Axonis Unveils Decision Governance Framework to Tackle AI Debt
Ai4
Enterprise AI adoption risks accumulating indefensible decision debt unless organizations establish durable records that combine human attestation with frozen cryptographic evidence chains.
## Background
Published by the channel Ai4 on YouTube on August 20, 2026, this presentation features Todd Barr, CEO of Axonis. The page description outlines the limitation of model explainability in regulatory environments, introducing the concept of 'decision debt' and arguing that human decisions—backed by frozen evidence chains and clear attestation—are the true units of AI accountability.
## TL;DR
Todd Barr makes the case that AI governance focuses too heavily on model explainability while ignoring human decision accountability, leading to accumulated 'AI-assisted decision debt.' To make AI-assisted outcomes legally and operationally defensible, organizations must implement frameworks that make decisions reproducible, attributable to human actors, fully auditable through frozen evidence chains, and refusable when evidence is weak. Grounded in high-stakes examples like real-time flood early warning systems, Barr argues that treating decisions as data accelerates execution and establishes a structured feedback loop for continuous organizational learning.
## Atmosphere & style
The presentation is authoritative, pragmatic, and grounded in senior-level software and intelligence-community expertise. Barr delivers an intellectually sharp narrative that contrasts current enterprise governance missteps with the hard realities of regulatory and legal scrutiny. Watching the talk feels like a clear-eyed reality check for AI builders and executives, shifting the room's energy from theoretical compliance metrics to operational, real-world defense.
## Key takeaways
- [00:04](https://www.youtube.com/watch?v=QIJWyt8TStg&t=4s) Axonis approach focuses on decisions rather than just models or data as the primary unit of AI governance.
- [00:04](https://www.youtube.com/watch?v=QIJWyt8TStg&t=4s) Three core realities of high-stakes decision-making are that evidence is distributed, decisions get reopened under scrutiny, and ultimate accountability remains with a human.
- [02:54](https://www.youtube.com/watch?v=QIJWyt8TStg&t=174s) Model explainability tools explain algorithm outputs, but regulators, courts, and inspectors general ask who decided, what they knew at the time, and if that evidence can be proven.
- [02:54](https://www.youtube.com/watch?v=QIJWyt8TStg&t=174s) Enterprises lack a system of record for the decision-making process itself, as most human decisions occur in ephemeral settings like Zoom, Slack, or emails.
- [06:11](https://www.youtube.com/watch?v=QIJWyt8TStg&t=371s) AI collapses the Observe, Orient, Decide, and Act (OODA) loop into direct action, creating 'AI-assisted decision debt' when rapid adoption disconnects human reasoning from action without a durable record.
- [08:32](https://www.youtube.com/watch?v=QIJWyt8TStg&t=512s) A defensible decision requires four key properties: it must be reproducible, attributable, auditable, and refusable.
- [08:32](https://www.youtube.com/watch?v=QIJWyt8TStg&t=512s) Human attribution must capture non-standard choices, including explicitly overriding AI recommendations or choosing to take no action.
- [08:32](https://www.youtube.com/watch?v=QIJWyt8TStg&t=512s) Decision systems must maintain explicit refusal thresholds to decline recommendations when input evidence is too thin or unsupportable.
- [12:23](https://www.youtube.com/watch?v=QIJWyt8TStg&t=743s) Simplicity Integration uses Axonis as an intelligence layer to govern mission-critical early-warning flood evacuation decisions made by municipal operators.
- [12:23](https://www.youtube.com/watch?v=QIJWyt8TStg&t=743s) Treating 'decisions as data' accelerates execution by embedding compliance into workflows and creates a structured dataset to train and improve future AI models.
## Detailed walkthrough
### [00:04](https://www.youtube.com/watch?v=QIJWyt8TStg&t=4s) Rethinking AI Governance: The Decision as the Unit of Accountability
Todd Barr, CEO of Axonis, opens his presentation by acknowledging the panel that spoke right before him on AI governance, model evaluation, and data management. While those aspects are vital, Barr explains that Axonis approaches governance from a completely different angle: focusing on *decisions* rather than just models or data. He invites attendees to visit booth 1452 or join Axonis for a happy hour via a provided Luma link before diving into the origins of his perspective. Drawing from his 25-plus years in infrastructure software alongside co-founders Dr. Bauer and Chris Uncles—who each bring over 30 years of experience in the defense and intelligence communities building large-scale information networks—Barr outlines three fundamental realities of decision-making observed in high-stakes environments:
1. **Evidence is distributed:** Information required for consequential decisions rarely lives in a single database; in the real world (and in post-9/11 inter-agency intelligence sharing), data is scattered across multiple systems, partners, and jurisdictions.
2. **Decisions get reopened:** Any major decision will eventually be scrutinised or re-examined after the fact.
3. **Humans remain accountable:** Regardless of advances in AI agents, ultimate accountability rests with a human being.
- **Key Takeaway:** Model observability and explainability explain how a model reached an output, but regulators and courts focus on who made the decision, what evidence was known at the time, and whether that evidence chain can be proven.
[02:54](https://www.youtube.com/watch?v=QIJWyt8TStg&t=174s) What Regulators Actually Ask and the Limits of Model Explainability
Barr points out a stark mismatch between standard AI governance tools and regulatory reality. When facing a court, Congress, or an Inspector General, authority figures do not ask about model architecture or feature weights; they ask: *Who decided? What did they know at the moment of decision? Can you prove it?* While data science teams produce model cards, drift reports, and observability dashboards to explain how a model arrived at a state, these are properties of the model. Accountability, however, is a property of the *decision*.
Enterprises currently have systems of record for models (registries, evaluation suites) and systems of record for business outputs (ERP systems like SAP, CRM tools like Salesforce). Yet, there is currently no system of record for the decision-making process itself. Most corporate decisions happen in ephemeral settings—conference rooms, Zoom calls, Slack threads, or emails—leaving no structured, reproducible audit trail.
- **Model vs. Decision:** Model explainability answers how the algorithm generated a prediction; decision accountability documents who committed the organisation based on what specific context and evidence.
[06:11](https://www.youtube.com/watch?v=QIJWyt8TStg&t=371s) The OODA Loop, AI Compression, and "AI-Assisted Decision Debt"
To illustrate how AI alters human reasoning, Barr invokes the OODA loop (Observe, Orient, Decide, Act), developed by U.S. Air Force strategist John Boyd to explain fighter pilot success in the Korean War. AI tool usage accelerates decision-making by collapsing the first three phases (Observe, Orient, Decide) directly into Action inside a "black box" prompt-and-response workflow.
This compression creates what Barr terms **"AI-assisted decision debt."** As organisations use AI to process higher volumes of data at faster speeds, they widen the gap between human cognitive reasoning and the resulting outcomes. When a regulator eventually demands an explanation for past actions, companies operating without a decision record face an accumulated debt that is nearly impossible to repay.
- **Definition:** *AI-assisted decision debt* accumulates when rapid AI adoption disconnects human reasoning from action without maintaining a durable record of the context and evidence used.
[08:32](https://www.youtube.com/watch?v=QIJWyt8TStg&t=512s) The Four Properties of a Defensible Decision
To solve decision debt and make AI-assisted outcomes legally and operationally defensible, Barr outlines four essential criteria that any declarative decision governance framework must fulfill:
1. **Reproducible (Replayable):** The exact reasoning logic and state must be cryptographically sealed and decomposable step-by-step so the decision can be replayed in the future.
2. **Attributable (AI Proposes, Human Disposes):** AI must only propose actions; human operators remain responsible for final disposition. This principles-based separation of duties extends to capturing non-standard human choices, such as explicitly overriding an AI recommendation or choosing to take **no action** (a critical state that traditional systems like Slack or email completely fail to record).
3. **Auditable (Frozen Evidence Chain):** The system must freeze and store a unified set of immutable artifacts: the raw data state at the time, the signals/thresholds that triggered the process, the frozen decision ("addition"), and the formal attestation by the human reviewer.
4. **Refusable (Abstention over Weak Evidence):** A confident answer built on thin or hallucinated evidence is worse than no answer. The system must have explicit refusal thresholds and be capable of declining to make a recommendation when input data is insufficient.
- **Core Framework:** Replayable logic, strict human attestation with separation of duties, a frozen immutable evidence chain, and automatic refusal when evidence thresholds are not met.
[12:23](https://www.youtube.com/watch?v=QIJWyt8TStg&t=743s) Real-World Impact: Flood Early Warnings and "Decisions as Data"
Barr grounds these concepts in a mission-critical deployment involving Axonis customer Simplicity Integration, a company specialising in flood monitoring sensors and water analytics. Axonis acts as the intelligence layer, combining live sensor feeds, weather data, historical trends, and AI reasoning to present actionable choices to municipal operators.
When an operator must decide whether to issue an evacuation warning during a rising flood, lives and property hang in the balance. The operator must make a clear call—whether to warn or not to warn—and both states must be captured alongside the underlying evidentiary thresholds.
Far from simply satisfying compliance, treating **"decisions as data"** yields immediate operational benefits:
- **Faster execution:** Authority and compliance rules are built directly into the workflow, reducing unnecessary meetings and management escalations.
- **Continuous learning:** Capturing the complete context of past decisions creates a structured dataset. Organisations can train future AI models on how previous decisions were made and evaluated, creating a compounding feedback loop where "every decision can possibly be better than the last."
In closing, Barr challenges the audience to evaluate their own AI-driven processes: identify a major decision made using AI, check if you can determine who made it, where that evidence lives, and whether the decision can be faithfully reproduced. If the answer is no, he invites them to visit the Axonis booth to close the gap between model explainability and decision defense.
- **Customer Case Study:** Simplicity Integration uses Axonis to bridge flood sensors, weather inputs, and human operator attestations for critical early-warning evacuations.
- **Luma Event Link:** Attendees are invited to join the Axonis team for their evening happy hour via the event Luma link.
## Notable quotes
> [02:54](https://www.youtube.com/watch?v=QIJWyt8TStg&t=174s) who decided? what did they know? and can you prove it? — Todd Barr
> [00:04](https://www.youtube.com/watch?v=QIJWyt8TStg&t=4s) Evidence is distributed — Todd Barr
> [00:04](https://www.youtube.com/watch?v=QIJWyt8TStg&t=4s) Decisions get reopened — Todd Barr
> [08:32](https://www.youtube.com/watch?v=QIJWyt8TStg&t=512s) AI Proposes, Human Disposes — Todd Barr
> [08:32](https://www.youtube.com/watch?v=QIJWyt8TStg&t=512s) Abstention over Weak Evidence — Todd Barr
> [12:23](https://www.youtube.com/watch?v=QIJWyt8TStg&t=743s) decisions as data — Todd Barr
> [12:23](https://www.youtube.com/watch?v=QIJWyt8TStg&t=743s) every decision can possibly be better than the last — Todd Barr
## Mentioned
Todd Barr, Axonis, Ai4, Dr. Bauer, Chris Uncles, SAP, Salesforce, John Boyd, Simplicity Integration, Luma, Slack, Zoom
## Video description
Todd Barr - CEO, Axonis
When a regulator, a court, or an inspector general reviews an AI-driven decision, the first question is never "how does your model work" - it's "who decided? what did they know? and can you prove it?" Model explainability is necessary, but not sufficient: accountability lands on the human decision made on top of the model, and most organizations have no durable record of that decision at all — a gap that compounds, as AI compresses the time between insight and action, into what I call decision debt.
In this session I'll make the case that the decision, not the model, is the real unit of accountability, and walk through what it takes to make decisions reproducible, attributable, and auditable the moment they are made — human attestation with separation of duties, a frozen evidence chain, and a system disciplined enough to refuse when the evidence is too thin to defend. I'll ground it in real use cases, like a live AI-enhanced flood-warning deployment, and in why governing decisions well makes teams faster, not slower. If you build, audit, or answer for AI that drives consequential decisions, you'll leave with a sharper way to close the gap between a model you can explain and a decision you can defend.
Todd Barr, CEO of Axonis, argues that enterprise AI governance overlooks regulatory reality by focusing primarily on model explainability rather than decision accountability. Because legal bodies scrutinize the human context and evidence present at the moment of an action, organizations risk accumulating unmanageable decision debt unless they establish formal systems of record for decisions.
Regulatory Scrutiny Exposes the Decision Record Gap (2:54)
Barr asserts that standard enterprise AI governance suffers from a fundamental mismatch with legal and regulatory inquiries. When confronted by courts, Congress, or Inspectors General, oversight authorities rarely evaluate model weights or drift metrics. Instead, they demand to know who made a decision, what specific evidence was accessible at that exact time, and whether that factual chain can be verified.
While enterprises maintain dedicated systems of record for model evaluation and business outcomes such as ERP and CRM platforms, no equivalent infrastructure exists for the decision process itself. In practice, high-stakes organizational choices remain dispersed across transient communication channels, including Zoom calls, Slack threads, and emails, leaving no reproducible audit trail.
Compressed OODA Loops and AI Decision Debt (6:11)
Borrowing from military strategist John Boyd's OODA loop (Observe, Orient, Decide, Act), Barr observes that AI tools frequently compress the initial three cognitive phases into immediate action through automated prompt-and-response mechanisms. This rapid acceleration disconnects human cognitive reasoning from operational outcomes.
According to Barr, this disconnect generates what he defines as 'AI-assisted decision debt.' As enterprises deploy automated tools to process larger volumes of information at higher velocities, the inability to preserve the context and evidence behind each output creates a compounding liability that becomes practically impossible to resolve retroactively under regulatory review.
Architectural Criteria for Legally Defensible Decisions (8:32)
To counter decision debt, Barr outlines four technical requirements for declarative decision governance. First, decisions must be reproducible through cryptographically sealed, step-by-step logic that can be replayed in the future. Second, systems must preserve attribution under the principle that AI proposes while humans dispose, explicitly recording human overrides and determinations to take no action—a state standard collaboration tools routinely fail to capture.
Third, decision records require immutable auditability by freezing the underlying data state, triggering thresholds, recorded outputs, and human attestations. Finally, systems must enforce refusal thresholds, deliberately abstaining from making recommendations whenever supporting evidence is insufficient or hallucinated.
Operationalizing Decisions as Data for Continuous Learning (12:23)
Illustrating these principles, Barr points to Axonis's work with Simplicity Integration, where an intelligence layer synthesizes flood sensor feeds, historical patterns, and weather analytics to assist municipal operators issuing evacuation warnings. The system captures both affirmative warnings and deliberate non-actions alongside the evidentiary thresholds that justified them.
Barr contends that treating decisions as structured data delivers benefits beyond regulatory compliance. By embedding authority matrices and compliance rules directly into operational workflows, organizations reduce managerial escalations while creating a structured repository of past human-evaluated decisions that can train and refine future AI models.
Barr concludes that enterprise risk hinges on whether organizations can identify who authorized a past AI-driven outcome and prove the evidence behind it. However, adopting this paradigm requires enterprises to enforce strict evidentiary refusal thresholds and transition their decision-making out of unstructured communication channels into cryptographic records.
精炼阅读摘要
Axonis 首席执行官 Todd Barr 指出,当前人工智能治理过度关注模型本身,但监管机构和法庭真正核查的是具体决策过程;企业必须建立以“决策”为核心的记录系统,以填补模型可解释性与法律问责之间的空白。
模型可解释性与监管实际问责的错位 (2:54)
Todd Barr 认为,现有的数据科学治理工具侧重于生成模型卡、漂移报告和可观测性仪表板,这些工具仅能解释算法如何得出预测,属于模型层面的属性。然而,在面对法院、国会或监察长等监管机构的正式质询时,调查的核心往往是“谁做出了决策”、“决策当时掌握了哪些证据”以及“该证据链能否被证实”。问责制本质上属于决策而非模型。尽管企业拥有针对模型(如评估套件)和业务输出(如 SAP、Salesforce 等 ERP 或 CRM)的记录系统,但对于决策过程本身依然缺乏系统的记录机制,许多关键决定仍散落在会议室、Zoom 通话、Slack 讨论串或电子邮件中,缺乏结构化且可复现的审计追踪。
OODA 环压缩与 AI 辅助决策债务 (6:11)
结合美国空军战略家 John Boyd 提出的 OODA 环(观察、调整、决策、行动),Todd Barr 分析了人工智能对人类推理逻辑的改变。传统的决策流程需要经历从观察到行动的完整步骤,而 AI 提示词与响应的工作流倾向于将“观察、调整、决策”压缩并直接转化为行动,形成黑箱操作。Barr 将这种现象称为“AI 辅助决策债务”。随着企业依靠 AI 以更快的速度处理更大规模的数据,人类认知推理与最终行动结果之间的脱节加剧。如果缺乏持久的决策记录,一旦未来被监管机构要求倒查历史行为,企业将面临难以偿还的决策合规债务。
构建可抗辩决策的四大核心要素 (8:32)
为了化解决策债务,Barr 提出了使 AI 辅助决策在法律和运营上具备可抗辩性的四项治理标准。首先是“可重现性”(Reproducible),要求推理逻辑与状态必须经过密码学封存,以便未来能够逐步回放重现。其次是“可归属”(Attributable),坚持“AI 提议、人类决断”的职责分离原则,完整记录人类专家的最终处理意见,包括明确否决 AI 建议或选择“不采取行动”的状态。第三是“可审计”(Auditable),系统必须冻结并存储不可篡改的证据链组件,涵盖原始数据状态、触发阈值、决策内容及人工审核签署。最后是“可拒绝”(Refusable),即系统需设定明确的拒绝阈值,在输入数据不足时选择弃权,避免基于薄弱或幻觉证据给出看似确信的推论。
决策作为数据在洪水预警中的实践价值 (12:23)
Barr 列举了水资源分析与洪水监测传感器公司 Simplicity Integration 的应用案例。在该方案中,Axonis 整合实时传感器数据、气象信息及历史趋势,为市政操作人员生成疏散预警决策建议。面对涉及生命与财产安全的场景,系统要求记录操作人员发出警报或不发出警报的明确决断,并将对应的证据阈值同步冻结。Barr 指出,将“决策作为数据”记录下来不仅满足合规审计,还能将授权与合规规则内嵌于工作流程以减少多余审批,同时沉淀下来的结构化决策数据可用于训练未来的模型,从而形成正向学习反馈循环。
Barr 总结认为,企业应审视自身依赖 AI 做出的关键业务决策,确认能否明确决策主体、证据归档位置以及重现完整过程;如果无法做到,则意味着模型层面的透明度尚未转化为组织层面的合法抗辩力。
Detailed notes — zh
## Background
本内容由 YouTube 频道 Ai4 于 2026 年 8 月 20 日发布,主讲人为 Axonis 首席执行官 Todd Barr。视频简介指出,监管机构与法庭在审查 AI 决策时关心的核心是人类问责与证据链,而非单纯的模型原理;演讲旨在阐明决策才是问责的基本单元,并探讨如何通过固化证据链与明确职责来弥合模型可解释性与决策防御性之间的鸿沟。
## TL;DR
Todd Barr 指出,当前 AI 治理过度聚焦于模型可解释性,却忽视了真正承担法律与合规责任的是人做出的“决策”。AI 的快速介入粗暴压缩了传统的 OODA 思考闭环,使企业在缺乏决策记录系统的情况下盲目积累了巨大的“决策债务”。针对这一痛点,他提出了可辩护决策的四大支柱——可重现、责任可归属、可审计与可拒绝,强调系统在证据不足时必须具备主动弃权的纪律。结合洪水应急撤离等实战案例,演讲论证了将“决策即数据”不仅能免于合规审查危机、减少无效会议,更能通过沉淀人类推理经验反哺下一代模型进化。
## Atmosphere & style
整场演讲呈现出一种严谨、沉着且直击痛点的技术务实感,既有国家安全防御背景带来的高压警示,又有企业级架构师的从容与理性。Todd Barr 的叙述节奏清晰、层层递进,用冷峻而现实的监管三问打破了科技界对模型指标的盲目乐观,带给听众一种如芒在背的合规紧迫感。现场氛围在穿插着“消除冗长会议”的行业幽默中张弛有度,最终引导听众从单纯的技术狂热转向对生死关键决策的敬畏与审慎思考。
## Key takeaways
- [00:04](https://www.youtube.com/watch?v=QIJWyt8TStg&t=4s) AI 治理的核心基石应当从“模型与数据”转向“决策”,因为无论自动化智能体如何演进,最终承担法律与组织问责责任的始终是人类。
- [02:48](https://www.youtube.com/watch?v=QIJWyt8TStg&t=168s) 监管机构与法庭在调查 AI 行为时从不关心模型架构有多复杂,核心审查永远是三点:谁做出的决定、决策时掌握了哪些证据、以及能否拿出不可篡改的证明。
- [02:48](https://www.youtube.com/watch?v=QIJWyt8TStg&t=168s) “模型可解释性”仅是解释算法运作的技术属性,“决策可追责性”才是组织对外承担承诺与责任的真正单元,二者存在本质断层。
- [05:06](https://www.youtube.com/watch?v=QIJWyt8TStg&t=306s) 现代企业普遍拥有数据仓库和模型注册表,却严重缺乏用于承载核心决策过程的“记录系统”(System of Record),导致决策思维轨迹随沟通渠道散落丢失。
- [05:06](https://www.youtube.com/watch?v=QIJWyt8TStg&t=306s) 生成式 AI 将经典 OODA 循环中的观察、判断与决策环节粗暴压缩进黑箱,驱使团队直接快进到行动,持续累积隐性的“AI 辅助决策债务”。
- [08:32](https://www.youtube.com/watch?v=QIJWyt8TStg&t=512s) 合规且可辩护的决策必须确立四大支柱:密码学密封的可重现性、清晰的责任归属、不可篡改的冻结证据链,以及系统主动拒答的纪律性。
- [08:32](https://www.youtube.com/watch?v=QIJWyt8TStg&t=512s) 决策权责必须贯彻“AI 提议、人类拍板”的职责分离原则,同时“驳回模型推断”与“选择不采取行动”均属于必须完整留痕的关键决策。
- [11:29](https://www.youtube.com/watch?v=QIJWyt8TStg&t=689s) 系统必须具备证据不足时主动弃权(Abstain)与拒绝(Refusal)的能力,因为基于脆弱论据生成的自信建议往往比完全没有回答更具破坏性。
- [12:23](https://www.youtube.com/watch?v=QIJWyt8TStg&t=743s) 在洪水预警等生死攸关的关键任务中,决策系统必须同等严谨地捕获并固化“启动疏散预警”与“决定按兵不动”两类截然不同操作背后的完整实时证据链。
- [13:27](https://www.youtube.com/watch?v=QIJWyt8TStg&t=807s) 将“决策即数据”(Decisions as Data)正规化不仅能厘清权责、大幅削减低效协调会议,更能将人类推理轨迹转化为高质量训练资产,反哺并进化下一代模型。
- [14:33](https://www.youtube.com/watch?v=QIJWyt8TStg&t=873s) 检验组织 AI 治理成熟度的标准在于能否随时明确三件事:谁最终拍板、支撑信息留存在何处、以及数年后能否原样精确复现当时的决策切面。
## Detailed walkthrough
### [00:04](https://www.youtube.com/watch?v=QIJWyt8TStg&t=4s) 视角转换:从模型治理转向决策治理
在大会现场,Todd Barr 首先询问了听众有多少人参加了上一场关于模型与企业 AI 治理的分组讨论。他肯定了前一场讲座的重要性与专业性,但他指出,Axonis(展位号 1452)希望为现场观众带来一个截然不同的切入视角:在探讨 AI 治理时,绝不能只盯着模型和数据——这些固然至关重要,但真正的核心应当是“决策”(Decisions)。Todd Barr 自身拥有超过 25 年的基础设施软件经验,见证了多次底层架构的演进;而与他共同创立 Axonis 的两位合伙人 Bauer 博士与 Chris Uncles,则在国防与情报界深耕了 30 多年。他们曾构建过超大规模的信息网络与分布式情报系统,在极度复杂的现实环境中目睹了决策如何在规模化场景下崩溃。
根据在国防与情报部门的长期实践,他们总结了重大决策容易失败的三大核心原因。首先,支撑决策的证据极少集中在单一地点。很多企业试图通过将所有数据集中化来加速 AI 应用,但在现实世界中,决策所需的数据永远分散在各类异构系统之中;在情报与国防领域,这些数据更是分布在不同的盟友与跨国机构之间。特别是“9·11”事件之后,小布什总统明确提出必须打破壁垒、实现跨部门的情报共享,两位合伙人正是在这种跨系统协作的时代背景下磨炼出应对分布式数据的经验。其次,任何重大或关键的决策(consequential decision),在未来的某个时刻几乎必然会被重新调取、审查并追问原因,企业必须随时做好“翻旧账”的准备。最后,任何决策最终都必须有明确的人员来担责。无论当下关于自动化智能体(Agent)的讨论多么热烈,在可以预见的未来,最终承担问责责任的永远是人类。
- **演讲者与机构**:Todd Barr(Axonis 首席执行官),展位位于 1452 展台。
- **国防与情报经验**:合伙人 Bauer 博士与 Chris Uncles 拥有 30 余年国家安全级分布式数据与高风险情报系统构建经验。
- **决策失败的三大诱因**:证据的高度分散性(跨系统/跨部门)、重大决策必被事后重审的历史必然性、以及最终责任无可避免地落在人类肩膀上的制度要求。
---
### [02:48](https://www.youtube.com/watch?v=QIJWyt8TStg&t=168s) 监管者真正关心的不是模型,而是决策问责
当一家机构因为 AI 驱动的行为面临监管机构、法院或监察长(Inspector General)的质询,乃至站在美国国会听证会的 C-SPAN 镜头前时,监管者和法官的第一反应绝不是探究底层的神经网络参数或复杂的模型架构。监管核心永远是三个极其现实的问题:“谁做出了这项决定?”“在做出决定的那一刻,当事人掌握了哪些信息?”以及“你如何拿出确凿的证据,证明他们当时确实只知道这些?”现实中,问责机关根本不关心你的模型有多花哨,他们从始至终审视的都是实际产生的决策行为。
目前,科技界正大力推进模型可解释性、可观测性与治理体系的建设,数据科学团队产出诸如模型卡(Model Cards)、漂移监控报告(Drift Reports)以及评估套件等成果。然而,Todd Barr 指出,“模型可解释性”仅仅是模型本身的静态技术属性,它解释的只是系统如何根据既有数据运转至当前状态;而真正接受外界评判的则是“决策”,这是决策本身的问责属性——究竟是谁签字代表组织做出了承诺?他们当时依据的是什么具体证据?目前绝大多数企业根本没有承载这一决策过程的专用系统。因此,AI 治理的根本出发点不应是模型,而必须是将“决策”作为最基础的问责单元(unit of accountability)。
```mermaid
flowchart TD
accTitle: 模型解释性与决策问责的对比
subgraph ModelGov["模型治理(技术属性)"]
M1["模型卡与数据科学报告"] --> M2["可解释性 / 漂移检测"]
M2 --> M3["解释系统如何运行与处理数据"]
end
subgraph DecisionGov["决策治理(问责属性)"]
D1["谁代表组织做出承诺?"] --> D2["决策当下依赖何种冻结证据?"]
D2 --> D3["能否向监管机构提供可验证证明?"]
end
ModelGov -.->|"必要但不充分"| DecisionGov
```
---
### [05:06](https://www.youtube.com/watch?v=QIJWyt8TStg&t=306s) 缺失的记录系统与被 AI 压缩的 OODA 循环
现代企业架构中,不同环节都拥有明确的记录系统(System of Record):用于底层数据的数据仓库、用于 AI 资产的模型注册表(Model Registry),以及作为业务输出端的 SAP ERP 或 Salesforce 系统。然而,唯独最核心的“决策环节”缺乏记录系统。当下的绝大多数业务决策都发生在封闭的会议室、Zoom 线上通话、Slack 频道或非结构化的即时邮件往来中。这种随性的决策方式沿用了几十年,在传统环境下,如果发生事故,模型行为尚且能被数据团队部分复现,而当时的决策过程与思维路径却彻底散落无踪,根本无法重构。随着 AI 促使决策节奏成倍加速,无法重构决策上下文的弊端被急剧放大。
```mermaid
flowchart LR
accTitle: 传统 OODA 循环与 AI 压缩导致的决策债务
subgraph ClassicOODA["经典决策模型(Boyd OODA 循环)"]
direction LR
O1["观察 (Observe)"] --> O2["判断 (Orient)"]
O2 --> D["决策 (Decide)"]
D --> A["行动 (Act)"]
end
subgraph AICollapsed["AI 介入后的黑箱化模式"]
direction LR
AI_In["数据输入"] --> AI_Box["AI 快速黑箱处理<br/>(压缩观察、判断与决策)"]
AI_Box --> Fast_Act["快速行动 (Act)"]
end
ClassicOODA -.->|"AI 模糊了思考过程"| AICollapsed
Fast_Act ==> Debt["积累「AI 辅助决策债务」"]
```
为了阐释这种断层,Todd Barr 引入了美国空军战略家约翰·博伊德(John Boyd)在朝鲜战争期间提出的经典 OODA 循环理论(观察 Observe、判断/定位 Orient、决策 Decide、行动 Act)。博伊德当时研究为何美军飞行员的击落比明显优于对手,发现优秀的飞行员都在潜意识里严格遵循这一认知闭环:先沉着观察环境,建立态势感知,做出周密判断,最后实施行动;这种“慢即是快”(go slow to go fast)的思维闭环赋予了他们极高的作战效能。然而,现代生成式 AI 和自动化工具正在用户浑然不觉的情况下,将“观察、判断与决策”这前三个原本属于人类严谨反思的环节粗暴压缩进一个黑箱。很多人在使用 AI 辅助工作时深有体会:输入一堆提示词和数据,AI 迅速输出结果,思维被直接牵引到一个与初衷截然不同的方向。表面上这是一场高效的思想实验,实际上却跳过了一切认知推导,用户直接快进到“行动”,事后除了几行可能随时被清空的聊天记录外,根本无法还原各阶段到底调用了什么数据。
这种现象造成了 Todd Barr 所称的“AI 辅助决策债务”(AI-assisted decision debt)。企业借助 AI,以惊人的数据吞吐量和极高频次作出海量决策,但在人类大脑的严密审查与最终决策结果之间,鸿沟却被拉得越来越大。这种盲目累积的隐形债务就像一颗定时炸弹,一旦监管机构、法庭或监察员要求企业证明某项自动化决策的合理依据时,企业将面临彻底失语的合规深渊。
---
### [08:32](https://www.youtube.com/watch?v=QIJWyt8TStg&t=512s) 可辩护决策的四大支柱与证据链
面对不断膨胀的决策债务,企业必须建立起一套“可辩护的决策”(Defensible Decision)标准。一个能够在法庭与审查机构面前站得住脚的决策,必须具备四大核心属性:
1. **可重现/可回放(Reproducible / Replayable)**:决策绝不能是一次性的黑箱输出,决策过程中的核心逻辑本身必须成为一种可独立存在的技术工件(Artifact),并经过严格的密码学密封(Cryptographically sealed),确保其内容不被篡改且可验证。AI 模型可以提出行动建议,但整个决策链条必须能够逐层分解、精确回放到当初做决定的历史切面。
2. **责任可归属(Attributable)**:确立“AI 提议,人类拍板”(AI proposing and human disposing)的权力分立(Separation of Duties)原则。AI 或自动化智能体只能扮演信息汇集与方案建议的角色,绝不能直接拥有最终的处置与执行权;在组织内部,搜集决策证据的经办人/智能体与最终签署决策的责任人必须界限分明。更为关键的是,**“驳回模型建议”(Overrule)本身也是一项决策**,系统必须忠实记录当事人凭借专业经验判定模型出错的完整过程;同时,**“不采取行动”(No action)同样是一项决策**——在 Slack 或邮件沟通中,未予执行的操作往往悄无声息地被遗忘,但在面对监管问责时,系统必须能够完整证明当初为何选择不作为。
3. **可审计(Auditable)**:必须具备不可篡改的“冻结证据链”(Frozen evidence chain)。以 Axonis 的底层系统设计为例,当一个决策被触发时,平台会瞬间冻结所有原始输入数据、引发该决策流程的关键阈值与指标信号(Signals)、经过不可变固化处理的最终决策产物(称为 Edition),以及最终责任人的签名确认(Attestation)。
4. **可拒绝(Refusable)**:整个决策系统必须具备自我克制的纪律性。当外部输入的数据质量太差、支持论据过于薄弱或环境不符合防御标准时,系统必须能够明确拒绝给出回答或终止推进决策。
- **重放性与证据固化**:逻辑工件通过密码学签名密封,使整个决策过程像录像带一样可以在审计时随时原样回放。
- **治理权责隔离**:明确 AI 仅负责提议(Proposing),人类专责最终处置(Disposing),严格记录包括“驳回模型”与“选择不作为”在内的全类型决策行为。
- **证据链构件**:原始数据快照、触发信号/阈值、不可变决策实体(Edition)以及带有责任归属的签名证明(Attestation)。
### [11:29](https://www.youtube.com/watch?v=QIJWyt8TStg&t=689s) 封装决策与系统弃权:证据不足时的拒绝机制
要真正落实声明式决策(Declarative Decision),就必须清晰记录具体是哪一个人或哪些人对该决策进行了核准认证(Attestation)。Axonis 将所有相关的上下文、输入数据与人员签名打包封存为一整套制品(Artifacts),并将其持久化保存在权威记录系统(System of Record)中,这正是所谓“封装决策”(Sealed Decision)的运作方式。然而,仅能记录正面决策还远远不够;在严肃的业务场景中,“建立在薄弱证据上的自信回答,往往比完全没有回答更糟糕”(A confident answer built on weak evidence is worse than no answer at all)。
因此,一个健全的决策治理系统必须具备自我克制与弃权(Abstain)的能力。当底层数据不足或置信度不够时,系统坚决不能通过自行插值、臆测或捏造不存在的数据来强行给出建议;相反,它必须主动“拒绝”(Refusal)生成提案或指令,并将这次拒绝行为同样作为一条完整的决策记录进行归档保存。管理者与审计人员必须透彻理解系统内部设定的证据阈值与触发条件——究竟掌握了何种程度的数据与证据,系统才会触发提案或下达决策。这构成了声明式决策的四大支柱要素。
```mermaid
flowchart TD
accTitle: 声明式决策与系统弃权流向图
accDescription: 展示多源数据输入后,系统评估证据阈值并决定是生成可核准提案还是触发合规拒绝记录。
subgraph Input["数据与感知层"]
Sensors["传感器遥测"]
History["历史数据"]
Weather["外部气象/环境数据"]
end
subgraph Engine["Axonis 决策与推理引擎"]
Reasoning["AI 综合推理分析"]
Threshold{"证据是否达到防御阈值?"}
end
subgraph Output["执行与归档层"]
Proposal["生成建议提案"]
Attest["人类操作员核准认证"]
Refusal["系统主动弃权 / 拒绝生成"]
Seal["封存归档至系统记录库 (Sealed Decision)"]
end
Sensors --> Reasoning
History --> Reasoning
Weather --> Reasoning
Reasoning --> Threshold
Threshold -- "证据充足" --> Proposal
Proposal --> Attest
Attest --> Seal
Threshold -- "证据薄弱" --> Refusal
Refusal --> Seal
```
- **封装决策的核心构成**:将模型输入、上下文证据链、人类核准人签名与职责分离约束,统合为不可篡改的归档制品。
- **拒绝记录的审计意义**:弃权行为(Abstention/Refusal)与正向决策具有同等的合规地位,必须同样记录在案以备追溯。
- **动态证据阈值**:严密界定驱动提案生成的最低数据完备度,杜绝模型在信息盲区中产生虚假置信。
---
### [12:23](https://www.youtube.com/watch?v=QIJWyt8TStg&t=743s) 关键任务案例:Simplicity Integration 与洪水预警的生死抉择
谈及容错率极低的关键任务环境(Mission-Critical Environments),没有什么比洪涝灾害中的水流破坏力更为严峻与紧迫。Axonis 的代表性客户之一 Simplicity Integration 是一家深耕水文、洪灾与水利传感技术的专业机构。在这套防洪预警体系中,Axonis 充当了核心的“智能决策层”——横跨在水文传感器阵列、海量历史水文数据以及实时天气预报之间,将多源异构数据与 AI 的综合推理能力结合起来,直接推送到一线操作人员的屏幕前。
对于身处市政应急部门的操作员而言,他们的职责是紧盯这些复杂交织的实时数据,并拍板做出极其沉重的生死抉择:何时应当正式向居民发布疏散指令、强制大家撤离家园。这是一项直接关乎成百上千人生命财产安全的决断,系统必须能够同时精准支持“发出警报”或“暂不发出警报”这两种截然不同的决定,并完整记录两种状态下的所有事实依据与操作链路。无论是预警撤离还是按兵不动,背后的推理逻辑都必须经受得住事后法律与公众的严苛审视。
- **多维数据融合**:集成现场水文传感器、过往洪峰历史以及气象预报,经由 AI 引擎进行上下文推理。
- **双向状态捕获**:系统同等严谨地记录“启动疏散预警”与“决定暂缓预警”这两种决策分支及对应的即时证据。
- **市政应急落地**:将前沿模型能力安全置于人类应急专家的掌控之下,确保每一次关键公共指令均有责可追。
---
### [13:27](https://www.youtube.com/watch?v=QIJWyt8TStg&t=807s) “决策即数据”的复利效应:从消除会议到自我进化
将决策正规化为数据资产——即“决策即数据”(Decisions as Data),不仅关乎合规防御,更能为组织带来直接的生产力飞跃。许多人误以为治理会让企业步调变慢,但决策层面的有效治理实际上会让组织“跑得更快”。当每个层级的决策权与责任边界都被清晰编码并固化到系统之中时,业务流程中的层级升级(Escalation)将大幅减少,原本为了权责拉扯而召开的繁冗协调会议也随之锐减——正如 Todd Barr 幽默所言,摆脱无休止的会议是“每个人都梦寐以求的解脱”。
更具变革意义的在于决策数据所带来的长期“复利效应”(Compounding Effect)。在人类历史上,这是我们第一次能够借助 AI 这个催化剂,完整捕获人类在做出关键判断时究竟衡量了哪些信息、经历了怎样的推理脉络,并将这些思考轨迹固化为结构化数据。一旦拥有了海量经过实战检验的高质量决策数据,组织就能反哺并训练下一代更强大的模型。“其远大前景在于,未来的每一次决策都能以过去的决策为基石,做得比上一次更加出色”,这正是决策治理带来的终极技术红利。
- **消除组织摩擦**:权限与授权链路内嵌于系统逻辑中,减少低效推诿、审批升级以及重复会议。
- **决策推理资产化**:不仅保留最终的勾选动作,更将当时面对的信息权衡与逻辑推导一并保存为训练数据。
- **正向迭代飞轮**:形成“真实决策 -> 沉淀为数据 -> 微调与强化模型 -> 输出更优决策”的持续自进化循环。
---
### [14:33](https://www.youtube.com/watch?v=QIJWyt8TStg&t=873s) 弥合治理鸿沟:模型可解释性与决策可追责性的根本区别
在总结演讲并厘清行业迷思时,Todd Barr 提炼了模型与决策两者的本质分野:模型可解释性(Model Explainability)回答的仅仅是“算法模型本身如何计算并得出某个推断或输出”;而决策可追责性(Decision Accountability)所解决的,则是“人类如何与该模型以及相关业务数据进行交互,并最终拍板形成一项具有法律与实际效力的决定”。只有跨越这道鸿沟,企业才算真正将决策转变成了系统性的数据资产。
在结束演讲之际,Todd Barr 给现场所有身处监管与关键业务环境的从业者留下了三道严肃的审视问题。如果你回想组织近期借助数据和 AI 做出的某项重大决策,你是否能够明确回答:究竟是谁最终做出了这项决定?支撑该决定的所有上下文信息被妥善保存在何处?在数月甚至数年后面对调查时,你是否能够一毫不差地将当时的决策场景完美复现?如果任何一个答案是否定的,就说明组织已经背负了沉重的决策债务,必须在构建 AI 治理架构的第一天起就将“决策捕获”纳入核心体系。
- **核心差异对照**:
- **模型可解释性**:揭示模型权重、注意力机制或算法得出预测分数的黑盒内部逻辑。
- **决策可追责性**:记录人机协同的具体行为、采纳或推翻模型建议的事由及责任主体。
- **企业自查三问**:
- 做出关键业务决定的责任人究竟是谁(Who decided)?
- 当时决策所依据的全套信息究竟保存在哪里(Where is it kept)?
- 该决策过程在审计时能否被精确且完整地复现(Can you reproduce it)?
## Notable quotes
> [02:48](https://www.youtube.com/watch?v=QIJWyt8TStg&t=168s) who decided? what did they know? and can you prove it? — Todd Barr
> [02:48](https://www.youtube.com/watch?v=QIJWyt8TStg&t=168s) the decision, not the model, is the real unit of accountability — Todd Barr
> [05:06](https://www.youtube.com/watch?v=QIJWyt8TStg&t=306s) go slow to go fast — Todd Barr
> [05:06](https://www.youtube.com/watch?v=QIJWyt8TStg&t=306s) AI-assisted decision debt — Todd Barr
> [08:32](https://www.youtube.com/watch?v=QIJWyt8TStg&t=512s) AI proposing and human disposing — Todd Barr
> [11:29](https://www.youtube.com/watch?v=QIJWyt8TStg&t=689s) A confident answer built on weak evidence is worse than no answer at all — Todd Barr
> [13:27](https://www.youtube.com/watch?v=QIJWyt8TStg&t=807s) Decisions as Data — Todd Barr
> [13:27](https://www.youtube.com/watch?v=QIJWyt8TStg&t=807s) 其远大前景在于,未来的每一次决策都能以过去的决策为基石,做得比上一次更加出色 — Todd Barr
## Mentioned
Todd Barr, Axonis, Ai4, Bauer 博士, Chris Uncles, 小布什, 约翰·博伊德 (John Boyd), Simplicity Integration, SAP ERP, Salesforce, Slack, Zoom, C-SPAN
## Video description
Todd Barr - CEO, Axonis
When a regulator, a court, or an inspector general reviews an AI-driven decision, the first question is never "how does your model work" - it's "who decided? what did they know? and can you prove it?" Model explainability is necessary, but not sufficient: accountability lands on the human decision made on top of the model, and most organizations have no durable record of that decision at all — a gap that compounds, as AI compresses the time between insight and action, into what I call decision debt.
In this session I'll make the case that the decision, not the model, is the real unit of accountability, and walk through what it takes to make decisions reproducible, attributable, and auditable the moment they are made — human attestation with separation of duties, a frozen evidence chain, and a system disciplined enough to refuse when the evidence is too thin to defend. I'll ground it in real use cases, like a live AI-enhanced flood-warning deployment, and in why governing decisions well makes teams faster, not slower. If you build, audit, or answer for AI that drives consequential decisions, you'll leave with a sharper way to close the gap between a model you can explain and a decision you can defend.
[Source](https://www.youtube.com/watch?v=QIJWyt8TStg)
Source quotes
[2:48] Todd Barr: who decided? what did they know? and can you prove it?
[2:48] Todd Barr: the decision, not the model, is the real unit of accountability
[5:06] Todd Barr: go slow to go fast
[5:06] Todd Barr: AI-assisted decision debt
[8:32] Todd Barr: AI proposing and human disposing
[11:29] Todd Barr: A confident answer built on weak evidence is worse than no answer at all
[13:27] Todd Barr: Decisions as Data
[13:27] Todd Barr: 其远大前景在于,未来的每一次决策都能以过去的决策为基石,做得比上一次更加出色
Source quotes
[2:54] Todd Barr: who decided? what did they know? and can you prove it?
[0:04] Todd Barr: Evidence is distributed
[0:04] Todd Barr: Decisions get reopened
[0:04] Todd Barr: Humans remain accountable
[6:11] Todd Barr: AI-assisted decision debt
[8:32] Todd Barr: AI Proposes, Human Disposes
[8:32] Todd Barr: Abstention over Weak Evidence
[12:23] Todd Barr: decisions as data
[12:23] Todd Barr: every decision can possibly be better than the last
Original transcript
[0:04] How many of you were in the last
session here? Okay, great. Uh,
[0:08] all that stuff is really important and I think
those folks knew certainly what they were talking
[0:13] about when it comes to governance of models and
AI in general in companies. What I plan to do
[0:19] today is just give you a different perspective.
We come at governance from a different angle.
[0:25] And I'd like to give you some perspective cuz I
think it's something that you need to be thinking
[0:28] about when it comes to governance is not just
models and data and things like that which are
[0:33] all really important, but also decisions. And
that's what we're going to talk about today. Um,
[0:38] just Exonum we are at booth 1452. We're
also having a happy hour tonight if you'd
[0:44] like to join us. There's a Luma link there for
you. You'll see that at the end as well. So,
[0:49] thanks for for joining us. I want to talk about
where we come from. Um, we are a software startup.
[0:55] My background is infrastructure software. Over
the last 25 plus years I've seen lots of different
[1:00] changes in infrastructure, but my colleagues are
these two gentlemen, Dr. Bauer and Chris Uncles.
[1:06] And these guys come from 30 plus years experience
each in the defense and intelligence communities.
[1:12] They've built huge scale networks and huge scale
information systems and tried to find intelligence
[1:19] across distributed data. And that's what we do.
Um, and so come by our booth and let's talk about
[1:24] it. But they come from these environments where
decisions are critical and they've seen decisions
[1:31] fail at scale. And there's a few reasons why
decisions fail that they've evidenced. So, one is
[1:39] the evidence of a decision rarely lives in one
place. So, many of you if you're in enterprises,
[1:44] you probably are centralizing your data trying to
get to AI as fast as possible. The truth is in the
[1:50] real world, the data you need to make decisions
is across lots of systems and always will be.
[1:56] In the intelligence and defense world, it's across
different partners, different countries. Um and
[2:02] what they did is grew up in a place after 9 9/11
in their careers where George W. Bush has said,
[2:09] "We need to start sharing intelligence across
all of these different um agencies." And that's
[2:15] the world that they kind of grew up in in their
careers. The second thing is every decision every
[2:20] consequential decision most likely gets reopened
at some point. You go back and you try to see why
[2:26] a decision was made. And you need to be prepared
for that. And the last one is somebody has to own
[2:31] it. At the end of the end of the day, there was
some great talk about agents and other things up
[2:36] here. At the end of the day, for the foreseeable
future, a human will end up being accountable.
[2:42] Um so that's where this uh this presentation and
this perspective comes from. And then we've built
[2:48] technology that helps enable this. So, what
does a regulator really want? How many of
[2:54] you have had to talk to a regulator, a court, a
Congress, anything like that? Raise your hands.
[3:01] Well, a regulator doesn't care about your model.
And probably won't for the foreseeable future.
[3:06] A regulator cares about who decided something that
happened, what decision was made, who decided it.
[3:14] Um what did that person know
at the time of decision?
[3:20] And can you prove what they knew at the time
of the of the decision? And we see this all
[3:25] the time when you see C-SPAN and you see
people standing up in front of Congress,
[3:29] this is the type of thing that you have to know if
you're going to be uh interrogated by an Inspector
[3:35] General, a court, or any sort of regulator. And
the truth is they don't care about your model,
[3:40] and they care about decisions. And that's
the different perspective we bring. So,
[3:46] you know, models are largely getting solved right
now. Again, that panel up here before was showing
[3:52] us how there's so much interesting technology and
processes and just work being done around model
[3:59] observability, governance, and explainability.
And that's really a property of the model,
[4:04] the explainability is. And that's about how did
the system get here into this state? How did
[4:10] this model use this data to do various things?
And there's outputs from the data science team
[4:15] like model cards and drift reports and things
like that. But you'll be judged on the decision.
[4:20] And the decision is the accountability that
you get from using the model for a decision.
[4:26] And that's really a property of the decision.
And like we said before, it's who committed the
[4:31] organization and what evidence did they use to
make that decision and commit the organization?
[4:37] And it's usually a human being. And right
now, there's really no system for that. And
[4:43] we're going to get back to that point here in a
minute. So, the whole point here is the decision
[4:49] not the model should be the starting point unit
of accountability when you're thinking about AI
[4:55] and governance. How do we make decisions? How
do we apply technology to those decisions? And
[5:00] then how do we stay accountable for
those decisions that we're making?
[5:06] So, um you have a system of record for
models now, and that's developing. And you
[5:10] have a system of record for your data, and you
often have a system of record for your outputs,
[5:14] you know, your SAP ERP system or your
Salesforce system. Those are outputs.
[5:20] But uh and and what governs those models today
are things like model registries, um you know,
[5:25] evaluation suites, drift, all these types of
things that many of you are working on today.
[5:31] But think about it, you really don't have
a system of record today for decisions.
[5:35] Most decisions happen either in a conference
room or on Zoom today. Or they happen in Slack.
[5:41] Or they happen maybe in an email. Um or some other
unstructured way where people make a decision and
[5:49] then they act and they go for it. And that's how
it's been done for years and years and years.
[5:53] Um and the problem is the model can start to be
reconstructed, but the decision can't. And today,
[6:01] uh as we start using AI and moving faster and
faster, the decision is going to have to be
[6:05] reconstructed as well. So, let me take a step
back to that defense and intelligence world.
[6:11] How many of you have heard of the OODA loop?
All right. Uh John Boyd was in the Air Force
[6:19] and he was a strategist in the Air Force
and he was studying why US Air Force pilots
[6:25] had a much better kill rate than uh Russian
airport uh uh pilots in the Korean War. And
[6:32] he observed that they follow naturally and then
he wrote it down this thing called the OODA loop,
[6:37] which is they observe what's happening, they
orient themselves to the context of what's
[6:42] happening, then they make a decision, and then
they act. And they were slower in doing that, but
[6:50] because they followed this process, they were more
effective. So, many of you have heard kind of go
[6:55] slow to go fast or something like that. Um that's
what they were doing and were more effective.
[7:01] The interesting interesting thing about AI today
is that it's collapsing those first three things
[7:06] right under our noses without us realizing it.
And so, many of you, just as I have, have gone
[7:12] into AI and you start working on a decision,
you're feeding it data, and you end up somewhere
[7:17] completely different than where you even started,
right? And it's uh it's a great intellectual
[7:22] exercise, but it's a black box. And that's the
problem. And so, you get to act, and then you have
[7:29] no sort of real record of how you got there, um
other than maybe a chat. You don't know what data
[7:34] was used at different times and and even the chat
sometimes gets, you know, compacted and goes away.
[7:39] So, that's really the problem. And what
it's doing is it's giving us a new problem,
[7:44] which I call AI-assisted decision debt. And
this is where you're basically making decisions
[7:51] faster and faster, more of them, and you're
putting distance between kind of your brain and
[7:59] the outcome because you're using AI to collapse
all those things that you were doing before.
[8:04] And this is the decision debt that you're
building right now if your company's using AI.
[8:09] And that decision debt can come calling when
you least expect it because if regulator says,
[8:16] "Hey, I need to know how you were making
these decisions." And so you're moving faster
[8:20] with more data, with more volume, with more
speed, and you're putting less or or more and
[8:25] more space between the brain that you're using
and the decision that's being that's being made.
[8:32] So, what's a defensible decision? And how do you
think about it when you think about uh capturing
[8:39] this information? Well, a defensible decision
has four properties. One is is it's reproducible.
[8:46] Two is it's attributable to someone. Three is
it's auditable, which means you have the evidence
[8:53] around the decision, not just the decision itself.
And four is the system has to be refusable, which
[8:59] means if the system has to be able to decline
to answer or capture a non-decision as well.
[9:05] And so um I'm going to go into each of these
a little bit deeper. One is the re-replayable,
[9:12] reproducible part. We actually call it replayable.
Can you go back and replay a decision that you
[9:17] made in the organization? And this is uh you know,
the logic itself is the artifact, and it has to be
[9:24] cryptographically sealed because uh it has to
be, you know, verified and verifiable. And um
[9:33] the model is proposed proposes the decision, but
it has to be decomposable back to the stage of the
[9:41] of the decision as you were making it.
So, replayability is one critical aspect.
[9:46] The second one is uh what we call AI proposing
and human disposing. So, AI only should be in
[9:54] the role of proposing, not making decisions
and disposing. Now, you might say, "Well,
[9:59] in a future world where we're going to have
agents making decisions or even in today's world,
[10:05] um you will have agents making hopefully less
consequential decisions, but there has to be a
[10:10] human attached to the accountability of those
decisions, and I'll leave it to the lawyers to
[10:14] figure out how that's going to work because it's
going to be an interesting topic. But we think of
[10:19] it as sort of separation of duties. The operator
who assembles the decision evidence is not
[10:26] necessary which might be an agent or an AI is not
necessarily the human who then disposes of it and
[10:31] makes a decision. Um overrule is a decision. So,
being able to say, "Hey, this model told me to
[10:38] do this and it said these are the things I should
be doing, but I know by my experience that that's
[10:43] wrong." We want to be able to capture that. And
then the last one is no action as a decision. And
[10:49] um there's really no other system that captures
no action, right? Your Slack and your email and
[10:54] those types of things usually no action just sort
of fades away. And so, being able to capture that
[11:00] means you're in a position where you can actually
defend a no a non-decision. The third one is um
[11:08] the frozen evidence chain. So, in our system,
for example, we freeze the data as it was today,
[11:16] the signals from the data, meaning the thresholds
that caused the decision process, what we call the
[11:23] addition, which is the frozen immutable decision
that was made, and finally the attestation,
[11:29] what human or humans attested that decision.
And we capture that all in one set of artifacts
[11:35] that we keep in a system of record. Um and that's
sort of how the uh the the sealed decision works.
[11:43] And then finally, the confident answer built on
weak evidence is worse than no answer at all.
[11:49] And so you have to have a system that can abstain
from telling you giving you even a proposal
[11:55] instead of interpolating data or making up
data that doesn't exist. You have to have as
[12:00] as we said before, a refusal uh to give you an
information or order decision has to be captured.
[12:06] And finally, you have to understand the thresholds
of the evidence and the data that you have that
[12:11] would cause a decision or cause uh a proposal to
happen. So, those are kind of the four pieces of a
[12:18] uh of a declarative decision. Um we
just to give you an example of this,
[12:23] if you think about mission-critical environments,
there's none more mission-critical than uh water
[12:31] and what water can do in in flood stage. And
uh so one of our customers is a company called
[12:38] Simplicity Integration. Simplicity Integration
is an expert in water and floods and sensors.
[12:45] And we are the intelligence layer that helps them
between the sensor data and the uh historical
[12:52] data that they might have and weather data and
brings that along with AI reasoning to operators.
[12:58] And if you think about that, if you're an
operator, which means you are in a municipality,
[13:03] and your job is to look at all this data and make
a decision on when to tell people to leave their
[13:07] homes, it's a mission-critical decision
that you're making that could save lives.
[13:11] And you have to be able to either warn or not
warn and capture both of those states. And so
[13:18] this is an example um and there's other examples
like this. So, there are some side benefits
[13:27] of what I call decisions as data. Um the first one
is kind of like what they were saying up here with
[13:34] AI governance make makes you go faster. Governing
decisions also makes you go faster. Um there are
[13:41] fewer escalations because authority is now baked
into your system. There are fewer meetings. Uh we
[13:48] could all use that. And finally, uh you can make a
better decision next time with that data. In fact,
[13:56] one one of the things I love here is sort of the
compounding uh effect of decisions as data. This
[14:04] is the first time in history and I think AI is
the catalyst where we could capture our decisions
[14:10] and then be able to learn from those decisions.
We see how we measured um the information we had.
[14:16] We see how we reasoned on it. We can capture all
that. We can save that as data, then we can train
[14:22] models on that and make better decisions next
time. I think the promise is that every decision
[14:27] can possibly be better than the last decision
you made, which is really the upside here.
[14:33] Um so, kind of to sum this
all up and close the gap,
[14:37] explainability gives you how the model
reached the output. And what decision
[14:43] uh accountability gives you is how the human
interacted with that model and with your data
[14:50] to create a decision. And now you have decisions
as data. So, uh just as you're leaving today,
[14:57] I would ask you to think about a couple of
things. One is um think about a consequential
[15:02] decision that you made or your organization made
with data and with AI. And then can you, you know,
[15:11] understand who made that decision and where is
that information kept? And can you reproduce
[15:16] that decision? And if the answer to those is no,
we'd certainly love to talk to you at our booth,
[15:22] but it's something for you to think about as
you're building your governance is how am I going
[15:26] to capture this in the future, especially if I'm
in a regulated or mission critical environment.
[15:31] Um thank you very much. Uh please join us at
the happy hour uh later. There's the Lumen link.