Why AI Agents Can Beat the Incumbents

Why AI Agents Can Beat the Incumbents — Elena Burger, Seema Amble, Vladimir Keil

Elena Burger, Seema Amble, Vladimir Keil

AI-assisted summary of Why AI Agents Can Beat the Incumbents — original source. Check the original for full context.

Source published:

Key ideas

  • Incumbent software giants like SAP and Salesforce own static enterprise records, but miss the 80% of unstructured operational labor—spanning hundreds of emails, CAD files, and spreadsheets—required to reach a final transaction price. (4:55)
  • Enterprise trust in autonomous agents is earned incrementally, starting with unmanaged tail spend under $50,000 where downside risk is low, before advancing to complex direct sourcing negotiations. (16:51)
  • Internal enterprise AI builds face a severe 'DIY trap': achieving 70% to 80% baseline accuracy does not equal 70% automation, because human teams must still audit every transaction until edge-case integration is complete. (40:00)
  • A 1% savings in enterprise procurement flows directly to the bottom line, delivering the equivalent P&L impact of a 10% increase in gross revenue across capital-intensive physical supply chains. (55:00)

Detailed notes

## Background Published on October 2, 2026, via RSS podcast distribution, this episode is hosted by a16z investors Elena Burger and Seema Amble, who interview Lio co-founder and CEO Vladimir Keil. The episode examines how AI-native startups can outmaneuver enterprise software incumbents by orchestrating the complex, unstructured workflows that take place outside traditional ERP systems of record.

## TL;DR Vladimir Keil explains that while legacy systems like SAP and Salesforce capture static transaction endpoints, up to 80% of actual procurement labor occurs across emails, spreadsheets, and cross-departmental negotiations. Lio tackles this through multi-agent architectures that scale across four tiers of autonomy, starting with low-risk tail spend to build enterprise trust before assisting in multi-million-dollar direct manufacturing sourcing. Keil also warns against the internal enterprise build trap—clarifying that 70% model accuracy does not equal 70% workflow automation—and explains how operational dependency, rather than a passive database record, forms the true defensible moat for vertical AI.

## Atmosphere & style The discussion is rigorous, highly pragmatic, and stripped of generic AI hype, resembling an insider strategic briefing between venture investors and an operator in the trenches. Keil brings an engineer's blunt candor to the conversation, contrasting the mundane reality of spreadsheets and procurement friction against the massive financial stakes of stalled production lines. The dynamic is intellectually brisk and collaborative, moving methodically from organizational psychology and software architecture to macroeconomic supply chain dynamics.

## Bulletin - `04:55` Incumbent software giants like SAP and Salesforce own static enterprise records, but miss the 80% of unstructured operational labor—spanning hundreds of emails, CAD files, and spreadsheets—required to reach a final transaction price. - `16:51` Enterprise trust in autonomous agents is earned incrementally, starting with unmanaged tail spend under $50,000 where downside risk is low, before advancing to complex direct sourcing negotiations. - `40:00` Internal enterprise AI builds face a severe 'DIY trap': achieving 70% to 80% baseline accuracy does not equal 70% automation, because human teams must still audit every transaction until edge-case integration is complete. - `55:00` A 1% savings in enterprise procurement flows directly to the bottom line, delivering the equivalent P&L impact of a 10% increase in gross revenue across capital-intensive physical supply chains.

## Key takeaways - `02:30` Systems of record record business outcomes but fail to execute the unstructured, cross-department workflows required to produce them. - `04:55` Procurement line items in legacy ERPs flatten weeks of work, dozens of meetings, and hundreds of emails into a single static number. - `06:22` AI agents divide across four functional tiers—retrieval, process, policy, and principal—with legacy software vendors largely stuck at the lower two levels. - `10:00` Incumbent software vendors face an innovator's dilemma: selling autonomous work conflicts directly with seat-based models and risks existing enterprise trust if early agents fail. - `11:51` Standard software solves the happy path of invoice syncing, which represents only 20% of the actual manual effort spent handling non-standard exceptions and fraud. - `16:51` Enterprises build operational trust by initially granting agents full autonomy over tail spend under $50,000, where manual procurement teams lack capacity to negotiate. - `20:00` Direct industrial procurement in aerospace, robotics, and data centers carries extreme physical stakes where single-component delays cause nine-figure factory halts. - `23:25` Predicting physical supply chain disruptions requires moving beyond internal ERP schedules to analyze live external signals like news and prediction markets. - `26:17` True end-to-end task automation requires multi-agent systems because human procurement workflows span multiple departments, stakeholders, and software tools. - `28:01` Requisitioners frequently bypass complex ERP interfaces, making multimodal intake of photos, PDFs, and spreadsheets essential for enterprise adoption. - `32:16` In direct procurement negotiations, up to 90% of the leverage comes from analytical pre-computation and live copilots benchmarking commodity indices and bill-of-materials costs. - `34:04` Closing the final 20% accuracy gap on proprietary industrial engineering tasks requires custom evaluation harnesses and outcome-based fine-tuning. - `36:34` Defensibility for vertical AI startups stems from operational dependency, as replacing an agent actively performing work creates far higher friction than swapping a static database. - `40:00` Achieving 70% accuracy on a prototype does not deliver 70% automation; closing the final 20% gap requires 80% of the total engineering effort. - `44:30` Bilateral automation between buyers and suppliers streamlines pre-negotiation spec analysis and compliance tracking where both parties share an interest in reducing cycle times. - `50:00` Forward-deployed engineering models in vertical AI succeed only when engineers are measured on KPIs that automate their own deployment workflows into the core product. - `55:00` A 1% reduction in corporate procurement spend delivers the same bottom-line P&L impact as a 10% increase in revenue, creating a massive economic opportunity in physical industries.

## Detailed walkthrough ### `00:00` Introduction: The High Stakes of Enterprise Procurement

In complex manufacturing environments, a single missed message can trigger massive financial fallout. If an aerospace enterprise is building an aircraft, it relies on thousands of external suppliers. Should a supplier email a routine notice that a single component will arrive two weeks behind schedule, overlooking that message can stall assembly lines and cascade into hundreds of millions of dollars in losses. While procurement was historically treated as an isolated back-office function, modern supply chains intersect directly with legal, finance, enterprise software platforms, and human operators across every department.

```mermaid flowchart TD accTitle: Incremental Trust Progression for Procurement AI Agents accDescr: Diagram illustrating how procurement AI agents evolve from human-in-the-loop oversight to handling larger autonomous negotiations.

subgraph S1["Human-in-the-Loop Foundation"] A["Supplier Interactions & RFQs"] --> B["Human Review & Feedback Loop"] B --> C["Agent Model Refinement"] end

subgraph S2["Autonomous Negotiation Milestones"] C --> D["$10K Negotiations"] D --> E["$20K Negotiations"] E --> F["$100K+ Negotiations"] end ```

Deploying autonomous agents into these environments requires navigating steep enterprise trust hurdles. Large organizations will not hand commercial negotiations over to an algorithm on day one. Instead, systems must operate with a human in the loop, absorbing feedback and operational nuances until stakeholders gain confidence in the technology's judgment. As Vladimir Keil explains: “No company and no enterprise starts with fully autonomous negotiation agents from day one.” Through this supervised learning curve, agents gradually graduate from low-stakes tasks to handling consequential negotiations valued at $10,000, $20,000, and eventually upwards of $100,000.

- Procurement mistakes in heavy industries like aerospace jeopardize hundreds of millions of dollars over single component delays. - Enterprises demand human-in-the-loop governance to calibrate agent responses before granting operational autonomy. - Trust accumulates incrementally, scaling deal thresholds as agents demonstrate reliable commercial judgment.

---

`02:30` Systems of Record vs. The End-to-End Job

The rapid advancement of foundation models has intensified the strategic debate between enterprise incumbents and AI-native challengers. Historically, startups competed directly against legacy platforms in an arms race of engineering and market capture. Today, market dynamics are complicated by incumbent software providers embedding foundation models directly into their existing products—such as Salesforce integrating Claude into its suite. Because incumbents already possess the customer relationship, proprietary database access, and deeply entrenched employee workflows, application-layer startups face urgent skepticism regarding their defensibility.

Despite these incumbent advantages, a system of record fundamentally documents business outcomes rather than executing the messy workflows required to produce them. As Seema Amble argues: “The legacy incumbent is limited to their system of record and that record that they have, and they're not completing the end-to-end job.” For instance, when a customer calls support after being billed following an account cancellation, solving the issue cannot be accomplished simply by referencing a single database entry. The resolution requires synthesizing chat logs, cross-referencing contract provisions, verifying billing ledgers, and issuing credits. Incumbent software remains compartmentalized within its specific database silo, whereas AI-native startups have the opportunity to orchestrate the entire workflow from initial customer inquiry through back-office remediation.

- Incumbents wield massive structural moats in data custody, established customer trust, and workflow adoption. - Bundling foundation models into existing enterprise suites (e.g., Salesforce with Claude) raises the competitive bar for outside software. - The primary strategic wedge for AI startups lies in end-to-end workflow ownership across fragmented systems rather than maintaining static database records.

---

`04:55` The Hidden Iceberg: Why Procurement Lives Outside the ERP

Enterprise resource planning (ERP) platforms present a deceptive illusion of simplicity. An ERP entry might display a single, tidy line item—such as an aluminum order finalized at $8,000. In reality, that final number represents the tip of an operational iceberg. Behind a single signed purchase order sit weeks of unstructured, collaborative labor that legacy software never captures.

```mermaid flowchart LR accTitle: The Procurement Workflow Iceberg accDescr: A comparison showing the visible ERP record versus the extensive unstructured labor happening outside of it.

subgraph Invisible["Unstructured Work Outside ERP"] direction TB M["30 Stakeholder Meetings"] E["500 Email Exchanges"] S["20 Spreadsheets"] CAD["3 Weeks of 3D CAD Modeling & Cost Engineering"] P["Supplier Pushback ($10K asking price)"] end

subgraph Visible["ERP System of Record"] R["Final Entry: Aluminum @ $8K"] end

Invisible -->|"Culminates in"| Visible ```

To secure that $8,000 price, internal teams may have navigated roughly 30 internal stakeholder meetings, exchanged more than 500 emails, iterated across 20 distinct spreadsheets, and countered a supplier pushing for $10,000. Furthermore, specialized cost engineers often spend up to three weeks analyzing 3D CAD models and financial projections to determine what a component ought to cost before any commercial negotiation even begins. Vladimir Keil highlights this disparity between the record and the reality: “So like most of the work in procurement actually happens outside of this ERP or any system of record.” Because incumbent systems only log the final transaction, they remain blind to the communication, engineering context, and negotiation dynamics where AI agents can deliver the greatest operational value.

- Final ERP entries flatten weeks of cross-functional friction into static prices. - Sourcing decisions routinely involve hundreds of emails, dozens of spreadsheets, and extensive engineering modeling before entering enterprise systems. - The vast majority of procurement context and negotiation takes place entirely outside of existing software records.

---

`06:22` The Four Tiers of AI Agents and the Incumbent Bottleneck

To evaluate how software platforms evolve beyond rudimentary chatbots, Seema Amble outlines a taxonomy of four distinct agent architectures: retrieval agents, process agents, policy agents, and principal agents. Each tier demands a progressively higher degree of autonomy, contextual synthesis, and qualitative judgment.

```mermaid flowchart TD accTitle: The Four Tiers of AI Agents accDescr: Hierarchical progression of agent capabilities from basic information retrieval to strategic commercial judgment.

Tier1["1. Retrieval Agent<br>• Chatbots & Search<br>• Pulls contract terms & verifies service outages"] Tier2["2. Process Agent<br>• Deterministic Execution<br>• Executes predefined refund workflows without human intervention"] Tier3["3. Policy Agent<br>• Interprets Ambiguity<br>• Determines if a 20-minute downtime constitutes a significant outage"] Tier4["4. Principal Agent<br>• Strategic Decision-Making<br>• Exceeds standard policy to protect strategic client relationships"]

Tier1 --> Tier2 --> Tier3 --> Tier4 ```

Using a telecommunications service outage as an illustrative benchmark, the functional differences across these four tiers become clear:

* **Retrieval Agents:** Function as conversational search layers over a database. When a customer calls regarding an outage, the retrieval agent pulls up contract provisions, confirms the incident occurred, and summarizes relevant account details without taking autonomous action. * **Process Agents:** Execute deterministic, rule-based tasks without human discretion. Once outage criteria are verified, the process agent automatically triggers the billing credit specified in the contract. * **Policy Agents:** Navigate ambiguity and exercise interpretation. If an outage lasted 20 minutes, the policy agent assesses whether the disruption qualifies as "significant" under ambiguous service-level agreements and determines whether compensation is warranted. * **Principal Agents:** Exercise high-level strategic reasoning to maximize overarching business objectives. A principal agent might decide to offer restitution far beyond contractual requirements to preserve a multi-million-dollar enterprise relationship after a severe service failure.

While major software vendors market agentic tools like Agentforce by emphasizing their potential to transform business processes, incumbent products remain predominantly constrained to retrieval and basic process execution. Incumbents benefit from vast distribution channels and pre-existing customer trust—allowing them to deploy features at minimal marginal cost—yet they face deep structural limitations. They are fundamentally held back by legacy system boundaries and internal revenue incentives that discourage them from venturing into subjective, high-liability decision-making tiers.

`10:00` Incumbent Conflicts and Lio's Spectrum of AI Agents

When legacy software vendors attempt to build advanced agents, they run directly into internal structural conflicts. Selling a product that provides workflow tools for a human support agent is fundamentally different from selling a solution that resolves the customer support issue end-to-end. As Seema Amble and Elena Burger point out, those two offerings target completely different buyers, pit different internal VP-led organizations against each other, and create conflicting incentive structures over what product is actually being sold.

```mermaid flowchart TD accTitle: Agent Spectrum by Complexity and Human Involvement accDescr: Progression from simple retrieval agents to high-risk autonomous agents with human-in-the-loop oversight. subgraph LowRisk["Low Risk / High Volume"] A["Retrieval Agents<br/>(Extract & Search Documents)"] --> B["Process Agents<br/>(Match Records, Update ERPs)"] end subgraph HighRisk["High Risk / Complex Reasoning"] B --> C["Policy & Exception Agents<br/>(Flag Fraud & Discrepancies)"] C --> D["Autonomous / Long-Running Agents<br/>(Tail Spend & Multi-Million RFQs)"] D -.->|"Oversight & Feedback"| E["Human-in-the-Loop<br/>(Engineers & Procurement Leads)"] end ```

When asked where Lio sits along the spectrum ranging from retrieval agents to process, policy, and principal agents, Vladimir Keil explains that the company spans across all of them depending strictly on risk and complexity. In lower-risk scenarios, Lio operates fully autonomously, whereas high-stakes workflows retain a human in the loop based on budget approval thresholds and operational risk. Addressing incumbent trust, Vlad contrasts existing internal reputation with external trust:

> “Incombents already have to trust, but this also means they like they can destroy the trust if they ship something like too early and the product maybe doesn't work or it's bad or it's like works decisions in a bad way.”

- **Organizational Friction in Incumbents:** Selling workflow software to augment human teams conflicts directly with selling agentic software that replaces or resolves the task, forcing different internal VPs to compete for budget and territory. - **Spectrum Coverage:** Lio deploys retrieval, process, policy, and autonomous principal agents, gating autonomy by budget authorization limits and deal complexity. - **The Trust Dynamic:** While startups must painstakingly earn customer confidence through proven reliability, incumbents already possess that trust—putting them at constant risk of squandering it if their initial agentic features fail or make damaging decisions.

---

`11:51` Invoice Processing: Why Software Covers Only 20% of the Work

Examining standard accounts payable and invoice matching highlighted the stark gap between legacy software coverage and actual enterprise labor. Traditional invoice software performs a predictable, mechanical process: it retrieves data from an incoming document, matches line items across corresponding purchase orders and receipts, and syncs the reconciled transaction back into systems like SAP or Oracle. While incumbent enterprise software was constructed to automate that straight-line flow, that "happy path" represents only a fraction of the real-world operational burden.

> “And then we figure out, okay, that's 100% of the software market. So that's invoice software. That's how you build it today. But it's actually only 20% of the work of the job to be done, of the problem.”

The remaining 80% of human effort is consumed by edge cases and exception handling: investigating fraudulent invoices, resolving pricing and quantity mismatches, and handling non-standard vendor terms. Lio quickly evolved from basic process automation into handling those complex exceptions. Vlad reflects that Lio benefited from being slightly ahead of the curve, starting three years earlier just before the breakthrough release of ChatGPT. While basic document retrieval seemed revolutionary to enterprise buyers three years ago, Lio used that initial foothold to pitch subsequent generations of process agents, autonomous agents, and long-running workflows.

- **The 80/20 Disconnect:** Standard invoicing software automates 100% of the predictable mechanical path, but that represents just 20% of the actual human labor required to manage invoices end-to-end. - **The Real Workload:** Enterprise teams spend the vast majority of their time on exception handling—uncovering fraudulent billings, reconciling missing purchase orders, and managing contract discrepancies. - **Rapid Iteration Cycle:** Lio tested market appetite by pitching advanced agent capabilities directly to enterprise buyers, confirming commercial demand, and shipping production deployments weeks later.

---

`14:04` Convincing Enterprises to Trust AI-Led Negotiations

Procurement is far more intricate than consumer purchasing; it is an economy-driving engine involving cross-functional stakeholders spanning finance, legal, cost engineering, and supply chain operations. Trusting an agent with internal back-office data is one hurdle, but allowing an external-facing AI agent to conduct negotiations directly with third-party suppliers represents a massive leap in enterprise risk.

```mermaid flowchart LR accTitle: Lio Progressive Enterprise Trust Model accDescr: Stepwise deployment from human-in-the-loop pilot to high-value autonomous negotiations. A["Initial Pilot<br/>(Human-in-the-Loop Evals)"] --> B["Low Spend Autonomy<br/>($10K – $50K Tail Spend)"] B --> C["Mid-Tier Spend<br/>($100K+ Sourced Deals)"] C --> D["Multi-Million Complex RFQs<br/>(Long-Running Agent + Expert Loop)"] ```

Enterprises are deeply skeptical of software vendor promises due to past disappointments with legacy tools that failed to deliver on marketing claims. Vlad notes that Lio manages this apprehension by implementing rigorous evaluations and an incremental, human-in-the-loop ramp-up:

> “No company and no enterprise starts with fully autonomous negotiation agents from day one. No one does that. Why? Because they don't trust us and they don't trust the technology from day one.”

Lio seeds each deployment with a standardized negotiation baseline, but adapts to the idiosyncratic operational practices of individual Fortune 10 enterprises by routing decisions through human operators. As procurement managers review and refine the agent's proposed counter-offers, the system captures institutional feedback. This gradually earns clearance to autonomously run $10,000, $20,000, and $100,000 negotiations. For multi-million-dollar strategic deals requiring hours of compute to inspect intricate 3D CAD models, Lio pairs the long-running agent directly with human cost engineers at critical milestones.

- **Cross-Functional Complexity:** Enterprise procurement decisions are rarely isolated to purchasing leads; they demand input and sign-off from legal, finance, and specialized engineering divisions. - **Overcoming Enterprise Skepticism:** Buyers carry significant fatigue from legacy vendors overpromising AI capabilities, requiring Lio to prove functionality via strict evaluation metrics rather than marketing claims. - **Escalating Financial Scope:** Trust expands incrementally—progressing from low-risk $10,000 orders to $100,000 purchases as the agent absorbs company-specific organizational patterns through human feedback. - **Expert-in-the-Loop for Large Contracts:** Multi-million-dollar deals deploy multi-hour, long-running agents that analyze complex 3D technical files, pausing to pull in specialized cost engineers before executing the next negotiation phase.

---

`16:51` Autonomous Tail Spend vs. Human-in-the-Loop High-Stakes Sourcing

The degree of autonomy Lio deploys is dictated by the category of spend and the underlying supplier relationship. Historically, large enterprises ignored all purchases below roughly $50,000 because procurement organizations simply lacked the headcount to review them. This created a recognized loophole in corporate spending:

> “Like this is maybe a hack for like other startups. You can just send an enterprise an invoice for 40K. They will probably not negotiate because they don't have the capacity to do so. Except they have Leo agents, then we are going to negotiate against you.”

For unmanaged tail spend under $50,000, the downside of utilizing an AI agent is virtually zero; because enterprises never negotiated those invoices in the first place, any savings the agent captures represents net-new value. If an agent occasionally miscalculates a low-value transaction, the business is no worse off than it was under manual neglect.

However, financial cost is not the sole variable in supplier management. Certain specialized expenditures—such as high-touch marketing services or dedicated audio engineers setting up a podcast studio for a venture firm like Andreessen Horowitz—involve institutional context and delicate vendor relationships. In those situations, buyers care deeply about tone of voice, partnership goodwill, and contract design rather than extracting every dollar of margin. For those sensitive interactions, Lio keeps procurement personnel actively in the loop to review messaging and protect strategic rapport, rather than letting the agent optimize purely for cost reduction.

- **The Unmanaged Tail Spend Hack:** Enterprising vendors often send $40,000 invoices knowing legacy enterprises will pay them without contest due to severe procurement capacity bottlenecks. - **Asymmetric Risk in Tail Spend:** Deploying autonomous agents against sub-$50,000 spend carries almost zero downside risk because companies previously left those transactions completely unnegotiated. - **Relationship-Driven Procurement:** Low-dollar expenditures tied to strategic partners, creative contractors, or specialized operational teams (e.g., podcast production) require human oversight to maintain goodwill and preserve the appropriate tone of voice. - **Contract Design Nuance:** Beyond top-line price concessions, agent workflows must navigate legal safeguards, service-level agreements, and long-term contract structures.

`20:00` Beyond Back-Office: Cross-Functional Complexity in High-Stakes Procurement

Procurement is far from an isolated administrative silo; it directly intersects with legal contract structures, finance, cost engineering, and commercial supplier relations. Vladimir Keil emphasizes that the people running these operations are not low-level back-office staff, but deeply specialized operators possessing intricate knowledge of proprietary workflows, enterprise constraints, and industry-specific regulations. These operators actively feed their domain insights into Lio’s long-running agents. Seema Amble and Elena Burger note how procurement has expanded from a historical back-office box into a cross-cutting nerve center touching legal, finance, and diverse software systems. When asked to ground this complexity in a tangible vertical—such as manufacturing humanoid robotics, drones, or commercial aircraft—Vlad makes it clear that Lio is not built for routine office supplies.

Vlad dismisses commodity procurement as long-solved table stakes: “When we as Lio, when we talk about procurement of purchases, like we think, don’t talk about laptops and pencils. We think that’s solved also by Lio agents, but that’s easy. We solved this three years ago.” The true challenge lies in capital-intensive physical builds: assembling an aircraft, standing up a robotics line, or building out the hyperscale data centers required for the AI boom. In these environments, procurement requires coordinating thousands of suppliers. A delay on a single component can stall a factory line and jeopardize hundreds of millions of dollars.

Much of this risk hides inside mundane operational exchanges. A supplier might send an email buried among 500 unread messages in a procurement manager's inbox stating that a critical part will arrive two weeks late. In an ERP system of record, that update registers merely as a date shift from this Wednesday to next Wednesday. The software cannot discern whether that date slip is benign or a catastrophic disruption. Lio’s agents are designed not merely to extract text from emails, but to evaluate operational downstream impact and initiate resolution strategies autonomously.

- **Cross-functional scope**: Procurement bridges legal terms, financial cost engineering, and commercial supply chain strategy across multiple specialized stakeholders. - **High-stakes scale**: Building aircraft or AI data centers demands synchronizing thousands of vendors where missing a single component can trigger nine-figure project delays. - **System of record blind spot**: Legacy ERPs store flat metadata (such as an updated delivery date) without interpreting operational context or calculating financial exposure.

---

`23:25` Predicting Physical World Friction and Managing Supply Chain Risk

When software interacts with the physical world, certain disruptions—such as cargo falling off a container ship or unexpected road closures—are impossible to prevent directly. However, Vlad explains that mitigating these failures comes down to probabilistic reasoning and holistic context. While an AI agent cannot alter maritime weather or road accidents, it can quantify supplier reliability and forecast risk based on historical operational data.

Vlad illustrates this trade-off with a concrete sourcing scenario: a company may evaluate two suppliers, one of which fails to deliver 20% of the time but is ten times cheaper, while the other maintains a 99% fulfillment rate at a premium price. For a non-critical component, the cheaper option might be acceptable; for a mission-critical line-stopper, paying 10x more to ensure delivery is an obvious operational necessity. To make these determinations, Lio synthesizes internal enterprise history with external context, including global news, supplier-side demand signals, and even macroeconomic betting markets like Polymarket to detect impending supply chain shocks.

Vlad sees this contextual awareness expanding beyond internal procurement workflows: “And this is what we are building at Lio, right? So it’s much bigger than just procurement into a company, it’s more like intra-company and how enterprises are doing business with each other so like buyer and supplier side.” By understanding the objectives and constraints of both buyers and suppliers, autonomous agents can negotiate and clear transactions across corporate boundaries.

---

`26:17` Orchestrating End-to-End Workflows: The Architecture of Multi-Agent Systems

Elena asks Vlad to clarify what Lio’s multi-agent architecture looks like under the hood. Vlad explains that Lio maps its agents across different levels of risk and complexity, as outlined in Seema Amble's enterprise AI taxonomy. Completing an enterprise workflow end-to-end requires multiple agents because the underlying human process naturally involves around eight stakeholders across three departments and at least five distinct software applications.

Vlad reflects on Lio's technical evolution over the past three years. The platform initially began as a retrieval-focused copilot before shifting toward single-agent automation. The team quickly realized that a lone agent cannot reliably execute complex tasks like commercial negotiation without supporting agents monitoring legal contracts, assessing operational inventory, and checking external news feeds. Multi-agent coordination became essential for true end-to-end execution.

Vlad outlines the core design requirement for full workflow autonomy: “When we talk about like a multi-agent system, this is essentially what we are doing: we are solving like the task end-to-end and because the human-level task involves eight people, eight stakeholders, and maybe like three departments and five different software tools, we need to cover like all of those to do like the job end-to-end and those agents need to then communicate with each other.”

- **Historical progression**: Lio evolved from an initial retrieval copilot to single-task agents, and ultimately to specialized multi-agent systems. - **Enterprise integration footprint**: Tasks span an average of eight cross-functional stakeholders, three departments (procurement, engineering, legal/finance), and five software platforms. - **Inter-agent communication**: Individual agents pass structured state sequentially and conditionally, allowing contract agents, news monitors, and price benchmarkers to inform negotiation strategies.

---

`28:01` The Life of a Bolt: Anatomy of an Autonomous Procurement Cycle

To illustrate the concrete mechanics of Lio's multi-agent system, Elena asks Vlad to walk through the end-to-end procurement of a physical part—such as an airline or aircraft manufacturer like Boeing needing to procure a specialized bolt. Vlad explains that the journey begins with demand capture, a phase notorious for user friction. A construction worker or shop-floor engineer who only logs into a computer every other week usually despises navigating complex ERP tools like SAP. They do not know or care about general ledger (GL) accounts, spend categories, or framework master agreements.

Lio removes this barrier by allowing the user to submit demand through multimodal inputs—snapping a photo of the part, uploading a supplier quote, or dropping in an unformatted spreadsheet. Lio's intake agent automatically parses the demand, infers the relevant accounting codes, and queries internal inventory across neighboring manufacturing plants to see if the bolt can be transferred internally. If internal stock is unavailable, the sourcing agent queries both approved and external suppliers, drafts a request for quotation (RFQ), and dispatches it over email.

When supplier responses arrive, Lio ingests an unstructured mix of raw email bodies, attached PDFs, and messy spreadsheets. The retrieval agent normalizes the bid data and benchmarks pricing against historical and market baselines. If a savings opportunity exists, the orchestrator triggers a negotiation agent. Depending on the dollar value and strategic risk, the system can execute an autonomous negotiation, launch an electronic auction (e-auction), or initiate a human-in-the-loop workflow where the agent drafts negotiation parameters for human review.

Vlad summarizes the fundamental disconnect between front-line requisitioners and legacy ERP software: “No one cares outside of the procurement department about categories, GL accounts, framework contracts, no one cares. We in the procurement world care, but no one outside that cares.”

```mermaid flowchart TD accTitle: End-to-End Autonomous Procurement Workflow accDescr: Diagram illustrating Lio multi-agent workflow from demand intake to automated negotiation.

subgraph Intake ["Intake & Internal Check"] A["User Input: Photo / Quote / Excel"] --> B["Intake Agent (Assigns GL & Category)"] B --> C{"Check Internal Inventory"} end

subgraph Sourcing ["External Sourcing & RFQ"] C -->|"Not Available Internally"| D["Sourcing Agent (Selects Vendors)"] D --> E["Draft & Dispatch RFQ via Email"] E --> F["Ingest Unstructured Quotes (PDF / Excel / Email)"] end

subgraph Analysis ["Benchmarking & Resolution"] F --> G["Price Benchmarking & Impact Analysis"] G --> H{"Negotiation Strategy"} H -->|"Autonomous"| I["Autonomous Negotiation / E-Auction"] H -->|"Strategic"| J["Human-in-the-Loop Negotiation"] end ```

- **Intake without friction**: Requisitioners capture demand via photo uploads, vendor quotes, or spreadsheets, bypassing manual entry into SAP or other legacy ERP systems. - **Automated accounting categorization**: The agent infers GL accounts, spend categories, and contract frameworks without requiring requisition training from front-line staff. - **Internal vs. external routing**: The system checks regional plant inventory before engaging external vendors to avoid unnecessary spend. - **Unstructured parsing**: Responses spanning diverse formats (freeform email text, attachments, PDF spec sheets, Excel matrices) are ingested and structured automatically. - **Adaptive negotiation paths**: Depending on value, category risk, and benchmarked savings opportunities, Lio dynamically routes between autonomous negotiations, competitive e-auctions, or human-in-the-loop approvals.

`30:00` Indirect vs. Direct Procurement: Where Agents Deliver P&L Impact

Vlad explains that procurement workflows can run end-to-end autonomously—encompassing everything from order confirmation to shipment tracking and invoice processing. When thinking about where agents belong, Lio categorizes enterprise tasks across two axes: what teams already do thousands of times a day that they wish they could do zero times, and what they currently do zero times a day that would yield a massive P&L impact if done thousands of times. The latter involves autonomous negotiations on spend categories companies have historically ignored due to a lack of headcount.

```mermaid flowchart TD accTitle: Indirect vs Direct Procurement Workflows accDescr: Comparison of indirect procurement automation versus direct procurement deep analysis. subgraph Indirect["Indirect Procurement (High Volume, Broad Tail)"] direction TB I1["High volume: MRO parts, laptops, pencils, studio builds"] I2["50,000+ suppliers across tail spend"] I3["Goal: Autonomous negotiations on spend never negotiated before"] I1 --> I2 --> I3 end

subgraph Direct["Direct Procurement (Mission-Critical Strategic Spend)"] direction TB D1["Core inputs: Airplane parts, drones, robotics"] D2["100 to 2,000 strategically vital suppliers"] D3["Months-long negotiations, $1B+ spend per supplier"] D1 --> D2 --> D3 end ```

Vlad contrasts indirect procurement (MRO parts, factory buildouts, bolts, laptops, pencils, podcast studio construction) with direct procurement: - Indirect procurement deals with long-tail suppliers (often upwards of 50,000 vendors) where automated micro-negotiations uncover margin that was previously left on the table. - Direct procurement involves core materials directly needed to build a physical product, like an airplane, drone, or robot. Here, enterprises deal with only 100 to 2,000 vendors, but spend on a single supplier can easily exceed $1 billion. - Because the stakes are so high in direct procurement, an autonomous agent does not simply take over the negotiation. Instead, it acts as deep preparation support across months-long negotiations involving cost engineers who analyze aluminum indices, oil prices, and CAD drawings.

Vlad points out: “90% of the work is preparation. The end result that you see in your system of record is like, oh, instead of like one billion, I paid 900 million dollars.”

---

`32:16` Real-Time Agent Copilots in High-Stakes Negotiations

Elena asks whether direct procurement means agents operate behind the scenes or sit directly across the table like an automated negotiator shaking hands. Vlad clarifies that it is primarily back-of-house, doing the heavy analytical lifting that ten people would normally spend three months preparing. However, real-time in-negotiation assistance represents an emerging frontier for direct procurement:

> “Imagine while we are negotiating, I would have real-time insights on my screen popping up where you tell me the indice for oil changed 10%. So it's increased by 10%. So that's why we need to increase the prices by 10%. And I would have an immediate pop-up of like, that's true, oil increased by 10%, but the product has only 30% of oil contained. So your overall price should only increase maybe only by 4%.”

By pulling live index data, contract clauses, and raw material bill-of-materials breakdowns during the conversation itself, human negotiators can instantly counter supplier cost-increase claims with hard math rather than conceding ground or pausing the meeting to run the numbers.

---

`34:04` Foundation Models, Custom Harnesses, and Outcome-Based Training

When asked how Lio handles fine-tuning and model selection relative to companies like Harvey or Decagon, Vlad notes that Lio treats underlying foundation models across various providers largely as commodities for generic enterprise tasks—reading documents, generating PDFs, and drafting spreadsheets. In many standard workflows, combining an off-the-shelf foundation model with a robust harness can solve 100% of the job to be done.

```mermaid flowchart LR accTitle: Model Architecture for Procurement accDescr: Pipeline showing commodity models versus outcome-based fine-tuning. subgraph Commodity["Standard Tasks (100% via Harness)"] F1["Foundation LLMs (Any Provider)"] --> H1["Custom Harness"] H1 --> O1["PDF & Excel Processing, Admin Tasks"] end

subgraph Specialized["Complex Engineering & Benchmarking (Needs Fine-Tuning)"] F2["Proprietary Enterprise Data"] --> M1["Outcome-Based Training"] M1 --> O2["Should-Cost Modeling (CAD Drawings)"] M1 --> O3["Price Benchmarking (BCG vs. McKinsey Quotes)"] end ```

For specialized industrial workflows, however, the standard "foundation model plus harness" paradigm caps out at around 80% accuracy. Bridging the final 20% requires fine-tuning on proprietary data: - **Should-Cost Modeling:** Cost engineers examine technical drawings to calculate the bottom-up target price of an engineered part based on machine time, materials, and labor. - **Price Benchmarking:** Benchmarking proprietary B2B service quotes that are not publicly available. Vlad compares this to assessing two identical-looking consulting proposals from BCG and McKinsey that differ by 10x in price, or pricing out professional video content creation: an experienced procurement lead uses gut instinct and implicit taste rather than codifiable rules.

To capture that qualitative intuition, Lio looks beyond standard conversational text completion toward outcome-based training that maps input proposals directly to an accurate target price.

---

`36:34` Moats, Dependency, and the Durability of Vertical AI

Elena turns to Seema to discuss how durable vertical AI companies build defensibility as AI research labs partner directly with incumbents. Seema notes that trying to plot out a rigid multi-step roadmap to a moat from day one is a trap:

> “If you look back at all the best businesses, at the early stages, they were just thinking about, okay, I'm winning customer trust, I'm selling more to them, and there's a lot of opportunity versus, okay, I'm going to do these six steps and then get to the seventh step, and then we'll have them vote.”

Seema argues that true defensibility stems from creating structural operational dependencies: - Traditional software (like an old CRM) served as a passive database or log of closed deals. - Vertical AI agents actively execute work: owning deal preparation, running outbound, triaging inbound, and completing analysis. - Once a business hands over end-to-end execution of a core function to an agent, replacing that product becomes far more disruptive than swapping out a static system of record. - Moat characteristics like high switching costs, stickiness, and proprietary data flywheels are natural byproducts of owning the workflow, not things that can be designed in isolation before achieving product-market fit.

`40:00` The DIY Trap: Why 70% Performance Does Not Equal 70% Automation

Three years ago, Lio’s very first product tackled a straightforward yet high-impact workflow: retrieving unstructured data from vendor quotes and entering it cleanly into SAP. Originally built and sold by a team of just three or four engineers, that exact workflow has now become a standard eight-hour applicant case study for prospective engineers applying to work at Lio. This dramatic shift highlights how trivially easy it has become to construct basic AI prototypes, which inevitably prompts enterprise procurement departments to wonder why they should not simply build their own internal solutions in a matter of months. However, Vladimir Keil explains that while an internal team can assemble a prototype in an afternoon, hitting roughly 70% accuracy, that baseline metric falls critically short in real-world operations. As Vlad points out: “And the problem is 70% of the performance or accuracy or however you measure it, it depends really on the task, doesn’t mean 70% automation, right?” When a system operates at only 70% reliability, employees still have to review and verify 100% of the output, creating more busywork than existed before.

Seema Amble notes that while surging enterprise familiarity with foundational models and ChatGPT is a net positive that builds trust for vertical AI applications, do-it-yourself software initiatives almost always stall out. Recounting a conversation with the management team of a Fortune 500 company two or three weeks prior, Seema describes their failed attempt to construct an in-house cash collection application. The internal team struggled with poor-quality organizational context, messy screen grabs, and inconsistent meeting recordings. The project completely unraveled when confronted with real-world infrastructure complexity: the company was running two distinct ERP instances and preparing to acquire a third, leaving them paralyzed over who would maintain mappings, manage ongoing system integrations, and update complex edge-case rules. Enterprise leaders eventually remember the historic lesson of IT: custom internal tooling distracts from a company's core business competency.

Vlad reinforces this dynamic using the Pareto principle, explaining that bridge from an 80% prototype to a production-ready system absorbs 80% of the total engineering effort. That final stretch demands deep vertical domain data, persistent agent memory, robust workflow engines, and reliable enterprise integrations. Unless a Fortune 150 enterprise intends to turn managing an autonomous procurement workforce into its primary strategic competency, attempting to build and maintain that infrastructure internally is an inefficient use of resources.

- **The Hiring Benchmark**: Lio’s initial commercial product—a retrieval agent that ingests vendor quotes directly into SAP—is now given to engineering candidates as an 8-hour take-home challenge. - **The Automation Fallacy**: Achieving 70% model accuracy does not equal a 70% reduction in workload; human staff must still audit 100% of incoming records to catch errors, eliminating the efficiency gains. - **The Maintenance Overhead**: Internal projects stumble when mapping messy operational exceptions across multiple legacy ERP systems, especially during corporate mergers and acquisitions.

```mermaid flowchart TD accTitle: Internal AI Build vs Production Reality accDescr: Diagram contrasting an internal prototype hitting an accuracy plateau with the full requirements needed for production deployment.

subgraph Internal["Internal Build Attempt"] A["8-Hour Prototype"] --> B["70% - 80% Accuracy"] B --> C["100% Manual Human Verification"] C --> D["Net Increase in Operational Burden"] end

subgraph Production["Production Enterprise Agent Harness"] E["The Final 20% Hurdle"] --> F["Custom ERP Integrations"] E --> G["Persistent Agent Memory"] E --> H["Edge-Case Exception Handling"] E --> I["Multi-System Synchronization"] end ```

---

`44:30` Bilateral Agents: When Both Buyers and Suppliers Automate

Looking ahead to market maturity, Elena Burger asks how dynamics shift when suppliers also deploy AI agents, and whether procurement will soon feature software agents negotiating directly against each other. Vlad confirms that bilateral agent interactions are inevitable, but notes an unexpected dynamic in today's industrial sectors. While software sales teams are traditionally seen as tech-forward compared to "unsexy" procurement teams, suppliers servicing major Fortune 5000 industrial accounts are surprisingly behind on real automation. They frequently use transcription apps like Granola or record sales calls, but lack deployed autonomous agents. Crucially, industrial enterprise buyers—such as automotive manufacturers—command massive leverage over their suppliers. They dictate product quality tolerances, response formats, and RFQ protocols, creating a clear opening for buyers to mandate that suppliers interface directly through Lio agents, allowing Lio to coordinate both sides of the transaction.

```mermaid flowchart LR accTitle: Bilateral Agent Coordination Model accDescr: Flowchart illustrating how buyer and supplier agents share unified incentives across upstream tasks despite adversarial pricing negotiations.

subgraph Upstream["Aligned Upstream Workflows (5,000 Shared Tasks)"] direction TB T1["RFQ Specification & Intake"] T2["Engineering & Compliance Reviews"] T3["Data Center & Aircraft Timeline Tracking"] T4["Frictionless Documentation Hand-offs"] end

subgraph Parties["Bilateral Parties"] B["Enterprise Buyer Agent"] S["Industrial Supplier Agent"] end

subgraph Downstream["Adversarial Zero-Sum Stage"] P["Final Contract Price Negotiation"] end

B --> Upstream S --> Upstream Upstream --> Downstream ```

Elena and Seema draw a parallel to the legal sector, where opposing law firms representing adversarial clients still benefit tremendously from shared platforms that track current draft versions, log open issues, and verify agreed-upon terms without tedious human back-and-forth. Vlad emphasizes that while final price negotiation is inherently a zero-sum contest, the actual pricing agreement is merely the end result of thousands of cooperative upstream operational tasks. In massive manufacturing projects—such as constructing aircraft or building hyperscale data centers—buyers and sellers have perfectly aligned incentives: buyers want fast time-to-market, and suppliers want frictionless sales cycles without spending six months parsing complex RFQ responses. As Vlad summarizes: “Sales wants to have as little friction as possible. Buyers want to have a really fast time to market.” Deploying agents on both sides to automate those preliminary tasks benefits both parties, regardless of who negotiates the final number.

- **Procurement Leverage**: Industrial enterprises hold significant sway over vendor behavior, allowing them to dictate the software interfaces, compliance standards, and submission protocols that suppliers must use. - **Shared Incentives Over Zero-Sum Friction**: Although final price margins represent conflicting financial interests, the preceding 5,000 steps—including scope definitions, spec analysis, and delivery schedules—share an identical goal: maximizing execution speed and removing friction. - **The Legal Precedent**: Adversarial entities in high-stakes fields already rely on shared coordination software to catalog agreed terms and outstanding deal points without requiring constant administrative friction.

---

`48:30` Forward-Deployed AI and Customization at Scale

Elena raises a traditional rule of enterprise B2B software: vendors should avoid heavy product customization for individual enterprise clients to preserve software margins and avoid becoming professional services firms. She questions whether large language models and autonomous agents fundamentally break that rule by enabling hyper-customization at software-like speeds. Seema agrees that the paradigm has shifted, observing that early-stage enterprise AI companies rely heavily on forward-deployed engineering teams to bridge current product gaps. This high-touch deployment model exists because legacy enterprise data environments are notoriously disorganized. As Seema explains: “And part of that is because the state of the customer data and understanding customer N is a lot harder than understanding N plus one.”

This forward-deployed dynamic creates an asymmetric advantage for nimble AI startups over entrenched legacy software incumbents. Traditional enterprise software giants rely on rigid implementation teams whose client work is treated as an afterthought rather than a real-time feedback channel for the engineering roadmap. In contrast, modern AI startups use forward-deployed engineers to build robust automated evaluation frameworks and capture critical user edge cases directly from production environments. By feeding operational nuances straight back into the agent harness, the model continuously learns, refining agent performance across each successive enterprise rollout.

- **Forward-Deployed Advantage**: Early enterprise AI deployments require hands-on technical work to untangle idiosyncratic customer data environments, but each deployment systematizes learnings that make onboarding subsequent customers faster. - **Structural Incumbent Weakness**: Legacy enterprise vendors isolate their services and implementation teams from core engineering, while AI-native startups treat implementation as an active product feedback and evaluation engine. - **Learning Loops**: Vertical AI systems leverage automated evals and real-time operational feedback to refine agent performance and custom system behavior over time.

`50:00` Automating the Forward-Deployed Engineer

```mermaid flowchart TD accTitle: Forward-Deployed Engineering to Self-Service Evolution accDescr: Three evolutionary stages showing how enterprise software implementation transitions from manual consulting to self-service AI tooling.

subgraph Legacy["Legacy Model"] L1["Accenture / Systems Integrator"] -->|"Manual Customization"| L2["Core ERP / SAP Deployment"] end

subgraph Hybrid["FDE Transition Model"] F1["Lio Forward Deployed Engineers"] -->|"Spec Nuances & Build Integrations"| F2["Multi-Agent Workflow"] F1 -->|"Automate Own Role / FDE KPI"| F3["Turn Work into Code"] end

subgraph SoftwareDriven["End State: Pure Software"] S1["Automated Deployment & Self-Service"] -->|"Enterprise Knobs & Levers"| S2["Scalable Enterprise Rollout"] end

Legacy -.-> Hybrid Hybrid -.-> SoftwareDriven ```

Seema Amble and Vladimir Keil explore how enterprise deployment is shifting away from heavy professional services. In the legacy era, deploying and tailoring systems like SAP required bringing in an army of consultants from firms like Accenture. Modern software startups replaced that with forward-deployed engineering (FDE) teams, but the next frontier is automating the deployment itself. Seema notes that portfolio companies are moving quickly toward software where customization is handled automatically, enabling customers to adjust their own operational parameters via software levers rather than relying on humans.

Vladimir confirms that this philosophy dictates Lio's organizational design: 85% of their personnel are engineers, and even those without official engineering titles typically hold engineering backgrounds. The explicit objective is to prevent Lio from morphing into an IT consultancy while tackling intricate enterprise nuances across direct procurement, indirect procurement, and finance. To scale without expanding headcount linearly, Lio gives its FDEs an unusual performance objective: automate their own day-to-day workflow. As Vladimir explains, their task is to convert repetitive manual onboarding and configuration into self-service product features, freeing them to move on to the next set of challenges.

- 85% of Lio's staff are engineers, and non-engineering roles predominantly require engineering backgrounds to avoid becoming a consulting practice. - Forward-deployed engineers at Lio are explicitly evaluated on automating their own deployment responsibilities into self-service tooling. - Vladimir Keil on engineering incentives: “Their KPIs, you're seeing this happening multiple times. Literally, your job is to automate yourself. And then if you automate yourself, you go to the next task.”

`51:30` Bots and Buyers: The Reality of Procurement

Elena Burger shifts the conversation to the "Bots and Buyers Summit," an event hosted by Lio a few blocks from their New York office, contrasting it humorously with Salesforce’s Dreamforce. Vladimir notes that this was their third summit, gathering over 100 enterprise C-level leaders, chief procurement officers (CPOs), and vice presidents. Despite the appearance of more than 500 specialized tools across landscape graphics on LinkedIn over the past 26 to 27 years, procurement remains universally dreaded. Requesters despise navigating it, suppliers find it painful, and procurement specialists themselves dislike working within their own departmental constraints.

Vladimir diagnoses the root problem: existing software vendors merely slapped digitizing layers over legacy processes without changing how people actually spend their days. Regardless of how many point solutions a company licenses, employees continue to coordinate through unstructured channels—endless email threads, Microsoft Teams messages, static PowerPoint decks, and sprawling Excel spreadsheets—all running without AI assistance. Rather than unveiling incremental standalone tools like an isolated invoice feature, Lio designs its workflows cross-departmentally, tracking an item from the instant a team member needs it until it arrives on site across direct materials, indirect goods, logistics, and corporate finance. To bridge the gap between abstract agent architectures and practical operations, Lio erected physical booths at their New York office where executives could test and inspect the agents hands-on, leading to a planned 700-person gathering in Munich.

- Lio’s New York summit convened over 100 enterprise procurement executives (C-level, CPOs, and VPs), with an upcoming summit targeting around 700 attendees in Munich. - Vladimir Keil on procurement tooling's failure: “You can find them on LinkedIn and you will see like they're like 500 procurement tools... But they never changed how those people actually work. And it's like crazy to see that they work in emails and on Microsoft Teams and in Excel sheets and PowerPoints.” - Vladimir Keil on universal frustration: “I challenge someone like to find someone who like loves to work with procurement like no one does. Like you can really state people hate working with procurement.”

`55:00` The Trillion-Dollar Nexus of Emotion, Boredom, and P&L Impact

Seema Amble highlights that procurement has historically had notoriously low Net Promoter Scores, recalling customer discovery calls where frustrated executives stated they were locked into systems like Coupa and refused to even discuss software evaluations. Vladimir explains that this deep-seated friction is precisely what makes procurement an extraordinary startup opportunity. While perceived from the outside as boring back-office B2B SaaS, the emotional charge surrounding broken workflows gives it intense urgency. The category has suffered a total lack of fundamental innovation for twenty years, with the only notable updates being occasional user interface refreshes roughly a decade ago. Consequently, delivering tangible, agentic automation quickly amazes buyers who are unaccustomed to real technical progress.

Beyond emotion and neglect, Vladimir emphasizes procurement's disproportionate leverage on enterprise balance sheets and the broader physical economy. Procurement dictates the execution, cost, and speed of building high-stakes infrastructure, including data centers, commercial aircraft, automotive manufacturing, and drones. Financially, operating leverage dictates that gaining a 1% margin expansion through top-line growth demands roughly a 10% increase in gross revenue; by contrast, capturing a 1% reduction in procurement spend flows directly to the bottom line, delivering that same bottom-line outcome instantly. This combination—unmatched operational frustration, a neglected software category, and extreme financial leverage—creates what Vladimir characterizes as a massive market opportunity before Elena closes the episode.

- A 1% cost savings in procurement yields the equivalent bottom-line P&L impact of driving a 10% increase in corporate sales revenue. - Procurement dictates real-world industrial infrastructure, directly governing data center rollouts, aircraft assembly, vehicle production, and drone manufacturing. - Vladimir Keil on the enterprise leverage of procurement: “If you just manage to get 1% savings, it's equals 10% of sales that you have to do to get the same outcome in your P&L.” - Vladimir Keil on why the category is poised for massive venture outcomes: “And you combine all of those three things a trillion dollar business opportunity. That's my opinion.”

## Notable quotes > `02:30` The legacy incumbent is limited to their system of record and that record that they have, and they're not completing the end-to-end job. — Seema Amble

> `00:00` No company and no enterprise starts with fully autonomous negotiation agents from day one. — Vladimir Keil

## Mentioned Elena Burger, Seema Amble, Vladimir Keil, Lio, Salesforce, Claude, Agentforce, SAP, Oracle, ChatGPT, Andreessen Horowitz, Polymarket, Boeing, Harvey, Decagon, BCG, McKinsey, Granola, Accenture, Coupa, Salesforce Dreamforce, Bots and Buyers Summit

## Video description a16z’s Seema Amble and Elena Burger sit down with Lio co-founder and CEO Vladimir Keil to ask where AI-native startups have an advantage when incumbent software companies already own the customer, the data, and the system of record. Their answer comes down to the work that happens outside those systems. In procurement, a final price in an ERP can hide hundreds of emails, spreadsheets, supplier conversations, engineering analyses, and decisions across legal, finance, and operations. Vlad explains how Lio uses multi-agent systems to take on more of that end-to-end work, from sourcing and RFQs to negotiation, shipment tracking, and invoices. They also discuss how enterprises learn to trust agents with increasingly consequential decisions, why the last 20% of an internal AI build can require most of the effort, and what happens when both buyers and suppliers have agents working on their behalf.

[Source](https://mgln.ai/e/1344/afp-848985-injected.calisto.simplecastaudio.com/3f86df7b-51c6-4101-88a2-550dba782de8/episodes/63755eda-ff93-4095-8822-e8bcb95a06a6/audio/128/default.mp3?aid=rss_feed&awCollectionId=3f86df7b-51c6-4101-88a2-550dba782de8&awEpisodeId=63755eda-ff93-4095-8822-e8bcb95a06a6&feed=JGE3yC0V)

中文简报

AI Agent何以击败传统软件巨头 Vladimir Keil解释称,尽管SAP和Salesforce等传统系统记录了静态的交易终点,但采购中多达80%的实际工作量都发生在电子邮件、电子表格和跨部门谈判中。Lio通过跨越四个自主层级的多Agent架构来解决这一问题,首先从低风险的尾部支出来建立企业信任,进而辅助数百万美元的直接制造采购。Keil还告诫企业切勿落入内部自建的陷阱——澄清70%的模型准确率并不等于70%的工作流自动化——并阐明操作依赖性而非被动的数据库记录,才是垂直领域AI真正的防御护城河。 SAP和Salesforce等传统软件巨头掌握着静态的企业记录,但却忽视了达成最终成交价格所需的80%的非结构化操作劳动力——这些劳动力横跨数百封电子邮件、CAD文件和电子表格。 (4:55) 企业对自主Agent的信任是逐步建立的,从下行风险较低、金额在5万美元以下的未托管尾部支出开始,逐步迈向复杂的直接采购谈判。 (16:51) 企业内部自建AI面临严重的“DIY陷阱”:达到70%至80%的基础准确率并不等同于实现70%的自动化,因为在边缘案例整合完成之前,人工团队仍必须审查每一笔交易。 (40:00) 企业采购节省1%会直接转化为净利润,在资本密集型的实体供应链中,这相当于总营收增长10%对损益表产生的影响。 (55:00)

Reading summary

AI-native vertical agents can outperform enterprise software incumbents by orchestrating unstructured, cross-functional workflows that legacy systems of record fail to capture, according to venture investors Seema Amble and Elena Burger and Lio co-founder Vladimir Keil. Systems of Record Versus End-to-End Execution (2:30) Enterprise resource planning (ERP) platforms like SAP or Oracle fundamentally act as static ledgers documenting finalized outcomes rather than executing the operations that generate them. A finalized $8,000 purchase order typically represents weeks of hidden labor—spanning dozens of stakeholder meetings, hundreds of emails, multiple spreadsheets, and specialized CAD cost engineering—all occurring outside the system of record. While incumbents wield distribution and proprietary data, they are structurally bounded by their database silos and internal organizational conflicts, such as competing VP incentives between tools that assist human workers versus software that resolves jobs autonomously. Four Agent Tiers and the Exceptions Dilemma (6:22) AI architectures can be categorized into four tiers: retrieval agents (searching data), process agents (deterministic rules), policy agents (interpreting SLA ambiguities), and principal agents (exercising strategic commercial judgment). While incumbents like Salesforce embed foundation models primarily for retrieval and basic process matching, real-world tasks like invoice processing require far more depth. Invoicing software automates the predictable mechanical matching path, yet that straight-line flow covers only 20% of the actual workload. The remaining 80% consists of messy edge-case exceptions, including investigating fraudulent billings, reconciling contract discrepancies, and resolving missing purchase orders. Progressive Trust and the Procurement Risk Spectrum (14:04) Deploying autonomous negotiation agents requires an incremental trust model, as large organizations will not surrender commercial negotiations immediately. Systems rely on human-in-the-loop governance to calibrate responses, progressively raising deal limits from $10,000 to $20,000 and eventually over $100,000. For high-stakes direct procurement—such as inputs for aircraft or data centers, where supplier spend can reach $1 billion and single delays threaten nine-figure line stoppages—agents operate back-of-house to conduct analytical preparation and provide real-time copilot math during negotiations. Conversely, for unmanaged indirect tail spend under $50,000, autonomous agents carry near-zero downside risk because enterprises previously lacked the capacity to negotiate those invoices at all. The DIY Automation Fallacy and Implementation Scalability (40:00) Enterprises frequently attempt to build internal AI applications, but Vladimir Keil warns that achieving a 70% accuracy prototype does not translate to 70% automation. If an internal tool fails 30% of the time, employees must still manually verify 100% of the outputs, erasing labor savings. Reaching production-level reliability requires persistent memory, deep domain data, and handling integrations across multi-ERP environments. Startups navigate this through forward-deployed engineers (FDEs) who systematize idiosyncratic enterprise edge cases into software features; Lio explicitly tasks its FDEs with automating their own deployment roles into customer self-service levers to prevent the company from becoming a headcount-heavy IT consultancy. Bilateral Dynamics and Extreme Financial Leverage (44:30) As suppliers and buyers both adopt automation, agents will interface across corporate borders. While final price negotiations remain zero-sum, Vladimir Keil highlights that the thousands of preceding upstream operational steps—such as RFQ specifications, CAD reviews, and schedule tracking—are mutually aligned around removing friction and accelerating delivery. Keil also points to procurement's extreme operating leverage: because procurement savings flow directly to the bottom line, capturing a 1% reduction in procurement spend matches the P&L impact of a 10% increase in gross revenue, turning an emotionally dreaded back-office function into a high-leverage business opportunity. While AI agents offer massive leverage over neglected enterprise workflows, vertical startups must navigate whether incumbent database vendors can eventually expand past their system-of-record boundaries and whether enterprise buyers will comfortably grant algorithms autonomous decision-making over strategic, relationship-driven supplier contracts.

精炼阅读摘要

Seema Amble、Elena Burger 与 Vladimir Keil 认为,虽然传统企业软件巨头拥有庞大的数据记录和分发渠道,但 AI 智能体初创企业能够通过接管横跨多个孤岛的端到端真实工作流,在采购等高杠杆复杂领域击败现有巨头。 记录系统与端到端工作流的脱节 (2:30) 传统企业资源规划(ERP)和客户关系管理系统本质上是“记录系统”(Systems of Record),它们只负责记录最终的商业交易结果,无法承载产生这些结果所需的繁杂工作。以采购为例,ERP 系统中一条看似简单的 8,000 美元铝材订单,背后可能掩盖了 30 次跨部门会议、500 封往来邮件、20 份独立表格,以及成本工程师长达三周的技术建模与价格拉锯。传统系统仅记录静态数据,完全丢失了实际决策过程中的工程与商业语境。在发票核对场景中,现有软件虽然自动化了 100% 的标淮流程,但这仅占实际工作量的 20%;其余 80% 的精力都耗费在处理欺诈核查、单据不符及非标准条款等异常情况上。Amble 指出,老牌巨头局限于自身的数据记录,无法完成端到端任务,这为 AI 原生初创公司跨系统调度完整流程提供了核心切入点。 四级智能体架构与现有巨头的组织阻力 (6:22) Amble 提出了四级智能体架构体系:从仅负责检索信息的“检索智能体”(Retrieval Agents)、执行确定性规则的“流程智能体”(Process Agents),到能够裁量模糊 SLA 条款的“策略智能体”(Policy Agents),再到拥有商业全局战略权衡能力的“委托人智能体”(Principal Agents)。目前现有巨头的产品(如 Agentforce)大多停留在前两级。巨头面临深刻的内部利益冲突:销售辅助人工团队的流程软件,与销售能够直接端到端解决问题的自主智能体,面向的是完全不同的企业买家,这会在其内部引发副总裁级别的预算争夺与战略抵触。此外,Keil 认为老牌软件公司虽然自带客户信任,但也因此承担极高的声誉风险,一旦过早发布存在缺陷的决策功能便可能毁掉信任;而初创企业则能通过渐进式交付逐步积累权威。 人机协同与渐进式信任建立机制 (14:04) 在涉及复杂供应链的制造环境中,单一部件延误两周可能导致整条装配线停滞,带来数亿美元损失。因此,企业绝不会在首日就将商业谈判完全托付给算法。Lio 等平台采用人机协同(Human-in-the-Loop)机制:系统首先给出基准方案,经由企业采购与工程团队审核校准后,再逐步获得 1 万美元、2 万美元乃至 10 万美元级别的自主谈判授权。对于低于 5 万美元的无管理长尾支出,由于企业过去受制于人力短缺而从不议价,使用自主智能体直接博弈几乎不存在下行风险;但涉及高价值定制零件或关键供应商关系时,智能体则转向充当幕后副驾驶,在长达数月的拉锯战中实时测算物料清单、原材料指数与 3D CAD 模型,协助人类专家以精确的成本拆解进行谈判。 多智能体协同与双边谈判网络演进 (26:17) 企业实际业务流程通常涉及跨 3 个部门的 8 位利益相关者以及至少 5 款不同的软件工具。单一智能体无法独立支撑全流程,必须依赖多智能体系统:由录入智能体自动解析图纸并推断总账科目,寻源智能体核查跨工厂库存并分发询价单,检索智能体结构化非标报价,再交由谈判智能体执行竞价或提交人工审批。展望未来,买卖双方均部署智能体的双边交互已不可避免。Keil 与 Amble 指出,虽然最终价格条款具有零和博弈性质,但前置的 5,000 个协作环节——包括需求规格定义、合规审查与工期跟踪——买卖双方的目标高度一致,即追求最快的上市时间与最低的沟通摩擦。制造业核心买家拥有强势的议价地位与规范制定权,这将有力推动供应商接入统一的智能体协作网络。 自研陷阱与前置工程的自动化交付 (40:00) 当前大语言模型易于调用的特性诱使部分企业尝试内部自研,但 Keil 指出,原型达到 70% 或 80% 的任务准确率并不等于实现了 70% 的自动化。只要系统存在 20% 的错误率,人工团队仍需 100% 全量复核所有输出,这不仅未能节省人力,反而增加了运营负担。迈过最后 20% 的工程鸿沟需要处理多套 ERP 实例集成、持久记忆管理与极其繁琐的业务边缘用例。为了避免沦为利润率低下的传统 IT 咨询公司,Lio 保持了 85% 的工程团队占比,并要求前置部署工程师(FDE)以“自动化自身工作”为核心考核指标,将定制化集成沉淀为可由客户自行配置的纯软件功能。 采购领域虽然长期被视作枯燥的后台业务并充斥着极差的用户体验,但具备极高的财务杠杆:采购端降低 1% 的支出对企业净利润的贡献,相当于销售额增长 10% 所带来的 P&L 改善。尽管目前初创公司在端到端工作流与工程复杂性上构筑了壁垒,但未来能否在更多巨头深度绑定基础模型、且供应商端技术生态参差不齐的环境下,真正实现跨产业的大规模全自动双边清算,仍有待市场长期检验。

Detailed notes — zh

## Background 本期播客由 a16z 的 Elena Burger 主持,邀请 a16z 合伙人 Seema Amble 与 Lio 联合创始人兼 CEO Vladimir Keil 共同录制,于 2026 年 10 月 2 日在 RSS 及网络平台发布。节目简介指出,在老牌软件巨头已掌控客户、数据与系统记录库(System of Record)的背景下,三方深入探讨了 AI 原生初创企业如何通过多智能体系统承接记录库之外的跨部门复杂端到端工作(如采购寻源、商务谈判与发票核验),并建立企业级信任与竞争优势。 ## TL;DR 节目围绕企业级 AI 智能体如何颠覆传统 SaaS 展开,深入剖析了像 SAP、Salesforce 等记录库巨头的死角——真实业务中 80% 的工作其实散落在系统外部的海量沟通、工程测算与跨部门拉扯中。Lio 团队展示了如何通过人在回路(human-in-the-loop)机制逐步积累信任,推动智能体从低风险的长尾采购和检索任务逐步接管高达数十万美元的商务谈判乃至工程协同。嘉宾们还探讨了企业自研 AI 遭遇的‘最后 20%’落地瓶颈、供需双向智能体协同对传统零和博弈的重塑,以及前线部署工程师(FDE)通过‘自动化自身’反哺产品的独特壁垒。最终指出,采购等看似枯燥且怨气集中的垂直场景,因其对企业利润表(P&L)拥有巨大的杠杆效应,正孕育着万亿美元级别的 AI 重构机遇。 ## Atmosphere & style 对谈整体洋溢着硅谷顶级投资机构与一线实战创业者碰撞出的高密度专业感,兼具战略审视的冷静与洞见行业痛点时的幽默犀利。Vladimir Keil 凭借工程与供应链实战经验,用‘一封漏看邮件损失数亿美元’、‘大企业四万美元尾部支出漏洞’等生动案例,打破了外界对企业软件‘枯燥无聊’的刻板印象;Seema Amble 则以成熟的投资人框架层层拆解传统巨头的组织惰性与产品闭环缺陷。整场对话节奏明快、观点交锋酣畅淋漓,既有对技术落地瓶颈的直言不讳,又充满对底层垂直软件范式变革的笃定与兴奋。 ## Bulletin - `03:00` 传统企业软件巨头受限于孤立的记录系统(System of Record),而 AI 原生初创公司的核心突破口在于跨越异构系统接管端到端(end-to-end)的完整工作流。 - `40:00` 企业自研内部 AI 往往陷入“70% 准确率陷阱”,因为 70% 的准确率要求人工 100% 逐条复核,攻克剩下 20% 的生产级异常处理需要投入 80% 的工程精力。 - `45:00` 工业采购方对下游供应商拥有绝对的规则制定权,能够通过强制集成推动供需双向 Agent 协作,消灭价格博弈之外的数千项协同摩擦。 - `55:00` 采购端对企业损益表具有巨大的杠杆效应:企业降低 1% 的采购成本,其释放到净利润中的收益等同于销售额增长 10% 的商业回报。 ## Key takeaways - `04:44` 传统 ERP 或记录系统仅记录最终成交结果,掩盖了跨越法务、财务、工程和 500 多封邮件拉扯的庞大隐性工作。 - `06:05` 企业 AI Agent 呈现四层演化梯度:从无判断力的检索代理、低判断力的流程代理,逐步进阶到兼具自由裁量权与商业权衡的策略代理与原则代理。 - `10:00` 软件巨头在推进自主 Agent 时面临内部利益冲突,例如“端到端解决问题”的产品与既有“为人工客服提供工具”的产品在买家定位与销售激励上严重对立。 - `12:30` 市面上绝大多数发票自动化软件仅解决了 20% 的“快乐路径”,真正的业务难点和风险在于另外 80% 的欺诈识别与异常对齐处理。 - `14:48` 企业对自主谈判 Agent 的信任需要循序渐进:通过“人在回路”机制,从 1 万至 2 万美元的小额尾部支出试水,再逐步升级到数十万美元乃至数百万美元的复杂标的。 - `17:20` 大企业在 5 万美元以下的长尾支出上通常缺乏人力议价,采用自主谈判 Agent 带来的商业风险极低且能直接挤出净利润。 - `20:00` 复杂物理工程(如飞机制造或数据中心)对供应链延迟极度敏感,一封漏看或未被评估业务影响的零件延期邮件可能导致数亿美元的停工损失。 - `25:00` 面对航运或供应链中的物理世界不确定性,智能 Agent 的核心价值在于基于多维度历史数据进行履约概率预测与风险定价决策。 - `30:00` 间接采购适合通过端到端多 Agent 体系实现高度自动化,而涉及数十亿美元核心物料的直接采购则依赖 Agent 在幕后完成工程图纸与大宗商品指数的战略建模。 - `35:00` 基础大模型已成为大宗商品,在应付成本建模(Should-cost modeling)与复杂价格基准评估等专有领域必须结合微调或基于结果(Outcome-based)的模型范式。 - `37:00` 新一代垂直 AI 的护城河不在于初期的理论蓝图,而在于接管实质性业务执行后所积累的深度客户依赖与专有上下文数据。 - `45:00` 商业交易中的价格本身属于零和博弈,但在达成定价前涉及的 5,000 项协同任务上,买卖双方在降低摩擦、加速交付上拥有完全一致的利益。 - `47:30` 传统巨头将实施交付视为后置的附加环节,而 AI 原生初创公司依靠前线部署工程师(FDE)建立起紧密的产品反馈闭环与自进化评测体系。 - `50:00` 前线部署工程师(FDE)的核心考核指标是“自动化自己的工作”,通过将个性化定制迅速固化为软件组件来实现客户全自助配置。 - `55:00` 采购赛道过去近 30 年缺乏底层架构创新,兼具用户怨气高、场景枯燥与万亿美元财务杠杆三大特征,是 AI Agent 颠覆的典型蓝海。 ## Detailed walkthrough ### `00:00` 播客开场与核心问题:现有巨头环伺下,AI原生初创企业胜算何在? 节目开篇通过几个极具冲击力的供应链场景切入:制造一架飞机需要协调数以千计的供应商,某家供应商发来一封邮件称某个零部件将推迟两周到货,如果采购人员漏看了这封邮件,可能导致数亿美元的巨大损失。采购业务在历史上往往被局限在狭窄的流程框架内,但如今它早已跨越边界,深度渗透到法务、财务、运营等多个职能部门与异构软件系统之中。面对这种复杂的现实,AI原生初创企业的破局点在于接管整个端到端的完整工作流。然而,没有企业从第一天起就敢把谈判等关键决策完全托付给自主代理。Lio联合创始人兼CEO Vladimir Keil(Vlad)强调,通过引入“人类在环”(human-in-the-loop)模式,团队持续将人类的反馈和经验喂养给代理,逐步建立信任,让代理承接的谈判额度从1万美元、2万美元提升到10万美元以上。 本期 a16z 播客由 Elena Burger 主持,与 a16z 合伙人 Seema Amble 以及 Lio 的联合创始人兼 CEO Vladimir Keil 共同探讨企业软件生态的剧变。Elena 抛出了近期企业软件领域最核心的焦虑:像 Salesforce、SAP 这样的传统巨头已经牢牢掌控了客户关系、核心数据以及系统记录库(System of Record),若巨头直接在原有软件上叠加前沿模型,AI 原生初创公司究竟还有什么生存空间与竞争优势? - 采购失误代价极高:漏看一封关于零件延迟两星期的确认邮件,在航空等大型制造场景中可能引发数亿美元级别的连锁损失。 - 信任积累路径:企业客户对自主谈判代理充满戒备,初创公司必须依靠人类在环的机制,让代理从承接小额谈判逐步升级到大额复杂决策。 --- ### `03:00` 现有巨头的边界与系统记录库之外的隐性工作 Seema Amble 回顾了她近期撰写的文章《巨头正在赶来》(*The Incumbents Are Coming*),阐述当前市场竞争格局的变化。过去行业往往被视为“初创公司与传统软件巨头”的双雄争夺战;然而现在出现了第三种更为凶猛的形态——传统巨头直接接入前沿基础模型(例如 Salesforce 与基础模型结合推出 Agentforce 类方案)。既然老牌厂商坐拥所有数据、员工已养成操作习惯且产品体验平滑衔接,市场为何还需要全新的独立产品? Seema 指出,传统巨头的根本软肋在于其视野被死死局限在自身的系统记录库(System of Record)之中,无法覆盖客户实际业务的全流程。以客户支持场景为例,某位客户在取消订阅后发现账户仍被扣费而发起申诉,要解决这个问题,绝不能仅仅依靠在聊天窗口中回一句“我被多收费了”:系统必须调取结算平台(Billing)、查验完整的历史聊天日志、核对合同条款与履约细则。这些上下文散落在多个异构系统之中,没有任何单一的系统记录库能独自掌握全局。针对这一痛点,Seema 总结道: > “The legacy incumbent is limited to their system of record and that record that they have, and they're not completing the end-to-end job.” —— Seema Amble AI 原生初创公司的真正战略机遇,正是跨越单一记录库的桎梏,去拥有从头到尾的完整弧线(end-to-end arc)。无论是法务场景中从起草案情摘要一路打到法庭审判,还是企业采购中的端到端落地,核心逻辑都在于“占领端到端的工作,而非守着一条孤立的数据记录”。 ```mermaid flowchart TD accTitle: 采购决策中系统记录库与外部真实工作的对比 accDescr: 展示ERP系统中极简的最终结果与背后大量繁琐线下流程的鲜明差异 subgraph ERP["系统记录库 (ERP)"] A["采购结果记录: 零部件单价 $8,000"] end subgraph HiddenWork["隐藏在系统记录库之外的端到端真实工作"] direction TB B["供应商首轮报价与推拉谈判 (索要 $10,000)"] C["成本工程师耗时3周运行 Excel 表格与 3D 几何建模"] D["跨部门协同: 30+ 场利益相关者会议 & 500+ 封往来邮件"] E["法务、财务合规与交货期排期确认"] end HiddenWork -->|"最终折叠录入"| A ``` --- ### `04:44` 采购场景的真实冰山:ERP 里的一个数字与背后的海量推拉 Vladimir Keil 从企业采购的实操视角进一步剖析了这种断层。人们谈及采购时,往往直觉地认为这只是关于“最终协议价格”的记录,在各类企业软件的界面上,这个结果显得极其平淡简单:系统表格里最终可能只敲下一行“零部件价格:8000 美元”。Vlad 打趣道,这和销售向投资人汇报工作一模一样:如果他拿着一份刚签好的客户合同去找 Seema,纸面上的签名干脆利落,看似水到渠成,但 Seema 看不到背后经历的30多场内部外部利益相关者会议、500多封邮件的激烈拉扯以及20多份复杂的 Excel 测算底稿。 采购流程同样如此。ERP 系统中只躺着一行冷冰冰的数据——“采购某型号铝合金部件,单价8000美元”。但这个数字抹杀了所有真实的业务过程: 1. 供应商最初可能强烈反弹,坚持索要10,000美元; 2. 内部成本工程师不得不花整整三周时间反复调整 Excel 测算模型并进行3D零部件制图建模,才推算出零部件的真实底价; 3. 随后还要历经多轮关于交货周期、账期及不可抗力条款的磋商。 Vlad 一针见血地指出,采购工作中绝大部分繁重、琐碎且决定成败的环节,根本没有发生在 ERP 或任何现存的系统记录库之中,而是漂浮在记录之外的海量非结构化沟通里。 - 表面数据具有欺骗性:ERP 中一条8,000美元的铝材订单,背后掩盖了供应商推诿索要10,000美元的拉锯战。 - 研发与成本工程的隐性投入:确定一个零部件的真实成本结构,需要工程师花费长达数周进行三维模型与材料成本测算,这些核心上下文传统系统完全无法捕获。 --- ### `06:05` 代理的四层演进梯度:从检索、流程、策略到原则 随着大模型从一年前只能提供简单的检索问答型聊天机器人演化为复杂的任务执行体,软件对人类“判断力”(judgment)的接管程度成为了核心分水岭。Seema 在文章中提出了企业 AI 代理的四层演进框架: | 代理类型 | 决策与判断力要求 | 客户支持场景案例表现 | |:--- |:--- |:--- | | **检索代理 (Retrieval Agent)** | **无**(仅限于信息查询、提取与摘要) | 客户因网络中断索赔,代理调出合同条款与故障记录,仅核实信息属实并回传。 | | **流程代理 (Process Agent)** | **极低**(严格执行既定规则与操作流) | 依据明确条文直接计算赔偿金,在后台账单系统中自动发放补偿款,不掺杂主观判断。 | | **策略代理 (Policy Agent)** | **中等**(在边界模糊处运用自由裁量权) | 故障持续20分钟,无明确赔偿死规定,代理综合裁定该时长已构成“重大中断”并批复赔偿。 | | **原则代理 (Principal Agent)** | **极高**(权衡长期战略与商业利弊) | 考虑此次事故体验恶劣且该客户具有高终身价值,决定提供超出政策上限的额外高额补偿以维系关系。 | 目前市面上的大多数老牌巨头在涉足 AI 时,基本还停留在第一层(检索代理)以及小部分的第二层(流程代理)——例如协助用户完成电子文档签署、从会议纪要中提取信息并录入字段等机械化任务,根本尚未触及需要真正商业判断力的策略代理与原则代理。尽管部分老牌巨头正大张旗鼓地宣称要向更具裁量权的流程和策略层面迈进,甚至选择与 OpenAI、Anthropic 等顶尖模型实验室结盟以强化自身能力,但实际产品落地仍极其受限。 针对传统软件厂商在引入判断力决策上的迟缓表现,Seema 深入探讨了巨头面临的矛盾处境。一方面,巨头享有得天独厚的“分发优势”(Distribution)与客户信任,如 Salesforce 推出 Agentforce 时,凭借庞大的现有客户基础以及几乎零额外试错成本的定价策略,能够极其丝滑地让客户开启产品试用;但另一方面,巨头被内部根深蒂固的激励冲突与商业模式包袱死死拖住了后腿。 ### `10:00` 现有软件巨头的内部分歧与 Lio 的 Agent 光谱定位 现有传统软件巨头(Incumbents)在从提供工作流向真正端到端解决问题演进时,面临着深刻的内部结构性冲突。Seema Amble 指出,如果一家公司正在做的事情是“端到端解决一个客户支持问题”,而原有的产品线是“为人类客服专员提供工作流软件”,那么这两款产品的目标买家截然不同,负责这两款产品的两个团队在内部必然会产生摩擦与利益冲突。不仅如此,从销售的角度来看,面对客户究竟该卖哪一套方案、如何对齐两边的激励机制,往往会直接演化成跨部门高管之间的争夺——正如 Seema 所形容的:“在经典的现有巨头问题中,通常会有两个 VP,他们分属不同的组织,需要弄清楚正确的激励机制以及到底该向谁销售。” 谈及 Lio 在信息检索型(retrieval agent)、流程型(process agent)、策略型(policy agent)与主体自主型(principal agent)等技术光谱上的具体位置,Lio 联合创始人兼 CEO Vladimir Keil 解释道,Lio 实际上横跨了所有这些范畴,具体采用哪一种形态完全取决于任务的复杂度以及 Agent 所承担的商业风险。某些场景下 Lio 已经实现了全自主运行,而在另一些预算审批更复杂、风险更高的任务中,系统则保留了“人在回路(Human in the loop)”的控制节点。 在这个过程中,“信任”成为了初创公司与现有巨头角力的关键筹码。现有的行业巨头天然拥有既定客户的信任,但这也意味着他们背负着包袱——如果他们为了抢占先机而过早发布尚未成熟、可能做出糟糕决策的产品,现有的信任资产就会被迅速摧毁。相反,像 Lio 这样的初创团队必须从零去一点点赢取客户的信任。这种信任的建立不仅依赖技术和产品本身,更取决于对人与组织关系的深刻理解。 ```mermaid flowchart TD accTitle: Lio Agent Spectrum and Risk Spectrum accDescr: 图表展示了从低风险检索型到高风险自主型 Agent 的阶梯演进,以及人机协同与信任建立的对应关系。 subgraph Spectrum ["Lio Agent 光谱与落地路径"] A["检索型 Agent<br>(Retrieval)"] --> B["流程型 Agent<br>(Process)"] B --> C["策略/长程 Agent<br>(Policy / Long-running)"] C --> D["全自主主体 Agent<br>(Principal / Fully Autonomous)"] end subgraph Execution ["执行与信任控制"] E["低风险 / 标配用例<br>全自主无缝运行"] F["高风险 / 复杂决策<br>人在回路 (Human in the Loop)"] end A -.-> E B -.-> E C -.-> F D -.-> F ``` --- ### `12:30` 破解发票处理与采购全流程的“20% 盲区” 以发票处理场景为例,Vladimir Keil 揭示了现有软件与实际业务需求之间的巨大鸿沟。传统的发票软件从本质上看是一个标准的信息检索与数据同步流程:提取发票字段,跨其他单据进行比对核验,然后将结果推送到 SAP 或 Oracle 这类企业资源规划系统(ERP)中。当前市面上 100% 的发票自动化软件都在解决这一套“快乐路径(happy path)”,但从采购部门要完成的实际任务(job to be done)来看,这仅仅覆盖了整个业务问题的 20%。 剩下的 80% 才是真正繁重、充满风险的工作:如果发票涉嫌欺诈怎么办?如果数据严重不匹配怎么核实?如果不走标准路径该如何做异常处理?正是洞察到传统软件只做了冰山一角,Lio 迅速把 Agent 的能力边界拓展到了这些异常处理场景中。Vladimir 提到,Lio 在商业拓展上的幸运之处在于他们始终略微领先于行业曲线:在三年前刚起步时,仅凭文档检索技术就足以震撼企业客户,促成付费合作并迅速交付上线;而如今,他们用同样的节奏推进流程型 Agent、全自主 Agent 以及需要数小时长程运行的复杂任务。 除了内部审批与核算,让 AI 直接代表企业去与外部供应商打交道是更大的信任跨越。Seema Amble 强调,客户采购软件不仅要在内部系统上产生信任,而“最有趣的一点在于,Lio 还在做商务谈判”,这意味着必须让客户相信 Lio 的 Agent 能够体面、专业地与第三方供应商互动。很多企业此前被传统供应商夸大宣传但效果平平的工具伤害过,因此要让企业放手让 AI 接管真正的谈判,需要极具说服力的落地策略。 --- ### `14:48` 企业采购的复杂性与渐进式谈判信任构建 面对 Elena Burger 提出的采购业务全貌以及如何让客户放下戒心的问题,Vladimir Keil 强调,大众认知中的采购可能只是简单的“买东西”或者像 B2C 那样下单结账,但真实的 B2B 采购是“驱动整个经济运转的高强度流程”,它牵扯到法务、成本工程、采购、财务等多个跨职能团队的协同。Lio 刚好在 ChatGPT 引发全球热潮的几周前创立,因而能敏锐捕捉到底层的企业痛点,并顺势将检索与文档处理等早期应用推向生产环境,以此积累了最初的技术信誉。 在最具挑战性的外部商务谈判场景中,Lio 并不会一步登天要求客户完全放权。正如 Vladimir Keil 所断言:“没有任何一家公司、没有任何一家大型企业会在第一天就直接上线全自主的谈判 Agent。没有人会这么做。”原因很简单:企业对初创公司和前沿技术在初期缺乏全盘的信任。为了破局,Lio 采用了一套极为实用的“人在回路(Human in the loop)”机制。系统虽然已经具备顶尖采购专员的通用谈判逻辑,但并不了解具体的《财富》世界前十强企业独特的内部行事风格。通过让人类专家在关键节点进行审核与反馈,AI 能够快速吸收这些组织的专属规则与偏好,逐步获取客户的授权: - 先从 1 万美元规模的谈判起步试水; - 随着准确度与可控性得到验证,进阶到 2 万美元乃至 10 万美元的合同标的; - 面对数百万美元的重大项目(如需要解析复杂 3D 模型的制造业采购),则采用长程 Agent 协同:Agent 运行数小时生成分析,交由成本工程师进行专业复核与反馈,再基于指导意见展开后续工作。 ```mermaid flowchart LR accTitle: Lio Negotiation Agent Adoption Ladder accDescr: 展示 Lio 如何通过人在回路机制,从低额长尾谈判逐步获取信任,最终扩展到大型复杂谈判。 subgraph Adoption ["信任与额度进阶体系"] T1["第一阶段: 1万-2万美元谈判<br>(低风险长尾,全自动捕获节省)"] T2["第二阶段: 10万美元级合同<br>(规则熟化,逐步放开权限)"] T3["第三阶段: 数百万美元复杂标的<br>(解析3D模型/成本工程长程协同)"] T1 --> T2 --> T3 end subgraph Mechanism ["学习飞轮"] F1["标准谈判 Agent 策略"] --> F2["人类专家实时复核与反馈"] F2 --> F3["沉淀企业专属业务偏好"] F3 --> F1 end Mechanism -.-> Adoption ``` --- ### `17:20` 尾部支出的无人区与战略商业关系的权衡 在谈判落地的具体分工上,Lio 的切入点不仅取决于金额大小,更取决于该交易对业务关系的敏感程度。在大型跨国企业中,存在着极大规模的“尾部支出(Tail Spend)”盲区:企业由于采购人力与精力严重受限,过去在 5 万美元以下的长尾采购上根本不做任何议价。Vladimir 半开玩笑地给初创公司支了一招:“这可以说是给其他初创公司的一个‘漏洞(hack)’:你可以直接给大企业发一张 4 万美元的发票,他们大概率不会跟你谈判,因为他们没有人力去处理——除非他们部署了 Lio 的 Agent,那我们就会和你谈判了。” 在这类长尾采购中,采用自主谈判 Agent 带来的商业风险极低,因为企业原本压根不进行议价,即便 Agent 偶尔错失谈判空间,为企业挽回的收益也远胜于过去完全不作为的零收益。 然而,对于另一类虽然金额不高、但重在合作稳定性的特殊服务,策略则完全不同。Vladimir Keil 举例说明,诸如播客制作、演播室搭建或特定市场营销等业务,在企业的总支出盘子中占比虽然微乎其微,但企业非常依赖这些供应商的长期默契。企业不希望系统用冷酷死板的算法去随意得罪熟络的制作团队,破坏既有的合作信任。对于这类采购,采购专员会亲自把控交流时的语气(tone of voice)与商务话术,Lio 在执行中也会引入人类专家的精细干预,全方位兼顾商业合同条款设计与合作伙伴关系的维系。 - **小额支出漏洞**:5 万美元以下的零散账单传统上完全被大企业采购部门放任跳过,直接批付; - **非纯价格驱动关系**:以音视频制作等强协同业务为例,维护供应商信任与交付稳定性的权重往往高于压榨成本; - **分层落地路径**:在纯财务导向的长尾支出中推行高度自动化,在重视情感与伙伴关系的品类中由人类把控沟通基调与合同细节。 ### `20:00` 采购的真正复杂性:从造飞机、造数据中心到一封价值上亿美元的邮件 企业采购绝非仅仅是购买“笔记本电脑和铅笔”这类标准化办公用品,后者的自动化在多年前就已被解决。采购的真正难点在于高度跨部门协作与深度工程决策——它涵盖法务(合同与责任归属)、财务(成本结构与成本工程)、商务谈判等多个环节。负责这些事务的不是后勤文员,而是掌握极其细分行业、特定公司、特定流程知识的高技能专业人员。无论是制造飞机、类人形机器人、无人机,还是在当下 AI 热潮中构建物理基础设施(如数据中心),其本质都是极端复杂的采购与工程协同项目。 在庞大的物理工程项目中,供应链的微小摩擦都会引发连锁反应,造成天价损失。例如在飞机制造或数据中心建设中,一个特定零件如果延迟两周送达,整个工厂或项目的交付就必须顺延,可能直接引发数亿美元的损失。然而在传统的企业运营流程中,由于供应商往往只是通过一封日常工作邮件发送“抱歉,该批零件将推迟两周到货”的确认函,这封邮件极容易淹没在采购经理每天多达 500 封的收件箱里。 ```mermaid flowchart TD accTitle: 采购决策与风险传导流程 accDescr: 展示从上游多部门协同到下游履约延迟对项目造成的巨大经济损失传导路径 subgraph upstream["跨部门协同输入"] L["法务 (条款与风控)"] F["财务 (成本结构/成本工程)"] C["商务 (采购与谈判专家)"] end subgraph execution["日常运营盲区"] M["供应商邮件确认: 零件延期两周"] ERP["传统系统记录: 仅变更日期 (如周三变下周三)"] end subgraph impact["重大业务后果"] D["工期停滞 / 工厂停工"] Lio["Lio Agent: 识别延迟严重度并自动调度解决方案"] Loss["产生上亿美元的经济损失"] end L & F & C --> M M --> ERP ERP -.->|"缺乏上下文推断"| Loss M --> Lio Lio -->|"评估冲击并介入"| D ``` 传统 ERP 系统只机械地将系统里的交付日期更新(例如将“这周三”改成“下周三”),却无法识别这一变更究竟属于无关痛痒的微调,还是致命的工期延误。Vlad Keil 强调了 Lio 核心代理的定位: > “And that's also what our agents are doing, right? They are not only retrieving the information, they are then making the decisions. Like, does this have an impact? What kind of impact? And how can we resolve this?” - 跨部门协同涉及法务、财务与成本工程、商务采购,各方信息严重割裂。 - 制造一架飞机需要协同成千上万家供应商,任何单一零件的缺位都会瘫痪总装生产线。 - 采购经理日常被数百封邮件淹没,传统的记录系统(System of Record)只存取死板的时间节点,无法提供业务上下文与风险预警。 --- ### `25:00` 物理世界的不确定性、外部预测与多代理端到端闭环 针对物理世界中“货物落水、道路封闭”等无法逆转的客观事故,AI 代理介入的核心逻辑在于**基于多重上下文的概率预测与风险定价**。虽然系统无法阻止轮船遇险,但如果系统沉淀了足够的历史数据与上下文,就可以预测供应商的履约可靠性。例如,A 供应商的丢包或延期概率为 20%,但报价低十倍;B 供应商的差错率仅为 1%,但价格昂贵。在工期攸关的极端项目上,系统可以做出“多付 10 倍采购成本以确保准时交付”的理性抉择。 此外,智能代理所依赖的上下文绝不仅局限于企业内部数据,更包括全网宏观新闻、地缘政治动态,甚至 Polymarket 等预测市场上的突发事件信息。结合买方、卖方和需求方的多维度动态,Lio 正在打破企业内部采购的单一边界,演化为连接买卖双方的企业间交易协调引擎。 在解释系统架构时,Vlad 阐述了 Lio 之所以必须采用**多代理系统(Multi-Agent System)**的底层原因: > “And because the also like human level task involves eight people, eight stakeholders, and maybe like three departments and five different software tools, we need to cover like all of those to do like the job end to end and those agents need to then communicate with each other and only with a multi-agent system you can do a job end to end.” ```mermaid flowchart LR accTitle: 航空螺栓全自动采购代理协作流 accDescr: 展示从一线工人提报需求到库存核查、RFQ分发及智能谈判的全流程多代理协同 subgraph Intake["需求捕获"] Req["工人上传照片/表格"] end subgraph Internal_Check["内部协同"] Inv["库存代理: 跨厂区物料核查"] Source["寻源代理: 内外部供应商比对"] end subgraph External_Loop["外部撮合与谈判"] RFQ["询价代理: 生成并发送 RFQ"] Ingest["解析代理: 结构化解析邮件/PDF/Excel"] Neg["谈判代理: 策略谈判 / 竞价拍卖 / 人工协同"] end Req --> Inv Inv -->|"内部无法满足"| Source Source --> RFQ RFQ --> Ingest Ingest --> Neg ``` 以航空公司(如波音等企业)采购高规格“螺栓”的端到端全自动场景为例,Lio 展示了具体执行流程: - **前台极简交互**:施工现场人员无需操作复杂的 SAP 等 ERP 系统,也不必理解采购分类、总账科目(GL accounts)或框架协议,只需拍照、上传报价单或 Excel 文件。 - **跨厂区库存核验**:库存代理立即检索其他生产基地,判断是否可在企业内部跨厂调拨。 - **寻源与 RFQ 分发**:寻源代理确认内外部合格供应商名单,随后由专用代理自动起草并通过邮件发送 RFQ(询价单)。 - **非结构化报价解析**:针对外部回执中格式极度混乱的邮件正文、PDF、Excel 附件,解析代理自动完成数据结构化提取。 - **智能定价与谈判**:系统调用价格基准库,判断是否存在议价空间,并根据业务风险灵活调度特定代理执行全自主谈判、电子逆向拍卖(e-auction),或在关键节点引入人工介入(human-in-the-loop)的战略谈判。 ### `30:00` 间接采购与直接采购:从完全自动化到战略协同 Vlad Keil 梳理了企业采购的全流程自动化图景。系统可以端到端地接管订单确认、物流追踪与发票核对,全流程自主运行并沉淀完整的业务上下文。然而,采购业务有着根本性的场景分化:间接采购(Indirect Procurement)与直接采购(Direct Procurement)的逻辑完全不同。间接采购包含 MRO 耗材零配件、建厂物料、螺栓、笔记本电脑、铅笔、播客录音室搭建乃至市场营销服务,涉及的供应商往往多达数万家。企业在这些品类上有两类需求:一是那些每天重复上千次但员工希望“做零次”的枯燥琐事,可以直接由智能体接管全自动化运行;二是过去从未顾及的尾部支出,如果让智能体去自动谈判,就能在以前完全未被议价的领域为利润表(P&L)挤出巨大的新收益。 与此相反,直接采购是指制造终端产品(如飞机、无人机或机器人)所不可或缺的零部件供应。这类采购的供应商网络极为收敛,通常只有 100 到 2,000 家核心供应商,但战略地位极其重要。单家战略供应商的年支出可能高达 10 亿美元。在这类场景下,企业绝不可能直接放任智能体去执行全自主谈判,而是需要历时三个月的极致准备:工程团队要深入分析铝价指数、原油指数的走势,拆解每一份 CAD 图纸与工程细节。Vlad 指出,这是智能体落地极其激动人心的领域,其关键在于区分自动化(做零次)与战略赋能(拓展过去做不到的极限)。 ```mermaid flowchart TD accTitle: 间接采购与直接采购的智能体分流架构 accDescr: 展现智能体在间接采购的高频长尾自动化,与直接采购的战略性准备和实时辅助之间的职责差异。 subgraph Indirect["间接采购 (长尾/日常耗材)"] direction TB A["订单确认 / 物流 / 发票"] --> B["全自动端到端智能体"] C["未议价的长尾支出"] --> D["自主谈判智能体 (扩大 P&L 收益)"] end subgraph Direct["直接采购 (飞机/机器人核心零部件)"] direction TB E["单供应商支出可达 10 亿美元"] --> F["幕后准备:图纸/指数分析"] F --> G["实时谈判辅助 (动态数据纠偏)"] end ``` 针对 Elena Burger 提问智能体在直接采购中究竟是坐在谈判桌前握手的“台前角色”(Front of House),还是属于辅助专家的“幕后支持”(Back of House),Vlad 明确表示它主要是幕后大脑。在动辄数亿美元的复杂商业博弈中,90% 的功夫都花在谈判前夕的准备工作上。记账系统(System of Record)里看到的可能只是一行简单的“原价 10 亿美元最终以 9 亿美元成交”,背后却是 10 个人全职奋战三个月的结晶。此外,智能体也能在谈判当下提供实时战场支持。Vlad 描述了这样一个场景:当供应商在谈判桌上声称“原油指数上涨了 10%,所以产品必须涨价 10%”时,采购人员的屏幕上可以立刻跳出实时纠偏提示:“原油确实上涨了 10%,但该产品中原油成分占比仅为 30%,整体成本影响实际应仅为 3% 到 4%”。 - 间接采购特点:涉及数万家供应商,品类杂、频次高,追求端到端全自主托管与全量长尾支出覆盖。 - 直接采购特点:供应商规模仅 100 至 2,000 家,涉及高额核心资产,谈判筹备周期长达数月。 - 幕后到实时的延伸:从前期的工程图纸与大宗商品指数模型分析,延伸至会议进行中的即时数据校验与谈判话术反制。 > Vlad Keil 强调战略采购的真实重量:“The end result that you see in your system of record is like, oh, instead of like one billion, I paid 900 million dollars. Okay, but like there's like three months of preparation and like 10 people working full time on that.” ### `35:00` 底层模型策略:基础模型的局限与结果驱动模型 探讨到底层模型架构与微调(Fine-tuning)时,Vlad 指出,Lio 将所有主流基础大模型视作通用的“大宗商品”(Commodity)。这些通用模型在处理通用商业任务(如阅读与解析 PDF、生成 Excel 表格等)时表现卓越。对于一部分业务场景,将基础大模型与外围框架系统(Harness)结合,就已经能达成 100% 的工作交付。然而在专业制造与采购领域,即使配备最强大的基础模型和最精密的 Harness,往往也只能勉强达到 80% 的完成度,剩下的 20% 必须依赖模型微调与专业建模。 典型瓶颈出现在成本工程师(Cost Engineers)执行的“应付成本建模”(Should-cost Modeling)中。工程师需要细致解析机械图纸,从而精确计算某个特定零件的理论合理制造成本。通用模型对这类私有工程知识无能为力。另一个难题是价格基准评估(Price Benchmarking)。在理想状态下,采购人员只需拖拽上传一份供应商报价单,系统就能输出最优目标价格;但企业间的历史报价与采购数据完全是私有专有的,通用大模型根本无法在公开网络中获取这些训练语料。Vlad 进一步解释,许多复杂的采购定价很难被硬编码成规则引擎:比如同为顶级咨询公司的麦肯锡(McKinsey)与波士顿咨询(BCG),两者提出的项目方案可能完全一致,报价却相差 10 倍;又如视频内容制作的采买,资深采购经理全凭行业经验与直觉来断定报价是否合理,而无法将其提炼成死板的逻辑规则。针对这类场景,Lio 正在探索类似 JEPA 等直接面向最终结果(Outcome-based)的模型范式,让智能体直接学习并输出最终合理的定价直觉,而非仅仅进行文本预测。 - 通用大模型定位:充当基础设施层大宗商品,胜任文档解析、报表生成等通用任务。 - 80% 瓶颈区:在 CAD/图纸分析、应付成本建模(Should-cost modeling)中,单纯依靠基础模型外挂提示词框架无法达到工业级交付标准。 - 隐性知识沉淀:针对专业服务与创意采购中无法规则化的商业直觉,利用私有交易数据训练基于结果的模型以替代纯文本大语言模型。 > Vlad Keil 针对复杂采购直觉的系统化难点解释道:“But if you ask them to write down the rules, they can't do this because it's just like gut feeling and instinct. And that's where we see a lot of opportunity actually training an agent, but not maybe like a classic LLM, but more like, again, like what companies like models like JEPA are now doing on the outcome-based.” ### `37:00` 垂直 AI 护城河:从系统记录转向端到端工作接管 Seema Amble 探讨了当前大模型实验室向垂直行业纵深发展背景下,具有持久生命力的垂直 AI 公司究竟具备何种特质。她指出,这类公司的首要特征在于真正接管端到端的工作流,在业务运转中积累前所未有的专有数据资产,去完成旧软件时代无法涉足的任务。关于初创企业的护城河,Seema 坦言,在极早期阶段试图精确预测未来的护城河往往并不现实。回看所有顶尖商业巨头的成长史,早期团队的核心关注点永远是赢得客户信任、不断把产品卖深卖透、抓住眼前的扩张机遇,而不是机械地按照“规划一到七步再构建护城河”的既定蓝图行事。 垂直 AI 的防御性与生命力,核心在于将软件从“被动的记录系统”演变为“深度的业务执行者”。传统 CRM 仅仅是销售交易的静态记录日志(Log),而新一代 AI 销售智能体则全面接管了前期的客户背调、外呼跟进、入站线索响应等一系列实质性工作。同理,当采购智能体实际接手了寻源、议价与执行,客户对产品的整体依赖度就会呈指数级攀升。产品的黏性、网络效应以及各类商业护城河,归根结底都是客户深度依赖与产品交付实际业务价值的自然结果。当 Elena 顺势向 Vlad 提问,面对企业客户“为什么不直接调用底层模型自己做,或者在已有记录系统上套个模型”的常见质疑时,Vlad 坦承这是每家企业都会提出的核心拷问。 | 软件代际对比 | 传统记录系统(System of Record) | 新一代垂类 AI 智能体(Vertical AI Agent) | |:--- |:--- |:--- | | **系统角色** | 静态数据库、流程日志记录器(如传统 CRM、ERP) | 具备主动执行能力的端到端业务接管者 | | **工作流覆盖** | 仅记录最终结果(如最终录入的合同价格) | 深度渗透过程:会前调研、跨团队协同、实时谈判对弈 | | **客户依存度** | 依靠数据锁定与高迁移成本 | 依靠关键业务执行流的深度嵌入与不可替代性 | | **护城河来源** | 事后构建的制度性壁垒 | 持续处理复杂端到端工作沉淀的专有数据与信任资产 | - 护城河的演进逻辑:护城河不是在早期推演规划出来的,而是在接管客户更多任务、获取深层依赖的过程中自发沉淀的结果。 - 软件形态转移:从“需要员工录入数据的软件”转向“替员工跑完任务的智能体”,客户依赖的锚点从记录本身迁移到了工作执行力。 > Seema Amble 在剖析 AI 时代软件粘性本质时指出:“And here it's truly like, OK, old CRM company was log for all the deals. New sales AI agent is actually owning a lot of the sales prep process and the outbound process, fielding inbound and doing a bunch of the work. The overall customer is dependent on that product.” ### `40:00` 8 小时原型与 70% 陷阱:企业自研 AI 面临的最后 20% 困境 Vlad 回顾了三年前 Lio 的第一个用例:抓取报价单中的信息并将其自动录入 SAP。尽管在技术层面上这只是一个信息检索与填报 Agent,但它为客户创造了巨大的商业价值。当时 Lio 仅有三四名工程师,花了不少力气来构建和销售这款产品;而如今,这项任务已经成为应聘 Lio 的工程师面试考核题,候选人通常只需 8 小时就能搭出一个可用版本。这种开发门槛的大幅降低引出了一个关键疑问:既然工程师 8 小时就能做出来,大型企业的采购部门为什么不花两个月时间自己搭建内部系统,而要去买初创公司的产品? 对于这个问题,Vlad 直言不讳地指出,8 小时确实能搭出原型,但其表现通常只能达到 70% 左右。更关键的是,70% 的准确率并不等于 70% 的工作被自动化了。如果准确率只有 70%,由于错误率过高,业务人员不得不对所有数据进行 100% 的人工复核,最终甚至可能创造出比原本更多的工作量。 ```mermaid flowchart TD accTitle: Internal Build vs Production Ready accDescr: 比较企业内部自研原型与生产级 Agent 在准确率与工作量上的落差 subgraph DIY["企业内部自研原型 (80% 投入规律)"] A["8小时/2个月自研"] --> B["达到 ~70% 表现"] B --> C["无法自动放行"] C --> D["人工需 100% 逐条复核<br/>(甚至增加额外工作)"] end subgraph PROD["生产级 Agent 框架 (最后 20% 难度)"] E["深度系统集成"] --> H["跨 ERP 映射与例外处理"] F["上下文记忆与工作流"] --> H G["垂直行业专属数据"] --> H H --> I["99%+ 生产可用自动化"] end ``` Seema 从投资人和行业观察的角度补充了两点洞察。首先,基础模型与类似 GPT 产品的大规模普及是一件好事,因为终端用户对 AI 工具的熟悉度、信任度和兴奋度越高,越容易接纳垂直领域的特定 AI 产品。其次,企业自研往往会重蹈覆辙。她分享了近期与一家财富 500 强企业管理团队的交流:该企业曾试图自研一套现金催收(cash collection)内部工具,收集了大量操作录屏和截图,但很快就遭遇严重瓶颈——上下文信息质量极差,且企业内部同时运行着两套不同的 ERP 系统,还正计划收购另一家带有全新 ERP 的公司。面对错综复杂的系统映射和极其繁琐的“例外处理”(exception handling),企业根本无力长期维护。企业最终意识到这与过去几十年的“DIY 自研软件陷阱”毫无二致,纷纷认识到内部造轮子并非自己的核心竞争力。 Vlad 赞同这一观点,并指出这完全符合帕累托法则(80/20 法则):用基础模型做到 80% 的效果非常容易,但要达到能上线生产的最后 20%,却需要付出 80% 的工程精力。这包括构建复杂的系统集成脚手架(harness)、记忆系统、工作流引擎以及融入专有的行业垂直数据。Vlad 对大型企业提出了犀利的质问: > “So you can do this, but then let's say, procurement and workforce of AI procurement agents should then become like one of your core competencies. And you should evaluate whether this makes sense or not for you to have this in your core skill.” (“你确实可以自研,但这样一来,采购业务以及 AI 采购 Agent 团队的搭建就必须变成你们的核心竞争力之一。你得好好权衡一下,把它变成自己的核心技能到底合不合理。”) --- ### `45:00` 采购方对供应商的议价杠杆,与零和博弈之外的“双向 Agent”机遇 Elena 提出一个极具前瞻性的问题:供应商是否也开始使用 AI 或 Agent?当买家和卖家两端都由 AI 驱动时,商业协作会发生怎样的变化?Vlad 证实,Lio 坚信未来交易双方都会部署 Agent,这是必然趋势。过去人们普遍认为销售端(供应商端)的数字化和 AI 化会走在采购端前面,毕竟“销售很性感,采购很枯燥”。但在深入财富 500 强企业的工业供应链后,他们发现供应商端的智能化其实非常滞后——供应商可能在用 Granola 等工具做会议录音和视频记录,却根本没有部署能够真正自动化业务流程的 Agent。 更重要的是,大型工业企业、汽车主机厂等财富 5000 强巨头的采购部门,对下游供应商拥有绝对的话语权和控制力。采购方可以直接制定规则,强制要求供应商使用特定系统、满足特定质量标准,并按照指定的格式响应询价单(RFQ)。这种强势地位为 Lio 带来了巨大的战略机遇:采购方完全可以要求供应商接入 Lio 的 Agent 来自动化对接工作,从而让 Lio 有机会同时拿下交易的两端。 ```mermaid flowchart LR accTitle: Two-Sided Agent Platform Dynamics accDescr: 展示采购方与供应商在价格博弈之外,通过 Agent 消除数千项繁杂任务摩擦的共同利益 subgraph BuyerSide["买方 (采购端 / 具有规则制定权)"] B1["核心目标: 极速投产 / 上市"] B2["采购 Agent (Lio)"] end subgraph Middle["5,000 项非零和协同任务"] M1["需求规格与图纸澄清"] M2["RFQ 快速响应与比价"] M3["交付排期与产能对齐"] end subgraph SupplierSide["卖方 (供应商端 / 销售端)"] S2["供应商 Agent (Lio)"] S1["核心目标: 降低摩擦 / 极速成单"] end BuyerSide -->|"下发 RFQ 与集成规范"| Middle SupplierSide -->|"自动化提交与数据对接"| Middle B2 <-->|"协同自动化"| S2 ``` Seema 将这种双边协作类比为法律科技场景:诉讼或交易中的两家律所虽然代表利益完全对立的客户,但双方在事实同步上有着完全一致的诉求——都需要清晰掌握最新版本草案、未决争议清单以及双方已达成共识的条款。以往这些高昂的沟通协调成本全由人工承担,而 Agent 恰恰可以在冲突双方之间承担中立的协同枢纽。 针对“双方都有谈判 Agent 时价格博弈是否会演变为零和僵局”的疑虑,Vlad 剖析了商业交易的本质。他强调,价格本身确实是完全零和的博弈,但价格只是前置 5,000 项繁杂任务完成后的最终结果。在价格确定之前的这 5,000 项协作任务中,买卖双方的利益诉求是完全高度一致的: - 销售方希望尽可能消除摩擦,促成交易极速落地。 - 买方(例如飞机制造或数据中心建设)最核心的诉求是项目极速上线,绝不能因为采购人员花费 6 个月时间人工比对供应商回复而导致数据中心延期交付。 由于双方在消灭流程摩擦上的诉求完全一致,Lio 能够通过在供需两端部署 Agent,自动化处理繁重冗长的对接工作,为双方释放出极高的商业效率。 --- ### `47:30` 前线部署模式与传统软件巨头的反馈闭环缺陷 随着讨论深入,Elena 探讨了底层软件交付逻辑的转变:过去的 SaaS 行业铁律是“尽量避免为单个终端客户做过度定制”,以免被拖入项目制的泥潭;然而,在 LLM 与现代 AI 架构的赋能下,软件公司似乎能够在不拖慢整体业务迭代节奏的前提下,为客户提供极高程度的个性化定制。 Seema 对此进行了深入剖析,指出当前 AI 交付领域普遍存在大量的“前线部署工程”(forward-deployed work)。这一现象的根本原因在于客户现有数据的混乱状态:Agent 必须深刻理解第 N 个客户的独特数据和业务逻辑,而这往往比理解通用的标准化规则要困难得多。目前整个行业仍处于早期部署阶段,产品中融入大量人工服务和现场调试是必经之路。 ```mermaid flowchart TD accTitle: Incumbent vs AI Native Product Loops accDescr: 对比传统大厂割裂的实施模式与 AI 原生企业的数据反馈飞轮 subgraph Incumbent["传统软件巨头 (模式割裂)"] I1["标准化产品研发"] --> I2["独立交付/实施团队"] I2 --> I3["项目完成 (实施作为后置附加环节)"] I3 -.->|"几乎无法有效反馈"| I1 end subgraph AINative["AI 原生企业 (正向反馈飞轮)"] A1["前线部署工程 (FDE)"] --> A2["深入客户专有数据与异常"] A2 --> A3["构建严密 Eval 评测体系"] A3 --> A4["Agent 自主学习与模型迭代"] A4 --> A1 end ``` Seema 尖锐地指出,这种前线部署和深度定制的能力,恰恰是传统软件巨头(Incumbents)难以复制的致命弱点: > “And by the way, that is something that is harder for the incumbents to do because they're also not set up in a way to have even the way their product feedback cycle works, where they have implementation teams, but that's very much an afterthought versus something that feeds into the product side.” (“顺便说一句,传统巨头更难做到这一点,因为它们的组织架构甚至其产品反馈闭环机制根本不是为此设计的——它们虽然有交付实施团队,但实施往往只是事后补充环节,而不是能够反哺产品端的核心部分。”) 相比之下,AI 原生企业的核心优势在于产品与现场反馈之间紧密的“学习闭环”(learning loops):借助严密的评测体系(Eval process),AI Agent 能够随着使用时间的推移在真实的客户环境中持续学习、自我进化,将定制化交付中的经验直接转化为底层通用能力。 ### `50:00` 前线部署工程师的使命:通过自动化彻底淘汰自己的重复工作 对话探讨了 AI 代理企业在服务大客户时的落地模式。Seema Amble 指出,传统企业部署软件(如 SAP)时,往往需要雇佣 Accenture 这类庞大的咨询公司进行繁琐的人工定制;而在现代 AI 初创公司中,这一流程正在快速被软件化,客户可以通过配置开关自主调整业务规则。 ```mermaid flowchart LR accTitle: 部署模式演进对比 accDescr: 展示从传统咨询定制到自动化全自服务软件部署的转变路径 subgraph Legacy["传统部署模式"] A["采购 SAP 等记录系统"] --> B["雇佣咨询机构 (Accenture)"] B --> C["漫长的人工定制与交付"] end subgraph Modern["Lio 自动化模式"] D["FDE 介入微调业务细微差异"] --> E["将定制逻辑固化为软件组件"] E --> F["客户全自助配置 (Self-Service)"] end ``` Vladimir Keil 透露,Lio 的组织架构高度偏向工程化:公司内部 85% 的员工都是工程师,即使没有工程师头衔的人员,也绝大多数具备工程背景。Lio 极力避免沦为一家卖人头的咨询公司,因此他们赋予前线部署工程师(Forward Deployed Engineers, FDE)非常明确且残酷的考核指标(KPI)——自动化自己的工作。Vladimir 强调:“他们的 KPI 非常明确,那就是:从字面意义上讲,你的工作就是自动化你自己。一旦你把自己当前的工作自动化了,就转移到下一个任务去。”(“Literally, your job is to automate yourself. And then if you automate yourself, you go to the next task.”)通过这种工程驱动的飞轮,大企业复杂的定制需求被迅速沉淀为产品内置的自助服务(Self-service)能力。 - Lio 全公司工程师比例高达 85%,非工程岗员工也基本具备技术与工程背景。 - FDE 的首要目标是构建降低定制需求的自服务产品,而非承接无休止的人工外包配置。 --- ### `52:30` Bots and Buyers 峰会见闻:打破 27 年未变的“邮件+表格”采购僵局 谈及近期在纽约举办的“Bots and Buyers 峰会”(Bots and Buyers Summit),Elena Burger 戏称这不是 Dreamforce 那种传统活动,而是 Lio 举办的采购界前沿聚会。Vladimir 介绍,这是 Lio 第三次举办该峰会,会场距离其纽约办公室仅几个街区,现场聚集了 100 多位来自全球顶尖企业的首席采购官(CPO)、副总裁及 C-level 高管。采购行业虽然在过去 26、27 年中涌现出 500 多种琳琅满目的技术工具,但在实际工作体验上却极度招人厌烦——不仅业务申请部门和外部供应商痛恨与采购部门打交道,就连采购人员自己也对现有流程深恶痛绝。 究其根源,市面上的工具仅仅是对既有流程做了修修补补的边际效率提升,完全没有改变最底层的协作方式:绝大多数采购人员至今仍然深陷于 Microsoft Teams、电子邮件、Excel 表格和 PowerPoint 之中,核心流程几乎完全没有 AI 化。Lio 在峰会上展示了截然不同的全景视角,不再孤立演示单一的发票抓取功能,而是跨越间接采购、直接采购、物流与财务部门,完整呈现“从某人提出需求,到物品最终送达办公桌”的端到端 Agent 协同。为了让抽象的 AI Agent 变得可感知,Lio 还在展厅和办公室设立了物理体验展位,让客户亲身试用各种智能体。这种直观的震撼引发了采购圈的热烈反响,下一届计划在德国慕尼黑举办的峰会预计将迎来 700 多位采购界领袖。 --- ### `55:00` 采购赛道的万亿美元商机:枯燥、高情绪化与杠杆式商业回报 关于“采购这一传统低 NPS(净推荐值)领域为何能让人重新兴奋”,Seema 结合自身经历回忆,许多企业客户往往态度消极地表示“我们已经在用 Coupa 了,我什么都不想再买,也不想再讨论”,这是她经手过的数百万次客户电话中最沮丧的一类。Vladimir 则直言,这种普遍的受挫情绪恰恰是他选择切入采购领域的初衷。B2B SaaS 听起来平淡无奇,但采购场景却交织着“极度枯燥无聊”与“用户怨气极重的高情绪化”。因为该领域上一次真正的技术革命还在 20 年前,10 年前也不过是换了一层稍好看的 UI,因此即便只是用 Agent 带来真正的实质变革,也能极为轻易地给客户带来惊艳感。 更核心的吸引力在于其对实体经济和企业损益表(P&L)的巨大财务杠杆。从数据中心、飞机、汽车到无人机的建造,采购都是不可或缺的底层支柱。Vladimir 从财务模型角度道出了极其关键的数据规律:为了使利润率提升 1%,企业通常需要增加 10% 的销售额;而采购端只需实现 1% 的成本节约,其释放到净利润中的收益就等同于销售额增长 10% 所带来的效果。Vladimir 总结道:“当你把这三点结合在一起——高度情绪化、枯燥小众,以及惊人的商业影响力,这就是一个万亿美元级别的商业机会。”(“And you combine all of those three things, a trillion dollar business opportunity.”)采购并非唯一的蓝海,任何兼具高情绪反差、被忽视的枯燥属性和巨大财务杠杆的垂直场景,都蕴藏着被 AI Agent 彻底重塑的潜能。 ## Notable quotes > `03:00` The legacy incumbent is limited to their system of record and that record that they have, and they're not completing the end-to-end job. — Seema Amble > `50:00` Literally, your job is to automate yourself. And then if you automate yourself, you go to the next task. — Vladimir Keil ## Mentioned Elena Burger, Seema Amble, Vladimir Keil, Lio, a16z, Salesforce, SAP, Oracle, Coupa, McKinsey, Boston Consulting Group (BCG), OpenAI, Anthropic, Agentforce, JEPA, Polymarket, Granola, Accenture, Bots and Buyers Summit, The Incumbents Are Coming ## Video description a16z’s Seema Amble and Elena Burger sit down with Lio co-founder and CEO Vladimir Keil to ask where AI-native startups have an advantage when incumbent software companies already own the customer, the data, and the system of record. Their answer comes down to the work that happens outside those systems. In procurement, a final price in an ERP can hide hundreds of emails, spreadsheets, supplier conversations, engineering analyses, and decisions across legal, finance, and operations. Vlad explains how Lio uses multi-agent systems to take on more of that end-to-end work, from sourcing and RFQs to negotiation, shipment tracking, and invoices. They also discuss how enterprises learn to trust agents with increasingly consequential decisions, why the last 20% of an internal AI build can require most of the effort, and what happens when both buyers and suppliers have agents working on their behalf. [Source](https://mgln.ai/e/1344/afp-848985-injected.calisto.simplecastaudio.com/3f86df7b-51c6-4101-88a2-550dba782de8/episodes/63755eda-ff93-4095-8822-e8bcb95a06a6/audio/128/default.mp3?aid=rss_feed&awCollectionId=3f86df7b-51c6-4101-88a2-550dba782de8&awEpisodeId=63755eda-ff93-4095-8822-e8bcb95a06a6&feed=JGE3yC0V)

Source quotes

[3:00] Seema Amble: The legacy incumbent is limited to their system of record and that record that they have, and they're not completing the end-to-end job. [50:00] Vladimir Keil: Literally, your job is to automate yourself. And then if you automate yourself, you go to the next task.

Source quotes

[2:30] Seema Amble: The legacy incumbent is limited to their system of record and that record that they have, and they're not completing the end-to-end job. [0:00] Vladimir Keil: No company and no enterprise starts with fully autonomous negotiation agents from day one.

Original transcript

[0:00] If you want to build an aircraft, you need to procure thousands of suppliers. Someone sends a confirmation of like, hey, sorry, like this part is going to arrive two weeks later. And if they miss this email, hundreds of millions of them. Procurement historically may have been more in a box. And now it's like, OK, it's touching legal, it's touching finance. It's touching a bunch of different software systems and people. The opportunity for the AI native startup is to say, we're going to own that entire end-to-end arc. No company and no enterprise starts with fully autonomous negotiation agents from day one. They don't trust us and they don't trust the technology from day one. And by having this human in the loop approach, we are feeding our agent with all the feedback and all the learnings. And then they suddenly trust us for like 10K negotiations, 20K negotiations, 100K negotiations. When you think about what a durable vertical AI company looks like, what are the qualities that you look for? It's really, really hard to forecast your mode going forward. If you look back at all the best businesses, at the early stages, they were... and the system of record, where does an AI-native startup have an advantage? In this episode, Elena Berger sits down with A16Z partner Seema Amble and Leo co-founder and CEO Vlad Kyle to answer that question through one of the most complex parts of the enterprise, procurement. They get into why so much of the actual work happens outside the system of record, across emails, spreadsheets, contracts, engineering data, and conversations with suppliers. agents that can coordinate that context and increasingly take on the job end to end. They also discuss how you earn enough trust to let an agent negotiate on your behalf, why building an internal AI tool can be deceptively easy until you hit the exceptions, and what changes when agents eventually sit on both sides of a transaction. Welcome back to the A16Z podcast. co-founder and CEO of Leo, which builds AI agents for enterprise procurement. Seema, you recently wrote a piece called "The Incumbents Are Coming" and then asked the question facing almost every AI application company: if an established software vendor already has the customer and the data and the model can work across its tools, where does a startup have an advantage? And we have Vlad here and Vlad can really help us understand where a startup has an advantage. So I think a good place to start is the cases for and against the incumbents. So if a company can connect a capable AI agent to the software it already uses, where does another application actually have a use case and an advantage there? Yeah, let me back up and frame it up a little bit. So historically, we thought about there is the incumbent and then there's the startup. raise. However, now there's like this third piece, which you're pointing at, which is the incumbent can layer on one of the models on top, and then there's a much more formidable competitor in the market. So why do you need an AI-native startup if you've got Cloudforce, which is taking Cloud plus Salesforce and putting the two together, and then you've already got all your data and your employees are all used to using the product. So why another product? I absolutely still think there's obviously still a case for the AI-native startup, and it really centers around the fact that... The legacy incumbent is limited to their system of record and that record that they have, and they're not completing the end-to-end job. So let me put that more concretely in an example. So say you're a customer and the customer calls and says they got charged after they got canceled. resolving that cancellation history isn't just the customer going into the chat and saying, hey, I got canceled. overcharged. And the response there, it has to hit billing. It has to look at all the chat history. It has to look at the contract. That's not one system of record. That's the knowledge around that customer and everything it touched. And that's something that one system of record wouldn't touch. However, the opportunity for the AI native startup is to say, we're going to own that entire end-to-end arc. So that could be illegal. So owning everything from brief all the way through trial. Vlad can talk more about procurement, but it's really the concept of owning the end-to-end work. Vlad, do you want to talk about where that does show up in procurement, like where existing incumbent plus a model just is insufficient? And what have you seen just for the companies that you work with? Sure. So when we think about procurement, I would assume that most people think about prices, right? So what is the end price that we negotiated on? And surprisingly, the record looks always very, very simple and [5:00] Very easy. 8K, that's the result, for example. And I mean, it's the same for sales, right? So even if I come to CIMA and tell her like, hey, we now partnered up with another enterprise, look at the signature here for like this contract. It looks like very easy, but like CIMA doesn't see like all the work behind it, right? So like, there are probably like 30 stakeholder meetings happened, 500 emails, 20 Excel sheets. And that's the same for the counterpart procurement, right? So you see in your ERP system, 8K for... aluminum, but you don't see that maybe the supplier did like a pushback and asked for like 10k. You don't see that like a cost engineer had run three weeks of Excel sheets and 3d modeling to find out the prices of the part and everything else. So that's what we see. So like most of the work in procurement actually happens. outside of this ERP or any system of record. Yeah. And I'm sure in the workflow that you described, an agent can do a huge number of things and different kinds of agents can do a large number of things too. And I actually think that's a good bridge into the next question, which is, you know, a year ago, I think a lot of the incumbents were trying, releasing chatbots. And that was kind of the extent of what you would see. But Seema, in this piece that you wrote, you lay out four different kinds of agents, retrieval agents, which are kind of the chatbots that we're familiar with, process agents, policy agents and principal agents. So can you just walk us through all of them and explain kind of what changes in the kind of judgment that's necessary across all of them? effectively had a chat bot that sat on top of the system record, which you could chat with to retrieve information, maybe do some analytics. And that really was in that first bucket of what the retrieval agent is. And maybe let me walk you through an example of what each of like the retrieval, the process, the policy and the principle back to the customer support example, just because it's very it's easier to understand. So imagine if you're a customer and there's a service outage and you're calling in to say, hey, I want to get compensated for this service outage. Retrieval assistant, which the incumbent may have, is going to be able to pull up, yes, this was what the contract term said, and yes, there was an outage, and just verify that information. It's pulling up information about the customer, it's in the database, and it's just sharing it back and maybe synthesizing. The second step in the agent sequence is the process agent. Therefore, we say you are entitled to money and it can just apply the bill and just do process. There's no judgment involved. Then as you keep going to the policy agent, so the policy agent isn't just going to apply the process, but it's going to say, okay, in this situation, it was out for 20 minutes. That's enough to be considered a significant outage. And they're applying that judgment because there isn't really a strict definition around it. you're actually weighing, okay, should we offer more compensation? Because that was a pretty terrible outage, and we want to reserve the relationship, and it's worth doing more beyond even what a process or policy is. But the importance of these four things is that most incumbents started out in, if at all, in bucket one. Now, at least they're marketing that they are moving towards process and policy, meaning they'll be able to apply more judgment. And, agents that will help you get a document signed or input information from a transcription or things like that. They're very much still limited to, Two, I would say retrieval and a little bit of process. They have not gotten into more judgment. And I can get into why there are all sorts of incentives that are preventing them from that. But the incumbents are trying. And I think what they're not able to do, they're like, some of them are saying, OK, let me partner with OpenAI, Anthropic, one of the labs, and try to build out, take that model capability and complement what they have and superpower it. Yeah. Well, do you want to say why sort of some of the incumbents are holding back? Yeah. OK, so. I would say they're holding back, but they're held back. Yeah, I'm sure they want to be full force, but there's probably two pieces. One, they have this advantage of distribution, right? They have the customer trust, which enables them to then sell more products with the customer. So take Salesforce. When AgentForce launched, it was very easy for customers to say, yeah, I'm going to sign up for the Salesforce agent, especially if it was offered at almost no extra cost. seamless to turn on the product. The flip side is there's all these internal incentive issues, right, which is if you start getting [10:00] into more complicated agents, it's an internal conflict with an existing product that's offering workflow versus you're resolving the work. And those are two products that are, like, if you're solving a customer support issue end-to-end versus providing a workflow for a support agent, a human agent, those are different buyers. How do you, you know, those two teams are in conflict. And then on top of that, I think from a sales perspective, like, what are you selling to the customer? And then oftentimes in the classic, like, incumbent issue, right, is, like, there's two VPs, right, and they're different orgs. figure out what the right set of incentives and the right person to sell to. But anyway, so there's all these sort of classic incumbent issues I think that the incumbent also runs into. Makes sense. Vlad, where across this kind of spectrum of retrieval agent, process agent, policy agent, principal agent, where does LEO sit? Yeah, so we span across all of those categories, and it really depends on the complexity and the risk our agents take. Right? Sometimes we can, like we already have use cases where we run fully autonomously. Sometimes you have the human in the loop. It really depends on like the budget approval, how, like how complex this is, how risky this is. But maybe like coming back to what Seema said about trust for the incumbents, like you talked about like internal trust. I think there's like also an external trust thing, right? So like. how do you convince someone to go through from, hey, just like an agent that retrieves some information and maybe runs processes to do something completely autonomously? It's like, Obviously, there's like a product component to it, but mainly it's a people component. So they need to trust you. And like we as a startup, scale up, we have to earn the trust. Incomments already have to trust, but this also means they like they can destroy the trust if they ship something like too early and the product maybe doesn't work or it's bad or it's like works decisions in a bad way. So that's what we can do. actually became kind of like a side quest for us. Because... When we look at the invoice process, invoice agents is a process. So we retrieve some information, you match this across other documents, and then you push this back to SAP Oracle. A very clear process. And then we figure out, okay, that's 100% of the software market. So that's invoice software. That's how you build it today. But it's actually only 20% of the work of the job to be done, of the problem. was like, um... what if the invoice is fraudulent? What if there's a mismatch? What if we don't take the happy path? And so we like... very fast shifted to the next step of agents like doing those exception handlings. And we convinced the customers by Um, I think we got lucky being always slightly ahead of the curve. So we were able to... to pitch the next generation of agents. So for example, like when we started out three years ago, it was like just retrieving a document. Like not impressive at all today, but like three years ago, this was in like, Crazy impressive. So we pitched this to customers. We find out, okay, that's a real problem. That's a real use case they would pay for. And then we were able to ship this some weeks later. And in the same way, we are doing this now for the next step for process agents and for like fully autonomous agents and for long running agents. We are pitching this to them, finding out it's a problem, and then we're able to ship this very fast. I think an interesting point on trust is, is this internal versus external trust. The other lens on that is, yeah, so you need your customer to buy the procurement software and trust to use it for their internal processes. But one of the really interesting things when we first met Vlad was that they're also doing the negotiation. So you have to trust that the Leo agent is going to then interface with a third party, and there is that piece of trust. And of course, I think a lot of people feel burned by the incumbents and like, pretty limited and haven't been able to do what they've marketed they've had in the past. So, but putting that aside, like, I don't know, maybe Vlad, I'd love to hear a little bit how you convinced the customers to trust an AI agent to now take on negotiations. Yeah. And can, when you do that, can you also just like paint the picture of like what's involved in procurement and who are your customers and what kind of sort of legacy systems are they used to? Yeah. Yeah. So like when we, when you think about procurement, you like maybe just think about like purchasing or like you, when you look at like B2C world, like just you buy something. But actually it's like a, very [15:00] intense process which like runs the economy, right? And it includes multiple stakeholders and a lot of stakeholders and a lot of departments. Legal, cost engineering, obviously procurement, finance, all of them have to work on these decisions. And Essentially, like when we... All right. I think the reason is how we convinced him is what I already said earlier on. So we... we're like always a little bit ahead of the curve. Okay, so we knew the technology is coming. So we like even before ChetBG came out, um, We just started a few weeks before this ChatTVT breakthrough. So we already heard all of the problems. Then we hear the hype in the, let's say, tech bubble, and we were able to pitch those enterprises. And we quickly figured out, okay, this could be an interesting use case, just chatbot applications or retrieval agents, document processing. And then we... we are able to find out the problem and then ship this quickly to them. And then, Obviously, this is the people factor of trusting. So we are telling them something about it and we're able to really ship something in production. But then there's also this product perspective where we have a lot of evals in place. So we... the... No company and no enterprise starts with fully autonomous negotiation agents from day one. No one does that. Why? Because they don't trust us and they don't trust the technology from day one. So we have a very easy approach of having a human in the loop and this is like, extremely helpful for us because we see, like we have like, let's say like the perfect negotiation agent, which is like overall the perfect procurement negotiator, but we don't know exactly how, a Fortune 10 enterprise, like the specific Fortune 10 enterprise operates. And by having this human in the loop approach, we are feeding our agent with all the feedback and all the learnings. And then they suddenly trust us for like 10K negotiations, 20K negotiations, 100K negotiations. And then you also have like other agents that are like more long running. So when we talk about like multimillion dollar negotiations where you analyze complex 3D models experts in the loop, right? So there's an agent running for multiple hours and then we ask for feedback of the cost engineer and then it does the next work and so on. Maybe just to double click on that, where do you put the human in the loop on the negotiation side? You mentioned the cost engineer, but if you were going back and forth on a deal, is it mostly around data for something like cost engineering or is there anything else where you have humans in the loop there? So again, depends on the level of negotiation, right? So like we have to distinguish between like, negotiations where you just, like a negotiation where enterprises, they never did those because they didn't have the capacity. By deploying agents, they can just capture savings that they weren't aware of. So before agents or before Leo, they just didn't care about everything which happened below 50k. So you can just... Like this is maybe a hack for like other startups. You can just send an enterprise an invoice for 40K. They will probably not negotiate because they don't have the capacity to do so. Except they have Leo agents, then we are going to negotiate against you. But other than that, they are just like, just paying that. And obviously they are the risk of like, what is the risk of like, you didn't negotiate at all. So what is the risk now of having a bad negotiation agent? nearly zero, right? So maybe we miss out on some negotiations, but like it's better than nothing. But still, you know, in like in, we talked about business relationships and business relationships are not always about the cost and the money, right? So maybe you're not spending a lot on the vendor, but maybe you... you are like you need this business relationship, right? So a good example might be like, podcasts or marketing services. Okay, that's probably like a friction of the spend, but you don't want to, like you have a clear business relationship with someone like setting up the studio and you don't want like a random podcast some random people doing that because they already know how, how ASICS and Z operates and how you want to record all this stuff. So there we have human in the loop approaches where like procurement people care about the relationship. So they care about the voice of tone and how it works, but mostly autonomously. And then we have the other set of agents where we always have a human in the loop approach. And it's like, they're like multiple steps and like negotiating. It's also like, how's the contract design? [20:00] So we're talking about legal, how is like... Collection design. So we talk about finance, obviously like cost structure. So we're talking about really like cost engineering. Then we talk about commercials. That's procurement. And those are... not back office people, those are like highly trained people where they have very specific knowledge of a very specific process of a very specific company and very specific industry. And they feed those long running agents of Leo with those insights. That's another example of how procurement historically may have been more in a box. And now it's like, okay, it's touching legal, it's touching finance, and it's touching a bunch of different software systems and people and both specialists and more generalists. Yeah. Can we map this onto a specific customer, like not a specific customer, but a specific vertical? Like I'm a drone manufacturer, I manufacture humanoid robotics or something How many suppliers am I touching? Just all of those things. If you want to pick me, Vlad. a vertical that, you know, is just managing all of this complexity with Leo and just kind of take us through what their experience is. I think that would really help just illustrate exactly just everything that you touch. Again, like when we as Leo, when we talk about procurement of purchases, like we think, Don't talk. about laptops and pencils. We think that's solved also by Leo agents, but that's easy. We solved this three years ago. We talk about when you... Like you want to build an aircraft or robots or drones or even like We now like doing a podcast about, you know, like AI hype, but even AI needs to be built, right? So you need data centers. And like building means procuring. Like someone needs to, like if you build an aircraft, you need to procure thousands of suppliers. You need to build a factory to build this airplane. And... like really small frictions can have like a crazy impact, right? So like there's a, like if you're running a very large project of like building a data center or building an aircraft, if there's like one specific part which arrives in, Two weeks later, this can have a damage of like, hundreds of millions of dollars and postpone the project. So like all of those decisions have to be coordinated. And one part is like you need to figure out like what you need with what suppliers you work, what is like the best supplier to get this part. But then once you decided all of the stuff, there's like all this operational stuff, back office stuff behind it, which Mine sound like unnecessary and boring, but again, like, Operational means someone sends a confirmation of like, hey, sorry, this part is going to arrive two weeks later. And this is like one of... 500 emails in the Outlook or Gmail of a procurement manager. And if they missed this email, they hundreds of millions of damage. And this happens regularly because the only thing they store in their system record is then just the date. right so like It will like Not this Wednesday, next Wednesday. That's what you see in the system. But you don't see like, Maybe that's okay. But maybe that's a $100 million damage. And someone has to decide that. And that's also what our agents are doing, right? They are not only retrieving the information, they are then making the decisions. Like, does this have an impact? What kind of impact? And how can we resolve this? Yeah. When you are sort of so deeply embedded in the physical world, what kinds of, you know, physical world problems can you intervene with? think are just unsolvable. Let's say you have a shipment coming in and a bunch of stuff falls off the ship or the street is closed or whatever. They're things that you can't do. And obviously, they're things that you can do. So where can you intervene and where does that really make a difference? But actually, it's about probability. So obviously, you can't change if, if there's damage on the ship. Every example that you manage, you can't change that. But you can if you have like all of the context, you can predict that. Because you can predict like how reliable is a supplier. So there are ways to protect the goods that you're shipping. And if you have all the context, you have one supplier where 20% of the goods are missing, and then 1% of the goods are missing. [25:00] the good is missing. And maybe like this one with 20% is like 10x cheaper. But for this use case, it's fine for you to pay 10x the amount because you have like a higher probability that this thing actually arrives. So, and this is the powerful thing because you have like context, not only within one enterprise. So we talked about like multiple stakeholders, but there's also context on the outside world, right? So just the agent should like have context of all the news out there. Maybe even having context of some bad sale on Polymarket. I was like, okay, those disruptions are going to happen. Then information about on the supplier side, on the seller side, on the demand side. And by combining all of those contexts, I wouldn't say that there is a limitation in the long run. Obviously, today we have different sets of probability, but we can help throughout the process. and this is what we are building at Leo, right? So it's much bigger than just procurement into a company, it's more like intra-company and how enterprises are doing business with each other so like buyer and supplier side You described Leo as a multi system So can you describe what the different agents are doing One level is that Leo agents spend across all those four categories that Seema mentioned in her article. And it again depends on the risk and the complexity. So we use all of them. So like multiple agents. but the other thing is that like in in order to do a job end-to-end those agents need to share information with each other they need to do this in like a very specific order and when we talk about like a multi-agent system this is essentially what we are doing we are solving like the task end-to-end and because the also like human level task involves eight people eight stakeholders and maybe like three departments and five different software tools, we need to cover like all of those to do like the job end to end and those agents need to then communicate with each other and only with a multi-agent system you can do a job end to end. When we started out, we like started off with like a retrieval like more like a co obviously like three years ago but then the next step was like a single agent But then we very quickly discovered okay you can solve negotiation even without having a contract agent without maybe having an agent looking at the news and everything that I described before. So that's what we define as a multi-agent system. So if you have a bolt, like an airline company needs to procure a bolt for, say, you know, Boeing needs to procure a bolt. What exactly is that process for procuring the bolt? And like, where does Leo step in on that process? Yeah. So like, this is like one of the purchases that we can like run fully autonomously. And we can do this because of this multi-agent system. So like, first of all, someone has a demand, right? So they need to somehow communicate it. And even like this part is extremely complicated. So you need to call someone, maybe you like, you like, you open up your laptop because you're like a construction worker, you open up your laptop only every second week. And now you are required to like work with SAP or any other like EAP system So you can even like issue the demand So this is like how we make it very easy So you very easy So you take a photo you upload a quote an Excel sheet and it actually everything that you should know about procurement. No one cares outside of the procurement department about categories, GL accounts, framework contracts, no one cares. We in the procurement world care, but no one outside that cares. And then our agents take off and they check the inventory. They find out, okay, they ask another plant, okay, can we source those bolts internally? No, okay, then I'm talking to the sourcing agent, finding out, do we have internal suppliers? Do we have external suppliers? Then another agent has to draft the RFQ, send out the RFQ over email. Then a bunch of emails arrive. Some of them are completely nonsense. Some of them are just in the email. Some of them are PDFs. Some of them are Excel sheets. We retrieve those information. Then we do the next step, or maybe based on our price benchmarking, there's an opportunity to negotiate. And then we have agents that essentially decide on the next step. So negotiation could mean strategic negotiation with a human loop. This could mean autonomous negotiation. This could mean auctions and e-auctions. Calling then the specific agent, doing the negotiation, and then doing the negotiation. [30:00] it's like end to end. Think about like, confirming the order, shipment tracking, invoices. And we are able to run this fully autonomously, capture all the context, and And... Then obviously the next powerful thing is do this for like more complex, um, parts where we talk about like direct procurement, um, where we also operate. What's direct procurement? So like, it seems like everything I just described is... the main goal is here automation, right? So you can like run this process fully autonomously and then throughout the process you can like generate even more savings, right? So it's not like, so we look at it as like, okay, what is like this, like end to add, like job to be done, how does it look like? So like what are they doing like thousand times a day, but actually they want to do it like zero times a day. We've run fully autonomous agents. But there's also opportunities of like, what are they doing zero times a day? But if a business would do this a thousand times a day, that would have a crazy P&L impact. autonomous negotiations on spent they never negotiated before. So this is like in the indirect procurement part, like think about MRO parts, building a factory, the bold example that we did, but also laptops and pencils, marketing services, someone who needs to build up this podcast studio. Those are like all indirect. And then we have like direct parts. This is like when you build an airplane, those are like all the suppliers that actually work. Um, that you actually need to build the airplane or to build the drone or to build the robot. And then we don't talk about... 50,000 suppliers. We talk about 100 suppliers or 2,000 suppliers maximum. And those are like extremely strategically important. And you have maybe on one supplier... like 1 billion of spent. So you don't want to run an autonomous negotiation. You want to run a negotiation which takes three months and where you're like crazy prepared and where you have engineers on your team analyzing, okay, what's the indice for aluminum? What's the indice for oil? How did the price change? So you like really take over like all of those drawings, you check the where it gets like, really exciting deploying agents. Yeah. And for something like that, presumably, like you'd have the expert engineers and the other procurement people kind of more as the front of house and like the agent is more back of house. Is that the idea? Or is the agent like, actually, it's like you sit across the table and you're shaking hands and it's like the robot instead of the human who's like negotiating. So yeah, is it more back of house or is it like still front of house? It's obviously more back off housewives because you're like, because you like, like these complex multi-million dollar negotiations. And that's, again, like a beautiful example. 90% of the work is preparation. The end result that you see in your system of record is like, oh, instead of like one billion, I paid 900 million dollars. Okay, but like there's like three months of preparation and like 10 people working full time on that. And obviously this is like happening in the back. But actually we have some use cases where... it's also like helping in real time. So think about, let's assume we would now have a negotiation and I have like a perfect preparation. The same as like with those notes that we are having here. Imagine while we are negotiating, I would have real-time insights on my screen popping up where you tell me the indice for oil changed 10%. So it's increased by 10%. So that's why we need to increase the prices by 10%. And I would have an immediate pop-up of like, that's true, oil increased by 10%, but the product has only 30% of oil contained. maybe only by 4%. So yeah, they're all like exciting use cases also like in the real life part. Yeah, we know that, you know, companies like Harvey and Decagon are really fine tuning models now. What kind of underlying models do you use and how do you approach things like fine-tuning or harnessing? Yeah, so like we believe like you can, so like we use multiple models from like all providers and we really see this as a, like obviously like as a commodity, right? So they like have... really good general business purpose. So reading, creating a PDF, and creating Excel sheet, all of this stuff. But we also believe that for some use cases, you... you can get extremely far with like combining the foundation model with a harness and you can maybe reach [35:00] like 100% of like, the job to be done. But there are also some use cases where you can have like the best foundation model, the best harness, whatever it then means, but like, the best harness, but you still can get only to 80%. And like, it would say like, Good examples for that is like, for example, what When we talk about negotiations, what cost engineers are doing. So they're analyzing drawings and then they're defining what should this Um, this part actually cost like, and that's why it's called like short cost modeling. Um, and there's, um, there is definitely like an opportunity where we like thinking and already started, um, um, fine-tuning the model to get them to 100% in this part. Another example is like price benchmarking, where... Think about like the, like you would have a quote, right? And in the perfect world, you would just drag and drop the quote somewhere and you would get the perfect price. But it's like, and all those, like all those informations, they are like not publicly available, right? So there's all like, those are like all proprietary data based on like one, one enterprise, like across multiple enterprises. So like general purpose models can't train their models on that. So what we are thinking about is maybe not training just an LLM, but I think what we see now with models like Jeff also popping up where you have an... You train it on like text data, but the output is actually like an outcome or just like the perfect price. And you can't do this with Harness because... Like, If you would give me like a quote from BCG and a quote from McKinsey, they could do like the exact same work, but this could be like a 10x different price. And I would have like no idea like, what is better. But if you give this to a procurement manager, he would like initially have a gut feeling. I'm like, okay, this quote makes sense. I think good examples are content creation. Always like, I don't know how much I should pay someone for creating a video. But there's a gut feeling behind it if I ask another video creator how to do that. But if you ask them to write down the rules, they can't do this because it's just like gut feeling and instinct. And that's where we see a lot of opportunity actually training an agent, but not maybe like a classic LLM, but more like, again, like what companies like models like Jeff are now doing on the outcome-based. So we have like price benchmarking, short-cost modeling. um Seema, we've talked a little bit about how labs are really moving into industry specific work or working with incumbents to do this. When you think about what a durable vertical AI company looks like, what are the qualities that you look for? One is around, you know, owning the end-to-end work that we're talking about, building up this data asset and being able to do something that hasn't been done before in many cases. This is all said, I think when we talk a lot about moats, it's really, really hard to forecast your moat going forward. If you look back at all the best businesses, at the early stages, they were... they were just thinking about, okay, I'm winning customer trust, I'm selling more to them, and there's a lot of opportunity versus, okay, I'm going to do these six steps and then get to the seventh step, and then we'll have them vote. And so I think we talk a lot about defensibility and durability, and I think part of that is you're locking in the customer. There's more dependencies. They find it valuable and you're doing more of the work. And here it's it's truly like, OK, you know, old CRM company was log for all the deals. New sales AI agent is actually owning a lot of the sales prep process and the outbound process, fielding inbound and doing a bunch of the work. the overall customer is dependent on that product. And that's like a really important signal of getting to the moat. And everything we talk about in terms of stickiness and network effects and all that is sort of downstream of... of that initial like customer use and the value of the product. Vlad, have you had conversations with customers or potential customers who ask you, you know, why should I buy your product? Why can't I just, you know, plug into a model and do this myself or like use whatever existing system of record I have plus a model? Like, like what, what do you tell them and how do you, how do you convince them to use Leo? Yeah, 100%. And that's a very fair question, right? And like, even if you look like internally at Leo, [40:00] So like the... the first use case three years ago, which like kind of like went viral in the procurement world was like, just like having a quote and then getting this information into SAP. So like very like, Again, technically, but tremendous business value. And so you have this retrieval agent getting all of the information, putting it into SAP. This was our first product. And we had an engineering team, obviously small, just the three of us, so maybe four people building it and then selling it. But this is nowadays a case study if you're applying to work at Leo. like eight hours to do so. So what I want to say about that is like a product that we, like one of our first use cases can now be somehow built by engineers within eight hours. So because it's very easy to build stuff nowadays. So obviously there's a question, okay, well, so someone can build this within eight hours, but, Okay, cool. But then couldn't like just procurement departments also just build everything in, two months. Um, And the answer is, yes, you can build this in eight hours and you can build this, but you will only reach... 70%, let's say, like, the performance. And the problem is 70% of the performance or accuracy or however you measure it, it depends really on the task, doesn't mean 70% automation, right? So this can mean that you have 70% of the performance, but you still need to do 100% of the work because 70% is not that much. So again, all of the people have to check the data. So maybe you even created more work... more work than they didn't do before. Two things to layer on to what Vlad just said. One, overall it's good if there's more adoption of the base models or just like GPT products, because it means that people are also willing to trust, um, vertical specific products as well. So I think that increased familiarity, comfort, excitement about AI tools is generally just good for the market. The second thing is I was chatting with the management team of a Fortune 500 company two or three weeks ago. And one of the things they mentioned was they had tried to build out their own cash collection product. It's a big enterprise them, they had found that there wasn't enough context. There was poor quality context. They had a lot of recordings, a lot of screen grabs. They tried to pull it all into one system, but there was no, there wasn't good enough. And then there was this giant question around, okay, like, you know, we've got now two different ERPs and we were about to acquire another one. Who's going to update keep talking about exception handling, you now need to map that onto a totally different system and different way of doing things. And I think they quickly realized that. the internal build didn't make sense. And so we keep hearing stories of this where people are like, okay, I'm going to do the internal build. And they're like, wait a second, it's not different from what DIY has ever been in the past, which, corporates have always tried, but I think enterprise companies generally realize that there's their core competency and then there's building internal tools and they should focus on the first camp. Yeah, yeah, makes sense. Yeah, so that's exactly what I've meant with like, obviously, like, they can get to 80%, but those last 20% really matter. And you can only get, like, they matter to get into production. So that's why you need, like, this harness, right? So you need all those, like, integrations, memory, workflows. And sometimes you need vertical data to do that. And like the Pareto Principes, so like those 20% can make like 80% of the effort. Or like they are making 80% of the effort. So... to all those Fortune 500, 150 companies. So you can do this. But then... let's say, like, procurement and... workforce of AI procurement agents should then become like one of your core competencies. And you should evaluate whether this makes sense or not for you to have this in your core skill. Vlad, I'm curious if you're seeing suppliers start to use agents or AI at all and kind of like what happens when both the buyers and the suppliers are fully AI enabled? Mm. Yeah. So like we, 100% believe that in the future there will be agents on both sides. And this makes so much sense. But surprising [45:00] what we see is like, so like when we look at the supplier side, this also kind of like equals the seller side, right? So what we see is like the sales side was like always, ahead of the procurement side. But what we're now seeing are those suppliers for this Fortune 500 companies. This actually is not true. So they are like maybe advanced and like, let's say, video recordings and like using tools like Granola and all this stuff, but like not like really having agents deploy, they're automating the work. And the cool thing is as like procurement is like, is unsexy, right? So sales are sexy, procurement is unsexy, but it's like one process and procurement is the counterpart. But now the good thing is in those industrial companies, Fortune 5000 companies, procurement has the bigger power to the supplier. Because, you know, You as an like typical use case like automotive supplier, you dictate to your suppliers what they should use, what the quality has to be, how they have to answer to a specific RFQ. So the opportunity is now... if we serve the procurement department and they can dictate what a supplier should use, Why aren't we also pushing them to Leo agents that are also helping them automate the work, owning them both sides of the transaction? And Elena, I know we were talking earlier today about, you know, how can you have two parties on the same platform? How does that work? I think it could even extend into like legal work, right? And these are two very adversarial parties, right? But like if you have two law firms with clients with different interests, but both benefit from knowing, okay, here's the latest draft, here's where we are with the open issues, here are things that have been agreed upon, and just even tracking that. all being human that's being created by um humans and so be that coordination effort an agent could be doing yeah yeah it's well it's super cool to think about how like you know both sides are kind of maybe evolving in tandem one side might be going a little bit faster as you're talking about um but over time potentially people are just like on the same platform and actually it's like also like what we mentioned in the beginning, right? So like, like the obvious question is like, okay, but like, we also talked a lot about like negotiation agents. What if like both parties have negotiation agents? And price is 100% the point where it's like a zero-sum thing. Or like, they have like different interests. But what we also discuss is that like price is like, the outcome of like 5,000 other tasks that happened. And on those 5,000 other tasks, they have the same incentive. Sales wants to have as little friction as possible. Buyers want to have a really fast time to market. Again, coming back to... building aircrafts, building data centers. You want this data center to be built as fast as possible. You don't want to be built at like, Six months later, just because it takes so much time to analyze all of the responses from suppliers. And you want to make the sale also fast. So like all of those 5,000 other tasks, the incentive is exactly the same. And that's why you can deploy or Leo can deploy agents also on both sides doing like automating the work of all those other tasks. This is the beautiful thing. I think that there used to be this logic of like, you shouldn't customize your software too much to one end user, one end customer. But I think something about LLMs and AI in general is like, it might increasingly be possible to customize without slowing yourself down as a business too much. So I'm curious if that is something that you're seeing, Vlad or SEMA. And kind of what does that mean for end buyers of software? I think the overall principle, there's... a lot of forward-deployed work happening right now. And part of that is because the state of the customer data and understanding customer N is, is a lot harder than understanding N plus one. And so we're sort of in the early stages of deployment overall, and that's why there's still a lot of humans as part of this product. And by the way, that is something that is harder for the incumbents to do because they're also not set up in a way to have even the way their product feedback cycle works, where they have implementation teams, but that's very much an afterthought versus something that feeds into the product side. The beauty of AI is, A, it learns over time, so that's when we're talking about learning loops. And you have the right eval process. [50:00] can do more and more complicated jobs over time. And part of that is automating the deployment itself. And so you can, and I'd be curious to hear how Vlad is doing it, but a lot of our companies even are doing that at a rapid clip where more of the customization, A, is being handled in an automated way, and B, the customer is able to turn the knobs and levers around customization via software. versus, okay, I needed to bring in, A, the original, it was like, you brought in Accenture to do your SAP customization, and now it's like, okay, I've got a forward deployed team that's going to help build and spec it out, and ultimately, it's going to be completely software-driven. Yeah, I mean, that's the reason why, when you look at the AUG structure of Leo, 85% of the people are engineers, and even if you look at the people where they don't have an engineering title, They have mostly an engineering background and the reason for that is we obviously don't want to be a consulting company. So we make sure that we have overall the best agents in indirect and direct and finance and those parts But then as you mentioned there is a lot of forward deployed work to do if you go to enterprises because they have different nuances in their processes. But how we work is we, as you mentioned, building a product in a way where it's like where we're reducing this customization, but also where it's a lot of self-service. So the job of our FDEs and forward deployed engineers is on the one hand making it self-service, but internally it's automating their own job. Their KPIs, you're seeing this happening multiple times. Literally, your job is to automate yourself. And then if you automate yourself, you go to the next task. I think it's also an approach that Google or so is doing. But yeah, I 100% agree with you. And that's exactly what we are what we are building and how we're doing it. There was recently a very big system of record event and we're not talking about Dreamforce, we're talking about the bots and buyers summit that Leo hosted in New York. And just wanted to kind of hear you know stories from the ground and what you seeing among buyers What are people excited about What are people looking ahead toward What are people you know asking you for? Can you just kind of tell us some stories from that day and that event? So, I mean, it was the third time that we are doing this event. Now we did it in New York, just a few blocks from our office here and over 100 procurement leaders arrived. And what we, made sure that when we do such events that we only invite high caliber people, so C-level, CPO, vice president. And there are two things very different of how we do this or why they're so amazed. So the first thing is when we look at how procurement used to work in the last 26, 27 years, a lot of tools emerge. So you can, they are like all those technology landscapes and you can find them on LinkedIn and you will see like they're like 500 procurement tools. But like if you like, and this is also the reason like, but when you talk to procurement people, like very painful and like I challenge someone like to find someone who like loves to work with procurement like no one does Like you can really state people hate working with procurement and when talking about the requesters and I talking about the suppliers and even people in procurement hate working with procurement So what's going on if there are 1,000 tools? And the reason for that is all of the tools, they just made the process more efficient. That's all. But they never changed how those people actually work. And it's like crazy to see that they work in emails and on Microsoft Teams and in Excel sheets and PowerPoints. It's like their main channel where they work on. And it's like zero AI enabled, obviously, in this part. And the other thing is like we give them like a very cross department perspective on procurement. So we are not talking about like, look at this crazy invoice feature that we developed. but we're more looking like someone needs something and in the end you have it on your table and this can be like across indirect direct logistics finance and you can see how we are doing it here and we're also putting it into like more into like a physical world because like AI agents that's very abstract so what we are doing is we building up [55:00] and we even have this in our offices also in New York, where you can walk through the booths and experience like, all of those agents like really hands on and that's what the people love and it's like, I mean the next event will be with around 700 people so you can't imagine how crazy this goes. Procurement people gone wild. Yeah, yeah. It's going to be, that one is in Munich. Yeah, so we're doing them like in Europe, Munich and in New York all the time. - Cool, if you're listening and in procurement, you know where to go. - Maybe, I guess, one question, one question for me. What do you think it takes to get people excited about procurement? Is it the agents? Is it the people? Is it the time save? Or something else? You mentioned it. Procurement is one of these things that I remember people don't like. It's like a universally disliked low NPS area. system of record, I'm on Coupa, and I don't want to buy anything else. I don't want to talk about it. It's fine. It was like the most disgruntled customer call I've ever done out of like millions of them. But I mean, I'm curious, yeah, what it is that you think, you know, really gets people excited about this category. Yeah, so I mean, it's like, it's like, and this is also why I like procurement. It's like, it's on one hand, like, So like the reason like why we started in procurement, like it's not essentially like what happened, but like how people react to it. Right. So if you talk to the, to the people, they're like really frustrated. So this means it's like highly emotional topic, but it's like, like, let's be honest, like, um, B2B Zars. Okay. But it's like highly emotional. So that's a good thing. And then if you combine this with like something which is boring and niche, this is also an advantage because again like the... It's... it's also easy for us to amaze those people. Because the really last revolution they have seen is like 20 years ago. And then maybe a nicer user interface 10 years ago. But nothing else happened. And so you have boring, highly emotional, And then plus... Crazy business impact. right so like it feels like it's unnecessary but like i i told you like some examples so like it has like obviously crazy P&L impact, but it has impact on like the whole economy. So we are talking about like how data centers are built, how aircrafts are built, how cars are built, how drones are built. So it's, extremely important, that you have a fixed procurement process, not only to like, make it happen and build something. But then also when you talk about, when you look at the competitive landscape, so to get 1% margin increase, you need to make 10% more revenue, 10% more sales. So if you just manage to get 1% savings, it's equals 10% of sales that you have to do to get the same outcome in your P&L. So it's tremendously important. And you combine all of those three things a trillion dollar business opportunity. That's my opinion. For procurement, but there are probably also other things that are emotional, boring, and have a crazy business impact. Well, Vlad, thank you so much for joining us. This was a ton of fun. Spotify. Follow us on X and A16Z and subscribe to our Substack at a16z.substack.com. Thanks again for listening, and I'll see you in the next episode. As a reminder, the content here is for informational purposes only, should not be taken as legal business, tax, or investment advice, or be used to evaluate any investment or security, and is not directed at any investors or potential investors in any A16Z fund. Please note that A16Z and its affiliates may also maintain investments For more details, including a link to our investments, please see a16z.com forward slash disclosures. Bye. you