Aaron Levie on Why Open AI Wins

Aaron Levie on Why Open AI Wins — Theo Jaffee, Sofia Puccini, Aaron Levie

Theo Jaffee, Sofia Puccini, Aaron Levie

AI-assisted summary of Aaron Levie on Why Open AI Wins — original source. Check the original for full context.

Source published:

Key ideas

  • Box CEO Aaron Levie argues that open-weight AI models expand total enterprise adoption without cannibalizing frontier labs, while calling for high-net-worth philanthropists to endow a $10 billion domestic non-profit open-weight lab. (0:00)
  • Levie warns that heavy-handed U.S. export controls and protectionism will fail to slow Chinese AI progress, instead incentivizing the creation of an independent foreign hardware and software stack that permanently displaces Western platforms. (6:38)
  • Enterprise software economics are shifting toward dynamic model routing, as companies avoid single-vendor lock-in and capture outsized value at the workflow, security, and context layer. (26:15)
  • Rather than eliminating engineering jobs, AI tooling at Box has dramatically expanded software roadmaps by reducing multi-year initiatives and unlocking previously neglected backlog items. (22:30)

Detailed notes

## Background Published on September 5, 2026, on the MTS podcast by hosts Theo Jaffee and Sofia Puccini, this episode features Box co-founder and CEO Aaron Levie making the strategic case for open-weight artificial intelligence. According to the show notes, the discussion explores the economics of open versus closed models, geopolitical AI competition with China, the evolution of software engineering, and why the enterprise routing layer will capture lasting value.

## TL;DR Box CEO Aaron Levie argues that open-weight AI models do not cannibalize closed frontier labs, but instead drive broad market diffusion, accelerate proprietary innovation cycles, and settle margins sustainably around compute infrastructure. Levie pushes back against national security hawkishness that seeks to isolate Chinese models, warning that export bans will only catalyze independent foreign silicon ecosystems while burdening American developers with artificially expensive proprietary APIs. He also refutes the idea that AI will eliminate software engineers, explaining that productivity gains actually expand product ambition and unlock previously shelved backlogs. Finally, Levie predicts that vendor lock-in will fail in the enterprise, ensuring that durable value accrues to the applied routing layer that bridges enterprise data, permissions, and evolving models.

## Atmosphere & style The conversation moves at an energetic, high-bandwidth clip, blending insider Silicon Valley humor with rigorous strategic and economic analysis. Levie, Jaffee, and Puccini share an easy, self-aware rapport, effortlessly weaving between tongue-in-cheek commentary on astrology image generators and serious critiques of regulatory guardrails and national security policy. It feels like an authentic, behind-the-scenes strategy whiteboard session—candid, pragmatically grounded in enterprise customer realities, and unapologetically dismissive of corporate protectionism.

## Bulletin - `00:00` Box CEO Aaron Levie argues that open-weight AI models expand total enterprise adoption without cannibalizing frontier labs, while calling for high-net-worth philanthropists to endow a $10 billion domestic non-profit open-weight lab. - `06:38` Levie warns that heavy-handed U.S. export controls and protectionism will fail to slow Chinese AI progress, instead incentivizing the creation of an independent foreign hardware and software stack that permanently displaces Western platforms. - `26:15` Enterprise software economics are shifting toward dynamic model routing, as companies avoid single-vendor lock-in and capture outsized value at the workflow, security, and context layer. - `22:30` Rather than eliminating engineering jobs, AI tooling at Box has dramatically expanded software roadmaps by reducing multi-year initiatives and unlocking previously neglected backlog items.

## Key takeaways - `00:00` Open-weight models foster broader AI adoption by enabling deep customization and specialized workloads, which in turn accelerates proprietary frontier lab innovation. - `03:36` Model distillation does not cross ethical or legal boundaries, especially given that frontier labs train on public web data and directly collect API revenue from distillation workloads. - `03:36` Synthetic code and reasoning outputs proliferate across public repositories, making the strict policing of downstream model distillation practically impossible. - `06:38` Restricting access to international open models risks saddling the U.S. with artificially high compute costs while competitors leverage free, hyper-efficient open architectures. - `06:38` Export controls will not halt Chinese AI advancements due to China's deep computer science talent pool, state-backed industrial base, and massive capacity for data curation. - `10:00` The primary economic driver of enterprise AI is compute rather than model secrecy, as inference costs dictate where revenue ultimately settles. - `10:00` Frontier labs will see model gross margins naturally compress to a sustainable 20% to 40% over bare compute due to intense multi-lab competition. - `10:00` U.S. frontier labs should consider open-sourcing prior-generation (n-1) models to preserve developer mindshare while monetizing the resulting cloud infrastructure workloads. - `15:00` Anthropic avoids open weights primarily due to short-term API monetization advantages and a founding ideology centered on centralized oversight and guardrail enforcement. - `15:00` Claude 3.5 Opus delivers strong price-to-performance gains for unstructured document analysis across regulated enterprise sectors like finance, law, and life sciences. - `20:00` Premature, aggressive safety guardrails and silent model downgrades risk rendering frontier models unusable for complex enterprise tasks like permissions auditing. - `22:30` AI expands the scope of engineering ambition: companies claiming AI eliminates the need for software engineers likely lack ambitious product roadmaps. - `25:00` Autonomous coding agents frequently overestimate task timelines because their pre-AI training data reflects cautious human engineer communication habits. - `26:15` The applied AI routing layer captures durable value by connecting enterprise permissions, context, and operational workflows across interchangeable foundation models.

## Detailed walkthrough ### `00:00` Introduction and the Jensen Huang Open-Weights Letter

MTS hosts Theo Jaffee and Sofia Puccini introduce Box co-founder and CEO Aaron Levie, highlighting Box's footprint across cloud content management, enterprise documents, security permissions, collaboration, and enterprise AI integrations, as well as Levie's prolific presence on X (formerly Twitter) under the handle `@levie`. Before diving into heavy policy, the hosts open with a tongue-in-cheek detour into breaking industry gossip regarding a supposed massive acquisition in the "astrology image gen space." When Puccini asks if astrology will embrace open-source architecture, Levie deadpans that astrology might remain closed source for the time being, prompting Jaffee to joke that the ecosystem will need to organize against proprietary horoscopes.

Turning to serious matters, Puccini brings up an open letter advocating for open-weight AI models, organized by NVIDIA CEO Jensen Huang and signed by enterprise tech leaders, including Box. Levie treats the letter as an industry Rorschach test, noting that signatories and observers project their own worldviews onto its contents, but explains that Box signed it based on two core arguments. First, open-weight models do not cannibalize closed frontier labs in a zero-sum contest; instead, they dramatically broaden the aperture of AI adoption by letting developers, startups, and enterprises customize, fine-tune, and build specialized workloads on top of foundational architectures. That expansion of total use cases ultimately pushes proprietary frontier labs to accelerate their own innovation cycles. Second, Levie interprets the statement as an urgent domestic call to arms: rather than merely panicking over rapid advances in Chinese open models or treating model distillation as an illicit shortcut, the United States must actively fund and build its own world-class open-weight ecosystem.

Levie readily concedes that the safety lobby raises genuine arguments regarding catastrophic capability overhangs in future iterations of frontier models. However, he maintains that stifling open weights out of precautionary fears will simply starve the broader software economy of vital infrastructure. Defending the letter's pro-diffusion thesis, Aaron Levie argues: “I almost unequivocally take the stance that more open innovation and open weights innovation is good for AI broadly and the diffusion of AI.”

```mermaid flowchart TD accTitle: Open Weights Flywheel accDescr: Diagram illustrating how open-weight AI drives adoption and pushes closed frontier labs to innovate faster.

subgraph OpenEcosystem["Open-Weights Ecosystem"] A["Open-Weight Foundations"] --> B["Developer Customization & Fine-Tuning"] B --> C["Expanded Commercial & Enterprise Use Cases"] end

subgraph MarketPressure["Market Feedback Loop"] C --> D["Broad AI Market Diffusion"] D --> E["Competitive Pressure on Frontier Labs"] E --> F["Proprietary Labs Innovate Faster"] end ```

---

`03:36` The Distillation Dilemma and the Case for an American Open Lab

The hosts push Levie on model distillation, asking where he draws the line between legitimate synthetic data optimization and improper intellectual property infringement. Levie rejects the premise that distillation crosses an inherent ethical or legal line. He points out the logical inconsistency of proprietary labs scraping the public internet without individual creators opting in, while simultaneously asserting that no subsequent model can train on their model's public or commercial outputs. While Levie sympathizes with closed-lab executives who try to enforce restrictive terms of service to defend their competitive moats, he stresses that attempting to treat output-based training as a civil or criminal violation undermines the foundational logic of machine learning.

Levie and Jaffee also highlight an ironic economic reality: frontier providers like Anthropic and OpenAI are actively monetizing distillation. Developers pay substantial API usage fees while extracting synthetic datasets, generating more direct revenue for the frontier lab than the original human creators ever received during pre-training. Furthermore, Levie offers a thought experiment regarding synthetic data diffusion: if developers query models like GPT-4 or Claude via API to write thousands of software projects, and those codebases are then pushed to public GitHub repositories, downstream models inevitably ingest that distilled data during standard web scrapes.

Looking at the broader competitive landscape, Levie dismisses the narrative that foreign rivals advance solely through illicit distillation. He emphasizes that labs in China are achieving genuine algorithmic breakthroughs independent of Western outputs. Rather than obsessing over intellectual property fencing, Levie urges American philanthropists and tech titans to fund native open-source research at scale. Levie outlines his ideal vision for domestic innovation: “The best case scenario personally would be you get a few people that are at a stage in life where they can just be like, yep, I'm going to drop $10 billion on building an open lab in America.” Jaffee and Puccini joke about tagging the Bill & Melinda Gates Foundation to underwrite the initiative, while Levie insists that an American equivalent of Moonshot AI or DeepSeek is overdue.

- Proprietary AI labs collect substantial API revenue from the very distillation workloads they publicly decry. - Organic data pollution makes policing distillation nearly impossible once synthetic text, reasoning traces, and code proliferate across public internet repositories. - Levie calls for high-net-worth American philanthropists or consortiums to endow a $10 billion non-profit open-weight research lab to counter foreign dominance.

---

`06:38` The China Threat, the Dwarkesh Debate, and Hardware Lockout

The discussion moves to the geopolitical fallout of China dominating the open-weight landscape. Jaffee outlines the standard national security hawkish critique: if American developers become addicted to Chinese open models like DeepSeek or Moonshot, Beijing could eventually pull access, dictate software norms, or undercut American enterprise software margins. Levie counters that trying to cut off international open models is as economically self-defeating as arguing an iPhone should cost $5,000 to manufacture domestically rather than leveraging mature Asian supply chains. Forcing the United States onto artificially expensive proprietary APIs while the rest of the world builds on free, hyper-efficient open weights would guarantee an American competitive disadvantage over the next decade.

Levie references the polarizing debate between Jensen Huang and Dwarkesh Patel on the *Dwarkesh Podcast*, which served as another industry flashpoint. While some tech commentators believed Patel was right to cross-examine Huang on national security risks, Levie sides firmly with Huang's analysis of technological inevitability. Levie argues that geopolitical export bans will never convince China to abandon AI, given the technology's strategic primacy. China possesses an immense base of domestic engineering talent, massive state-backed industrial fabrication capacity, and the organizational muscle to mobilize hundreds of thousands of people for synthetic data curation and reinforcement learning annotation.

Levie warns that heavy-handed U.S. export controls and protectionist postures will trigger a dangerous unintended consequence: rather than slowing Chinese AI, restrictions simply catalyze the creation of an entirely independent hardware and software stack. If foreign labs are locked out of NVIDIA's ecosystem, they will design and scale competing domestic accelerators, deploy them across sovereign clouds throughout the developing world, and permanently displace Western technology platforms. Reaffirming his agreement with the NVIDIA CEO's geopolitical calculus, Aaron Levie states: “I was watching it and just was like, yeah, Jensen's obviously right. You might not like the conclusion, you might disagree with it, but he's obviously right that the following will happen. If you block off China, China is not going to give up on AI.”

- Restricting domestic access to foreign open models risks leaving the U.S. with artificially high compute costs while global competitors build on dirt-cheap, highly capable open weights. - China's combination of elite computer science talent, deep industrial manufacturing, and massive labor pools for manual data generation ensures it will remain a frontier player regardless of chip bans. - Western hardware embargoes risk accelerating the global adoption of alternative silicon stacks across non-aligned sovereign cloud infrastructures.

`10:00` Geopolitics, Jensen Huang, and the True Economics of Open Weights

Aaron Levie pushes back against the belief that Western labs can simply stonewall China to maintain an insurmountable lead. In his view, assuming that strict isolation will permanently preserve American primacy rests on shaky logic: “So I think it's, I just don't think there's a scenario here where you can kind of close off completely to China and somehow you dramatically slow them down.” With rapid advancements such as Kimi k1.5 and similar releases, the technical gap between the US and China is visibly narrowing rather than expanding. The hosts briefly detour into Dwarkesh Patel’s recent interview with Jensen Huang, calling it “generational,” “absolute cinema,” and “tech reality TV,” specifically laughing over Jensen’s visceral rejection of defeatism: “I'm not a loser. You're not talking to someone who woke up a loser.”

```mermaid flowchart TD accTitle: Value Capture in Open versus Closed AI Architectures accDescr: Diagram illustrating how competition drives margins down to infrastructure and how labs monetize open weights.

subgraph Competition ["Market Realities"] A["3–5 Leading US Frontier Labs"] --> B["Token Prices Converge Toward Compute Costs"] B --> C["Inference Margins Settle at 20% to 40%"] end

subgraph Monetization ["Monetizing Open-Weight Ecosystems"] C --> D["Provide Preferred Cloud Infrastructure"] C --> E["Post-Training & Fine-Tuning Environments"] C --> F["Trusted Enterprise Brand & Safe Deployment"] end

subgraph UltimateSpend ["Capital Flow"] D & E & F --> G["Revenue Accrues to High-End GPU Clusters"] end ```

When asked what trade-offs the US faces by openly releasing capable frontier-level weights, Levie explains that the primary driver of enterprise software value is compute, not model secrecy. Even if an architecture is open-sourced, the money ultimately flows directly to the infrastructure stack because inference costs dominate. Levie rejects the zero-margin thesis, estimating that competition among three to five major US labs will naturally compress model gross margins from sky-high software levels (70%–90%) down to a sustainable 20% to 40% over bare compute. Under those economics, hosting open models captures nearly the same bottom-line value as running closed proprietary APIs.

- **Market lead assumptions:** Theoretical arguments for shutting down open weights depend on the flawed premise that Western labs enjoy an unbridgeable, accelerating technical moat over Chinese competitors. - **Inference as the profit center:** Real money in artificial intelligence accrues to inference compute; running open models still demands vast GPU infrastructure that laptops and local edge devices cannot replace. - **Fast-following with open weights:** Levie argues frontier labs like OpenAI should systematically open-source their prior-generation models (n-1), keeping developer mindshare within their model families while monetizing the resulting infrastructure workloads.

`15:00` Why Frontier Labs Stay Closed and Claude Opus 3.5 Benchmarks at Box

Addressing why dominant providers like Anthropic and Google avoid open-sourcing previous flagship architectures, Levie identifies two key friction points: temporal incentives and safety ideology. Financially, maintaining an exclusive closed API generates superior cash flows in the short run: “Because tomorrow, if I release a closed model, I just will literally make more money if I just keep it closed and I force everything to route through my API.” Over a multi-year horizon, however, commodity pressures level out those structural advantages. Culturally, organizations like Anthropic view open weights as an unacceptable safety hazard; they believe a single centralized entity must oversee token streams to intercept prompt injections, monitor queries, and guarantee guardrails.

```mermaid flowchart LR accTitle: Enterprise Knowledge Work Dual Evaluation Axes accDescr: Visual mapping showing the two core capability axes required for enterprise AI models.

subgraph Axis1 ["Horizontal Intelligence"] H["General Reasoning & Large Context Synthesis"] end

subgraph Axis2 ["Vertical Expertise"] V1["Life Sciences & Bio Research"] V2["Legal Precedent & Contract Logic"] V3["Institutional Banking & Finance"] end

H & V1 & V2 & V3 --> Eval["Enterprise Benchmark Performance"] ```

The discussion transitions directly to real-world performance evaluations with the release of Claude 3.5 Opus. Drawing on Box’s production workloads handling unstructured documents for law firms, life sciences companies, and major financial institutions, Levie notes that enterprise adoption requires simultaneous gains across two distinct vectors: broad general reasoning and intense domain-specific comprehension. Box’s internal benchmarks demonstrate that Claude 3.5 Opus delivers massive generational leaps over prior models, particularly in synthesis and industry accuracy.

- **Anthropic's safety stance:** Anthropic’s refusal to open-weight models is rooted in core founding philosophy—open weights eliminate the central oversight needed to filter dangerous queries and manage token-level security. - **Enterprise evaluation vectors:** Box tests frontier releases against complex corporate workloads that combine high-level general intelligence with rigorous vertical knowledge in regulatory, medical, and legal contexts. - **Claude 3.5 Opus vs. competing flagships:** While models like OpenAI's GPT-4o (or internal variants referred to as "Fable") may edge out slight wins on raw qualitative vibes, Opus represents a Pareto-superior choice for enterprise knowledge work due to its massive price-to-performance advantage at roughly half the running cost.

`20:00` Anthropic’s Guardrails, Downgrades, and the Perils of Premature AI Regulation

Discussing recent frontier model evaluations, Aaron Levie reflects on internal tests comparing cutting-edge models. He notes that in their benchmark testing, Fable demonstrated superior capability over version 4.8 on difficult technical problems, delivering a level of performance that could not be offset simply by token cost advantages. When asked whether the comparison was against 4.8 or an upcoming Opus 5, Aaron explains that prior to having access to version 5, he lacked enough internal coding evaluations to measure that specific gap, particularly because many newly released benchmarks focus on general knowledge work and agentic tool use rather than pure coding.

The conversation turns to a frustrating friction point users have encountered with Fable: the tendency for the system to quietly downgrade queries to a lower-tier model like 4.8 when safety or security filters trigger. Aaron observes that developers frequently encounter this when analyzing permissions or access control code, which alarms the safety guardrails and strips away the model's raw problem-solving capability. While Aaron commends Anthropic for attempting to structure a constructive dialogue with policymakers through a multi-point risk framework, he voices deep skepticism about who determines those risk thresholds and whether the identified risks reflect reality. Aaron warns that aggressive, early throttling could choke adoption: “People will simply not use AI if this is the kind of ongoing environment.” Because of the nuance involved, he argues it is far too early to lock models down with restrictive regulations.

- Internal Box testing showed Fable significantly outperforming 4.8 on complex technical problems beyond what token economics could balance. - Automated safety triggers frequently downgrade high-capability prompts to 4.8 during access control or permission audits, depriving engineers of top-tier model intelligence. - Aaron supports risk assessment frameworks in principle but questions who defines the criteria, maintaining that premature guardrails threaten to make frontier AI unusable.

`22:30` Expanding Software Engineering Ambition and Unlocking the Backlog

When asked how advanced AI models are altering the practice of software engineering and hiring expectations at Box, Aaron rejects the notion that software engineers are becoming obsolete. Instead, he explains that AI fundamentally alters the economics and psychology of product planning. Before AI, development roadmaps were restricted to a narrow middle band: teams routinely rejected tiny tasks because spending a week on a minor issue was not worth the developer hours, while simultaneously shelving massive, multi-year initiatives because they were deemed too risky or difficult to execute.

AI collapses both ends of that spectrum. Multi-year undertakings shrink into manageable short-term efforts, while low-priority backlog bugs that previously took a week can now be knocked out in two hours. Aaron shares that Box currently has multiple dozens of active development projects that never would have received the green light in a pre-AI world. Rather than cutting technical staff, Box is actively trying to hire more software talent, constrained primarily by overall business budgeting across departments rather than a shortage of work. Challenging tech leaders who use AI as a rationale for developer layoffs, Aaron asserts: “I generally think if you think that you've kind of eliminated the need for software engineers, there's just no chance you're being ambitious enough with your product roadmap.”

```mermaid flowchart TD accTitle: Impact of AI on Software Roadmap Economics accDescr: Diagram contrasting pre-AI roadmap constraints with post-AI software scope expansion.

subgraph PRE["Pre-AI Software Planning Constraints"] direction TB A1["Tiny Fixes (~1 week)\n'Not worth developer time' -> Ignored"] A2["Middle Band Projects\nStandard, moderate feature roadmap"] A3["Multi-Year Initiatives\n'Too complex and costly' -> Rejected"] end

subgraph POST["Post-AI Roadmap Expansion"] direction TB B1["Backlog Clearance\nTiny fixes solved in ~2 hours"] B2["Expanded Core\nFaster delivery of customer value"] B3["Moonshots Unlocked\nMulti-year complexity drastically compressed"] end

A1 -.->|"Accelerated by AI"| B1 A2 -->|"Augmented capacity"| B2 A3 -.->|"Compressed by AI"| B3 ```

- Pre-AI roadmap planning stranded teams in a narrow middle band, ignoring both week-long backlog tickets and ambitious multi-year projects. - Box has dozens of active projects underway that would have been rejected as technically unfeasible or economically unjustifiable without AI. - Engineer productivity gains translate into resolving more customer problems faster, heightening demand for engineering talent rather than eliminating it.

`25:00` The Humor of AI Overestimation and Slack-Trained Timelines

The hosts and Aaron share a laugh over the quirky pacing and conservative estimates built into autonomous coding agents. Theo and Sofia note that when prompted with a task, agents often wildly overestimate the required effort, warning the user that a feature will take an entire weekend or even a month, only for the human developer to wrap it up in three hours. Aaron quips that this behavior is an inevitable consequence of the training data: “That's because it was trained on all of our Slack messages pre-AI.” He jokes that the models merely learned to mimic the classic software engineer defense mechanism of declaring every request a two-year project.

The hosts observe a similar disconnect in mathematical reasoning. When asked when an AI system might successfully disprove an open conjecture in mathematics, models typically generate conservative five-year projections—completely oblivious to the fact that AI models have already begun solving and disproving open mathematical problems in the real world.

- Coding agents regularly overestimate implementation timeframes by orders of magnitude, predicting weeks of work for three-hour jobs. - Aaron jokes that cautious timelines stem from pre-AI internal communications where human engineers reflexively inflated project estimates. - AI models display similar lagging conservatism in forecasting mathematical breakthroughs that have already occurred.

`26:15` The Rise of Model Routing and Value in the Applied AI Layer

Turning to enterprise architecture, the hosts discuss whether enterprises can remain loyal to any single frontier lab when model releases and benchmark leapfrogging occur at a breakneck pace. Aaron agrees that vendor lock-in is unviable and argues that the market is inevitably moving toward intelligent model routing. While acknowledging his inherent bias as the leader of Box—a platform operating directly in the applied AI tier—Aaron highlights that companies like Box, Cognition, Factory, Cursor, and Replit thrive in an ecosystem where diverse models excel across different axes. In this paradigm, super-frontier models handle high-order orchestration while cheap, cost-tuned workhorses process repetitive sub-tasks.

```mermaid flowchart TD accTitle: Enterprise Model Routing Architecture accDescr: How the applied enterprise layer routes between diverse foundation models based on task, cost, and workflow context.

subgraph APP["Applied AI & Orchestration Layer (Box, Cursor, Replit)"] direction TB Context["Enterprise Context: Data, Permissions & Workflows"] Router{"Intelligent Model Router"} Context --> Router end

subgraph MODELS["Underlying Foundation Models"] direction LR M1["Frontier Orchestrators\n(e.g., Fable, Opus 5)"] M2["Workhorse / Cost-Tuned\n(e.g., 4.8, GPT-5.6)"] M3["Specialized / Open Models\n(e.g., Grok 4.5, Llama)"] end

Router -->|"Complex Reasoning"| M1 Router -->|"High Volume / Low Cost"| M2 Router -->|"Specific Domain Tasks"| M3 ```

Aaron points out that with major U.S. competitors such as Google, OpenAI, xAI, and others engaged in a continuous warpath to reduce inference costs while pushing the frontier, enterprises face acute decision paralysis. The applied routing layer resolves this dilemma by abstracting the underlying models: organizations can configure their data pipelines, security controls, and operational workflows once, seamlessly toggling between Fable, GPT-5.6, or Grok 4.5 as capabilities evolve. Aaron argues that horizontal foundation labs will struggle to capture deep vertical workflows in regulated industries like legal, healthcare, and finance because raw models lack the necessary surrounding apparatus: “It needs to get access to the right data. It needs to be implemented into the workflow in the right way. And that's why I think you're going to have just a tremendous amount of value creation at that layer of the stack.”

- Enterprise AI architecture is shifting to dynamic routing across multiple providers to optimize for both raw intelligence and cost efficiency. - Applied platforms insulate customers from model churn, allowing organizations to adopt next-generation models without refactoring workflows. - Domain-specific value accrues to the application layer because foundation models require deep contextual data, access controls, and workflow integration that horizontal labs cannot provide out of the box.

`29:30` Rapid News Cycles and Outro

Wrapping up the interview, the hosts and Aaron reflect on the dizzying speed of the AI news cycle over the preceding week. The hosts marvel at how quickly major developments are displaced by new headlines, noting that OpenAI's reported security breach involving Hugging Face had occurred just four days prior, despite feeling like a distant event from a month ago. With new releases from Opus to open-source breakthroughs dropping continuously, the hosts thank Aaron for joining the discussion before transitioning to the network outro and standard financial disclosures.

- The hosts emphasize the unprecedented tempo of AI news, where monumental events like security breaches and frontier model launches fade from memory within days. - The episode concludes with distribution notes across YouTube, Apple Podcasts, Spotify, X, and Substack, followed by standard a16z legal and advertising disclaimers.

## Notable quotes > `22:30` I generally think if you think that you've kind of eliminated the need for software engineers, there's just no chance you're being ambitious enough with your product roadmap. — Aaron Levie

> `00:00` I almost unequivocally take the stance that more open innovation and open weights innovation is good for AI broadly and the diffusion of AI. — Aaron Levie

> `10:00` I just don't think there's a scenario here where you can kind of close off completely to China and somehow you dramatically slow them down. — Aaron Levie

## Mentioned Aaron Levie, Theo Jaffee, Sofia Puccini, Box, Jensen Huang, NVIDIA, Anthropic, OpenAI, Google, DeepSeek, Moonshot AI, Dwarkesh Patel, The Dwarkesh Podcast, Bill & Melinda Gates Foundation, Claude 3.5 Opus, GPT-4, GPT-4o, Fable, Kimi k1.5, Grok 4.5, GPT-5.6, Llama, Cognition, Factory, Cursor, Replit, Hugging Face, xAI

## Video description Box co-founder and CEO Aaron Levie joins MTS hosts Theo Jaffee and Sofia Puccini to make the case for open-weight AI, unpack the economics of open versus closed models, and explain why he believes more openness could strengthen rather than undermine the U.S. AI ecosystem. Aaron argues that open models create more use cases, push closed labs to innovate faster, and don't fundamentally change where the economics of AI ultimately accrue. They debate model distillation, America's competition with China, why restricting access may simply accelerate competing AI ecosystems, and whether U.S. labs should begin releasing open-weight versions of previous-generation models. They also get into what the latest frontier models mean for knowledge work, how AI has changed software engineering at Box, and why Aaron believes companies cutting engineers may simply not be ambitious enough. Finally, they discuss why enterprises are unlikely to bet on a single model and why the layer that routes between models, data, and workflows could become increasingly valuable.

[Source](https://mgln.ai/e/1344/afp-848985-injected.calisto.simplecastaudio.com/3f86df7b-51c6-4101-88a2-550dba782de8/episodes/fa4d1de0-221c-4305-9b44-d8ee5ef2a0db/audio/128/default.mp3?aid=rss_feed&awCollectionId=3f86df7b-51c6-4101-88a2-550dba782de8&awEpisodeId=fa4d1de0-221c-4305-9b44-d8ee5ef2a0db&feed=JGE3yC0V)

中文简报

Box首席执行官Aaron Levie论开放式AI为何胜出 Box首席执行官Aaron Levie认为,开放权重AI模型并不会蚕食闭源的前沿实验室,而是推动了广泛的市场扩散,加速了专有创新周期,并将利润率可持续地稳定在计算基础设施周围。Levie对试图孤立中国模型的国家安全鹰派观点进行了反驳,警告称出口禁令只会催化独立的海外芯片生态系统,同时让美国开发者承受人为抬高的昂贵专有API负担。他还驳斥了AI将消灭软件工程师的观点,解释称生产力的提升实际上扩大了产品雄心,并盘活了此前搁置的待办需求。最后,Levie预测供应商锁定在企业端将会失效,从而确保持久的价值沉淀在连接企业数据、权限以及不断演进的模型之间的应用路由层。 Box首席执行官Aaron Levie认为,开放权重AI模型在不蚕食前沿实验室的情况下扩大了整体企业采用率,同时呼吁高净值慈善家为本土非营利性开放权重实验室资助100亿美元。 (0:00) Levie警告称,严厉的美国出口管制和保护主义无法减缓中国AI的发展步伐,反而会促使海外建立独立的软硬件技术栈,从而永久取代西方平台。 (6:38) 企业软件经济正转向动态模型路由,因为各公司都在避免被单一供应商锁定,并在工作流、安全和上下文层获取巨额价值。 (26:15) AI工具并未消灭工程岗位,反而通过缩短多年期项目周期并盘活先前被忽视的待办事项,极大地扩展了Box的软件路线图。 (22:30)

Reading summary

Box CEO Aaron Levie argues that open-weight artificial intelligence accelerates broader software diffusion without undermining proprietary frontier labs, while warning that nationalistic restrictions will fail to stop foreign competition. Open Weights Expand Diffusion Without Squeezing Compute (0:00) Levie explains that Box endorsed Jensen Huang's open letter because open-weight models widen the aperture of AI adoption, allowing developers to customize workloads without cannibalizing closed frontier providers. In his view, market competition among three to five major US labs will compress software-like gross margins from 70%–90% down to 20% to 40% over bare compute. Because running open weights still demands vast infrastructure clusters, value naturally accrues to inference compute rather than model secrecy alone. Levie suggests that frontier labs should systematically release prior-generation (n-1) models to preserve developer mindshare and monetize underlying cloud infrastructure. Although proprietary labs such as Anthropic avoid open-sourcing architectures due to short-term API monetization and safety philosophies requiring centralized token monitoring, Levie contends that stifling open models out of precautionary fear risks starving the broader software economy of foundational infrastructure. Geopolitics, Export Bans, and Model Distillation Realities (3:36) Levie rejects the notion that the United States can preserve a permanent AI lead by stonewalling China through export controls, agreeing with Jensen Huang's perspective that foreign competitors will not abandon the technology. He argues that cutting off foreign open models risks saddling American firms with expensive proprietary APIs while international competitors build on low-cost open architectures. Furthermore, Levie warns that aggressive hardware embargoes inadvertently accelerate the creation of rival silicon stacks and sovereign clouds outside Western ecosystems. Addressing model distillation, Levie dismisses claims that downstream fine-tuning is inherently illicit, highlighting that frontier providers actively collect substantial API revenue from the very distillation workloads they decry. Given that synthetic data spreads organically through public code repositories and standard web scrapes, Levie believes policing distillation is impractical. Rather than relying on defensive legal fencing, he calls on American philanthropists to endow a $10 billion domestic non-profit open-weight research lab to counter foreign advances. Safety Downgrades and the Fallacy of Engineer Obsolescence (20:00) While Levie acknowledges the intent behind structured safety frameworks, he expresses concern over automated guardrails that silently downgrade high-tier models to lower-capability versions during technical access control or permissions audits. He warns that overly aggressive, premature regulatory throttling risks making frontier AI unusable for real enterprise tasks. Levie also disputes claims that generative AI will make software engineers obsolete, arguing instead that productivity gains alter the economics of product roadmaps. AI collapses planning extremes, compressing multi-year initiatives into manageable projects and reducing week-long backlog tickets to a couple of hours. Rather than downsizing developer teams, Box is actively hiring engineering talent to tackle dozens of active projects that were previously deemed too costly or complex to justify. Model Routing and Value Accrual at the Application Layer (26:15) As frontier labs engage in rapid capability leapfrogging and price reductions, Levie argues that enterprise vendor lock-in is unviable. Instead, enterprise architecture is shifting toward dynamic model routing, where applied platforms seamlessly dispatch complex orchestration to top-tier models and high-volume sub-tasks to cost-efficient workhorses. Levie maintains that sustainable enterprise value will concentrate in the applied application layer—occupied by tools like Box, Cursor, and Replit—rather than in raw horizontal models. Because generalist frontier labs lack built-in context, deep permission models, and native workflow integrations required by heavily regulated fields like legal, healthcare, and finance, specialized application platforms insulate organizations from model churn while capturing essential domain context. Levie concludes that open models and application-layer routing will drive the next wave of enterprise productivity, but unresolved tensions remain around how frontier safety frameworks will balance security guardrails against functional model performance.

精炼阅读摘要

Box 联合创始人兼首席执行官 Aaron Levie 认为,开放权重模型非但不会损害前沿封闭实验室,反而会扩大软件生态的采用广度,倒逼专有实验室加速创新;同时,企业级 AI 的长期商业价值将主要沉淀在基础设施算力与应用路由层,而非单纯的模型权重封锁。 开放权重的生态扩散与蒸馏争议 (0:00) Aaron Levie 针对英伟达首席执行官黄仁勋牵头的开放权重公开信进行了解读。Box 签署该信的核心逻辑在于,开放权重模型通过允许开发者与企业自定义、微调和构建专用工作负载,大幅拓宽了 AI 落地场景,从而对封闭实验室形成反向推动,而非零和博弈。Levie 承认安全阵营对模型前沿能力失控的担忧有其道理,但强调若因预防性恐惧扼杀开源,将导致整个软件经济缺乏必要的基础设施。针对模型蒸馏的知识产权争议,Levie 指出封闭实验室一方面抓取公开网络数据进行预训练,另一方面却试图禁止下游基于其输出进行训练,在逻辑上存在内在矛盾。此外,Anthropic 和 OpenAI 等前沿厂商实际上通过 API 调用向提取合成数据的开发者收取了可观费用,且合成数据流入 GitHub 等公开代码库后,后续模型在网页抓取中已无法避免地受到蒸馏数据的自然扩散。他呼吁美国慈善家或机构出资 100 亿美元设立本土非营利开源实验室,正面应对国际竞争。 地缘芯片限制的负面效应与算力经济学 (6:38) 在探讨中国开源模型(如 DeepSeek、Moonshot 和 Kimi k1.5)带来的竞争格局时,Levie 反驳了对海外开源生态实施封锁的鹰派观点。他认为,迫使美国企业依赖昂贵的专有 API,而全球其他地区依托高效便宜的开源模型构建,将在未来十年让美国处于竞争劣势。Levie 赞同黄仁勋在接受 Dwarkesh Patel 采访时的判断,指出出口管制绝不会迫使拥有庞大工程人才、制造实力和数据标注能力的国家放弃 AI;相反,强硬的硬件封锁只会倒逼对方建立独立的芯片与软件技术栈,甚至在全球主权云中替代西方平台。从经济学角度看,Levie 认为随着 3 至 5 家主要实验室的竞争,模型推理毛利率将从极高的软件水平(70% 至 90%)压缩至超出纯算力成本 20% 至 40% 的区间,商业价值的本质是算力消耗而非模型秘密。前沿实验室理应将上一代架构(n-1)开源,以争夺开发者心智并直接货币化底层的 GPU 集群托管需求。 封闭壁垒成因与企业级评估的现实约束 (15:00) 解释 Anthropic 和 Google 等厂商为何坚持封闭策略时,Levie 归结为短期商业变现动机与安全意识形态。在短期内,维持封闭 API 垄断能创造最佳现金流,而 Anthropic 等机构深层信念认为必须由中心化实体全程监控 Token 流以拦截提示词注入。基于 Box 在法律合同、生命科学与金融机构的大量非结构化文档处理实践,企业采购模型需要同时兼顾通用推理(水平能力)与特定领域合规理解(垂直深度)。Box 内部基准显示 Claude 3.5 Opus 在企业知识工作和价格表现上实现显著跨越。然而,安全机制的过度干预引发了实际落地问题:当系统触发安全过滤器时,高阶模型(如测试中的 Fable)会静默降级为较低阶的 4.8 版本,导致工程师在审查权限与访问控制代码时被剥夺顶尖问题求解能力。Levie 警示,过度激进且标准不明的早期监管及防护壁垒,可能直接导致企业用户放弃采用 AI。 软件工程扩容与应用路由层价值沉淀 (22:30) 面对 AI 替代程序员的论调,Levie 明确表示反对,强调若企业认为 AI 能消灭研发岗位,说明其产品路线图缺乏足够雄心。在引入 AI 之前,研发规划受限于狭窄的中间带:耗时一周的琐碎缺陷因投入产出比低而被搁置,耗时数年的庞大项目则因风险过高被否决;AI 的介入使得 Box 能在两小时内清理长期积压的微小任务,同时压缩复杂大项目的执行周期,目前该公司有数十个以往根本无法立项的项目正在推进,研发瓶颈完全取决于整体预算而非缺乏工作需求。此外,由于前沿模型迭代极快且能力各有侧重,单一厂商锁定已不可行。Levie 指出,未来的企业架构必然走向智能模型路由:企业无需重构业务流,即可由应用层将复杂的顶层编排分配给尖端前沿模型,而将大批量子任务交由低成本或开源模型处理。因底层通用模型缺乏特定行业的权限控制、上下文数据与业务流程集成,绝大部分企业级价值创造将牢固沉淀在应用编排层。 Levie 的论证核心在于技术扩散不可逆转,试图依靠封闭权重或地缘出口壁垒维持领先在经济与工程层面皆不成立;然而,随着模型更替节奏不断加快,如何在安全防范降级与实用效能之间权衡,以及应用编排层能否在基础模型厂商逐步纵向渗透的过程中长期守住其高利润与上下文壁垒,仍有待行业实践验证。

Detailed notes — zh

## Background 本期播客于 2026 年 9 月 5 日由 MTS 播客频道(Theo Jaffee 与 Sofia Puccini 主持)发布在 RSS/音频平台。节目邀请到 Box 联合创始人兼 CEO Aaron Levie,围绕他参与签署的开放权重公开信展开,深入探讨开源与闭源 AI 的经济学、模型蒸馏争议、中美竞争格局,以及前沿模型对企业软件工程与应用层路由的深远重构。 ## TL;DR Aaron Levie 旗帜鲜明地主张开源权重模型能够扩展应用场景并反推闭源实验室加速迭代,两者绝非零和博弈;由于 AI 的变现重心在推理基础设施,即使开放旧代模型,企业也能通过基础设施与调优服务获取稳健利润。针对中美 AI 竞争,他指出试图通过单向技术封锁拖慢中国发展是不切实际的保护主义,反而会催生出完全独立于美国的替代生态并削弱美国企业的全球市场。谈及技术落地,Levie 结合内部评测肯定了新一代前沿模型的表现,但批评了过度安全防御导致的模型降级现象;他强调 AI 正在极大拓展开发团队的产品立项边界,借 AI 裁员的公司纯粹是产品野心不足。最终,企业极不可能押注单一基础模型,在多模型竞争且快速迭代的环境下,深度连接企业数据与业务工作流的应用路由层将捕获最持久的商业价值。 ## Atmosphere & style 对谈整体节奏轻快且信息密度极高,既有硅谷核心圈层内行对话的机智幽默,又充斥着对宏观产业格局的犀利透视。Aaron Levie 语速飞快、论据扎实,带有典型科技创业者那种兼具务实商业考量与强烈技术乐观主义的张力;主持人的敏锐追问与穿插调侃,让复杂的模型蒸馏伦理、地缘封锁和推理经济学辩论毫不沉闷。整场节目给人一种置身于行业风暴眼中心的真实体感——伴随着大模型代际迭代的疯狂加速,所有嘉宾都在为剧烈重构的技术秩序感到兴奋与眩晕。 ## Bulletin - `00:00` Box 首席执行官 Aaron Levie 联合黄仁勋等签署支持开放权重 AI 模型的公开信,主张开源创新不会与闭源模型形成零和博弈,反而会扩大整体应用生态并倒逼前沿实验室加快迭代。 - `06:50` Levie 警告称,试图通过全面封锁对华技术连接来保持领先并不现实;切断合作只会迫使中国加速构建独立于美国的软硬件技术闭环,长远看将损害美国的基础设施与生态利益。 - `10:00` AI 商业核心正加速向推理基础设施倾斜,随着三至五家核心玩家的激烈竞争,Token 的毛利率预计将从纯软件的 70%-90% 逐步压缩至基础设施成本之上的 20%-40%。 - `15:00` Box 评测显示 Claude Opus 5 在企业级深度行业理解与长上下文通用推理上均有代际提升,凭借显著的成本优势确立了相比更贵竞品的帕累托最优地位。 - `20:00` Levie 认为借助 AI 裁撤软件工程师的企业是在产品规划上缺乏野心;AI 的普及大幅降低了超大项目与超长尾微小功能的实现门槛,使得团队能够承接远超以往的工作量。 ## Key takeaways - `00:00` 开放权重模型能激活下游企业定制和垂直应用场景,其与闭源实验室之间构成良性竞争与相互促进的正向循环,而非零和博弈。 - `03:36` 美国产业界需要领袖出资建立属于本土的顶级开源实验室,以平息针对模型蒸馏的恐慌情绪,并正面参与开源模型的技术竞赛。 - `03:36` 关于大模型蒸馏的伦理争议存在双重标准:闭源实验室未征得创作者许可便摄取全网数据进行训练,因而难以在逻辑上彻底否定利用付费 API 输出进行的再训练。 - `10:00` 中美模型技术差距正在逐渐收窄,基于美国拥有无法跨越的领先优势而采取的严苛技术封锁假设已被近期的竞品进展所动摇。 - `06:50` 单纯的技术封锁无法阻挡中国在 AI 领域的战略投入;中国拥有庞大的人工智能研发人才库、大规模数据组织能力以及实体制造业支撑。 - `06:50` 与其通过禁令催化对手构建完全独立的硬件与架构,不如让美国企业参与全球底层基础设施建设,以保全长期的商业利益与网络效应。 - `10:00` 前沿闭源实验室若以固定节奏开源上一代模型,不仅不会削弱自身,反而能通过承接庞大的推理托管调用和后期调优服务维持 20%-40% 的稳健基础设施毛利。 - `15:00` Anthropic 等实验室不愿开源主力模型,一方面出于短期账面变现考量,另一方面源于其安全哲学——坚信必须由单一实体把控 Token 流向以防御提示词注入等风险。 - `15:00` 企业在选型 AI 时高度看重双重轴线能力:既要垂直领域的深层专业知识(如生命科学、法律合规),又要横向顶级通用推理与长上下文支持。 - `20:00` 前沿模型因过度触发安全警报而频繁将调用“降级”至低阶模型的行为,严重破坏了高级推理与代码生成的体验,过早过度锁死能力可能会扼杀技术的实际采用。 - `20:00` AI 消除了软件工程立项的两难困境,使以往不值得投入的人力琐碎微需求和周期过长的宏大项目同时变得极具可行性,从而大幅拓展了产品路线图的广度。 - `25:00` 编码智能体目前倾向于严重高估开发周期,原因在于其训练语料中包含了大量 AI 时代前人类工程师习惯性夸大任务复杂度的沟通记录。 - `25:00` 企业不会永久绑定单一底层基础模型,价值将持续向能够理解具体业务工作流、掌握企业私有权限数据并动态调度多模型的应用路由层汇聚。 ## Detailed walkthrough ### `00:00` 开源权重公开信与 AI 的非零和生态 节目开场由 MTS 主持人 Theo Jaffee 和 Sofia Puccini 介绍 Box 联合创始人兼 CEO Aaron Levie。Box 业务涵盖企业云内容管理、文档权限协作以及多种企业级 AI 功能。主持人调侃了当天关于“占星术图像生成领域重大收购”的玩笑话后,迅速切入核心议题:NVIDIA 首席执行官黄仁勋(Jensen Huang)牵头撰写了一封支持“开放权重”(Open-weight)AI 模型的公开信,Box 也是签署方之一。 ```mermaid flowchart TD accTitle: 开放权重模型推动生态创新的正向循环 accDescr: 开放权重模型与闭源模型并存,催生更多应用场景,倒逼闭源实验室加速迭代,最终实现多方共赢。 subgraph OpenEcosystem["开源权重生态"] A["开放权重模型\n(Open-Weight Models)"] --> B["企业定制化训练\n与下游应用扩展"] B --> C["衍生更多 AI 落地场景\n(扩大整体市场)"] end subgraph ClosedEcosystem["闭源实验室"] D["闭源模型提供商\n(Closed Model Labs)"] C -->|"竞争压力倒逼"| D D -->|"加速创新与交付"| A end ``` Aaron Levie 将这封信比作一个“罗夏墨迹测验”(Rorschach test)——每个人都能从中解读出自己的立场。对于签署方而言,信件的核心主旨主要包含两层: 1. **开放权重是 AI 创新的加速器**:开放权重并非与闭源商业模型形成零和博弈,而是大幅增加了 AI 能够触达的场景数量。开发者可以在其上自由构建、针对垂直用例进行再训练,从而激活更多增量需求。 2. **美国必须加大对开放权重的投入**:公开信并不是要无条件为中国正在发生的所有技术动态站台,而是向美国产业界发出动员令——美国本土需要有更多企业站出来研发开放权重模型。同时,关于“模型蒸馏”(Distillation)的恐慌情绪(FUD)需要降温,蒸馏本身存在大量合理的工业场景。 尽管 Levie 承认关于高级 AI 能力未来潜在安全风险的辩论是健康的,但他明确指出开放技术利大于弊:“I almost unequivocally take the stance that more open innovation and open weights innovation is good for AI broadly and the diffusion of AI.”(我几乎毫无保留地坚持这一立场:更多的开放创新和开放权重创新,从整体上有利于 AI 及其技术的普及传播。) --- ### `03:36` 蒸馏争议:API 付费与伦理界限的实质 在探讨模型蒸馏(即用大模型的输出结果去训练或微调另一个小模型)的合法性与商业合理性时,主持人提问如何区分正常的经济活动与触碰民事甚至刑事底线的违规蒸馏。Aaron Levie 坦言,很难在两者之间划出清晰的伦理分界线。 Levie 深入剖析了前沿实验室立场与底层逻辑之间的张力: - **训练数据来源的双重标准**:闭源模型本身是抓取整个公开互联网的数据训练出来的,绝大多数创作者从未主动选择同意(opt-in)或拒绝(opt-out)。如果实验室认为从全网摄取人类智慧是合理的,就很难在逻辑上反驳“另一个 AI 模型可以基于 AI 的输出进行训练”。 - **商业 API 的经济交换**:前沿实验室当然会在服务条款(ToS)细则中全力设防保护自己的护城河,但蒸馏方在调用 API 时是付了真金白银的。正如 Levie 形象指出的,Anthropic 等实验室从这些蒸馏调用的 API 费用中赚到的钱,远超过他们当年为原始训练数据支付的对价。 - **直接蒸馏 vs. 公开数据的思想实验**:通过多账号直接调用 API 蒸馏模型,与成千上万开发者用 Claude 或 GPT 编写代码、再将这些代码上传到公开代码仓库供后人训练,在本质上并无伦理鸿沟。 Aaron Levie 呼吁美国科技领袖挺身而出,建立本土的顶尖开源实验室:“I think the best case scenario personally would be you get a few people that are at a stage in life where they can just be like, yep, I'm going to drop $10 billion on building an open lab in America. And we have our own version of, you know, Moonshot.”(就我个人而言,最佳情景是能出现几位处于人生特定阶段的人,能够直接说:‘行,我掏 100 亿美元在美国建一个开源实验室。’这样我们就能拥有属于自己的 Moonshot(月之暗面)。) --- ### `06:50` 中美地缘博弈:封锁无法阻止竞争对手崛起 主持人提出了当前硅谷对中国开放权重模型的两大普遍担忧:第一,如果美国初创生态过度依赖中国开源模型(如 DeepSeek 等),一旦对方断供,美国科技产业将陷入被动;第二,廉价开源模型压低了美国企业的利润率,构成国家安全风险。 Aaron Levie 反驳了这种保护主义逻辑。他举例道,这就像有人主张“为了不依赖中国的制造业优势,iPhone 就应该卖 5000 美元而不是 1000 美元”一样荒谬。如果按照封锁逻辑推演下去,最终的结果只会是“美国用着极其昂贵的 AI,而世界其他地方用着极其廉价的 AI”,长期来看对美国的竞争力是灾难性的。 关于黄仁勋此前接受 Dwarkesh Patel 播客访谈时引发的分歧,Levie 旗帜鲜明地站在黄仁勋一边,强调围堵并不能阻止中国在 AI 领域的崛起: - **战略决心不可动摇**:AI 被中国视为国家最高战略方向之一,绝不可能因为美国的外部限制而放弃发展。 - **顶尖人才与数据优势**:中国本土储备了极其庞大的人工智能研发人才,即便美国顶尖实验室中也有大量华人学者;在训练数据上,中国具备调动十万人规模生成高质量数据的工业组织能力。 - **制造底蕴与技术闭环**:中国具备芯片与晶圆制造的工业潜力和实体产业链支撑。 Aaron Levie 警告,强行切断供应只会适得其反:“If you block off China, China is not going to give up on AI. They're not going to just decide that this is not that important of a technology category for them to play in.”(如果你封锁中国,中国绝不会放弃 AI。他们绝不可能认定这是一个不值得参与的重要技术领域。) Levie 赞同黄仁勋的战略洞察:与其用外部禁令催化并加速中国自主技术栈的成熟,倒不如让美国企业参与到全球底层基础设施建设中去。否则,开源模型依然会被训练出来,但届时使用的将是完全独立于美国的另一套硬件与架构,并最终广泛部署在全球主权云体系中,从根本上削弱美国的长期经济利益与技术霸权。 ### `10:00` 中美模型竞赛与开源权重的经济学 Aaron Levie 深入探讨了对华 AI 限制的实际效果。他指出,试图通过全面切断与中国的技术连接来显著拖慢中国 AI 的发展速度,并寄希望于美国就此“轻松获胜”,这种假设完全不切实际。许多关于开源权重(open weights)或基础设施外泄的理论风险评估,其底层逻辑都建立在“美国对中国拥有不可逾越的绝对领先优势,并且这一优势只会加速扩大到无法追赶的程度”这一前提之上;然而从近期以 Kimi k3 为代表的中国大模型表现来看,中美之间的技术差距非但没有扩大,反而在逐渐缩小。 三人顺带提到了 Dwarkesh Patel 对英伟达创始人黄仁勋(Jensen Huang)的那场轰动业界的访谈。主持人盛赞那是一场“属于这一代人的访谈(generational)”,留下了极多金句,比如黄仁勋脱口而出的“我不是个失败者,你面对的不是一个每天起床认输的人”,整场交流宛如一场充满真实张力的“科技真人秀”,堪称“绝对的电影级名场面(absolute cinema)”。 讨论随即切入核心问题:如果美国主动开源一个性能媲美甚至超越中国竞品的模型,代价与收益究竟是什么?Aaron Levie 剖析了 AI 产业的底层商业规律,指出 AI 真正的造血机核心在于推理(inference),资金无论如何最终都会流向基础设施层。如果在极端假设下,全球只有一两家实验室独揽无法被逆向的专利核心机密,或许能把持更深层次的技术栈封闭变现;但现实是美国存在三到五家视领先模型为生死存亡的核心玩家。这种激烈的竞争动态必然会导致 Token 的售价随着时间推移不断向基础设施的裸成本逼近: > “在那种情况下,如果你拥有一个开源模型,并且为你自己的开源模型提供首选基础设施,或者构建针对该模型的 post-training(训练后调优)环境,抑或被企业视为部署该模型时更安全的品牌,我其实认为仅凭带动该模型的推理调用,你就能赚取几乎等额的收入。”——Aaron Levie 在 Aaron 看来,毛利率最终会落在高于基础设施成本 20% 到 40% 的区间,而非 70% 至 90% 的暴利。因此,即便像 OpenAI 这样的前沿实验室,若能以更固定的节奏将其上一代模型以开源权重形式发布,不仅能把长尾用例锁定在自家生态系统内,还能通过承接海量推理赚取收益。开源 AI 并不意味着企业能彻底脱离云基础设施在本地笔记本上运行大型复杂任务,用户最终依然要为庞大的 GPU 集群买单。 ```mermaid flowchart TD accTitle: AI推理商业飞轮与基础设施货币化 accDescr: 展示开源前沿模型如何通过基础设施托管与企业生态沉淀产生与闭源相似的推理收益 subgraph Release["模型生态层"] A["前沿闭源旗舰模型<br/>(Frontier Models)"] -->|"技术代际更替,快速跟进"| B["上一代开源权重模型<br/>(Open-Weight Models)"] B --> C["企业与主权定制用例<br/>(Post-training & Sovereign)"] end subgraph Platform["商业化与基础设施承接"] C --> D["实验室官方优化基础设施<br/>(Preferred Hosting Stack)"] C --> E["企业安全与合规品牌<br/>(Enterprise Safe Branding)"] end subgraph Monetization["价值沉淀层"] D --> F["海量 Token 推理收入<br/>(Inference Revenue)"] E --> F F --> G["维持 20%-40% 基础设施稳健毛利"] end ``` --- ### `15:00` 闭源实验室的顾虑与 Claude Opus 5 的工作评测 主持人质疑道,既然开源旧代模型在商业上说得通,为什么前沿实验室依然按兵不动?例如 Anthropic 从未开源过任何核心模型,Google 也仅仅开源了 Gemma 而非上一代 Gemini。Aaron 分析实验室的顾虑主要分为两类:其一是商业时间周期的考量。如果明天发布一个模型,纯闭源并强制所有调用走专属 API,短期账面上的吸金能力毫无疑问更强;只有放眼长期、接受 Token 成本终将因任务均摊而走低的规律,开源与闭源的长期收益差距才会抹平。其二则是安全哲学,以 Anthropic 为代表: > “我真的认为他们从根本上坚信,你必须由单一实体来把控 Token 的流向,从而防范提示词注入,并确保能够根据用户的查询类型动态路由到不同的模型;在开源权重环境下,你根本无法做到这一点。”——Aaron Levie 因为安全理念是 Anthropic 的立身之本,所以他们几乎不可能开源主力模型。 随后话题转向新发布的 Claude Opus 5。Box 在内部基于多种行业知识工作场景对 Opus 5 展开了为期一两周的深度评测(Evals)。大型企业对 AI 的刚需可以拆解为双重轴线:一方面是极深度的垂直行业理解力(如生命科学、法律合规、大型投行规则等必须内化在模型中),另一方面是顶级的横向通用大模型理解力与长上下文处理能力。评测表明,Opus 5 相比此前同类最佳的 Opus 4.8 展现出了极具分量的代际跃升,在两大维度上均有显著突破。 在闭源与开源的关系上,Aaron 重申这绝非零和博弈:闭源实验室依然会在最前沿的技术边界上保持绝对领跑,绝大部分行业利润仍将被前沿闭源实验室收入囊中。针对主持人提出的“在直观体感(Vibes)上竞品模型是否微弱优于 Opus 5,但因其两倍昂贵的价格导致 Opus 5 具备帕累托最优(Pareto superior)”的对比,Aaron 结合 Box 内部通用知识工作基准测试表示赞同,确认由于显著的成本差异优势,Opus 5 在综合性价比与实用性上已形成明显胜势。 - **Token 利润率收敛预期**:AI 模型的推理边际利润率预期将从软件行业常见的 70%-90% 逐步压缩至硬件基础设施成本之上的 20%-40%。 - **企业核心考量维度**:垂直行业深度知识库(Life Sciences、Legal 等)与横向通用推理能力并重。 - **性价比评估**:Opus 5 在知识工作基准上的表现加上相比竞品更低廉的调用成本,确立了其在企业部署端的帕累托最优地位。 ### `20:00` 模型降级问题、安全边界与工程团队的野心 在内部评测中,大家讨论到了顶尖前沿模型(如代号 Fable)与常规模型(如 4.8)之间的差距。Aaron Levie 指出,高阶模型在解决棘手技术难题时展现出的超强能力,完全不是靠 Token 成本差价能够弥补的。然而目前使用这些前沿大模型存在一个严重痛点:模型经常会在调用过程中出于安全警报机制,自动将用户请求“降级(push down)”到低阶模型(如 4.8)。例如当模型在代码中扫描到权限管理、访问控制相关的逻辑时,安全防护机制可能会过度反应,导致用户无法获得前沿模型原生的强悍推理能力。虽然 Anthropic 提出了与政府合作建立多级能力风险测试框架的方案,但 Aaron Levie 质疑究竟该由谁来界定何为真实风险:“I would argue that if you kind of snapshot it in time, Fable, right now, the level of things that they push down – prevent you from doing, that would be untenable for the future of AI. People will simply not use AI if this is the kind of ongoing environment.” 他认为目前整个行业尚处于极早期阶段,过早将模型能力全面锁死只会扼杀 AI 的采用。 谈到 AI 对软件工程和开发团队构成的深远影响,Aaron Levie 依然对软件工程师这一岗位抱有极其乐观的态度。他透露,在 Box,AI 的引入并没有导致裁员,而是让团队能够接手远超以往的工作量。以往的产品规划受限于纯人力资源的边界,团队通常会落入一种两难选择:要么拒绝微小需求(因为不值得花一周时间去做),要么拒绝极其宏大的跨年项目(因为技术实现太复杂、耗时太长),导致大部分立项都只能挤在中间的常规区间。有了 AI 之后,原本需要几个月的长期项目被大幅压缩,而那些原本排在需求池最底端的琐碎小功能,现在两小时就能搞定。Box 目前有数十个原本绝不可能立项的项目正在顺利推进。对于那些借 AI 裁撤工程师的公司,Aaron Levie 给出了极具讽刺意味的断言:“I generally think if you think that you've kind of eliminated the need for software engineers, there's just no chance you're being ambitious enough with your product roadmap.” 真正限制团队扩张的只剩财务预算,而不是对工程师需求的减少。 - 核心矛盾:安全策略导致的静默降级(Fall-back to lower models)极大地破坏了高级代码生成和前沿推理体验。 - 产品规划变革:AI 抹平了两极化的开发阻力,使得“超小型长尾需求”和“多年度超大型复杂项目”同时变得触手可及。 - 团队规模论点:技术杠杆率提高后,雄心勃勃的企业不仅不会裁撤开发人员,反而会招募更多工程人才以扩大产品战线。 --- ### `25:00` 编码智能体的时间误判与模型路由层的崛起 对谈中主持人分享了一个有趣的现象:当前的编码智能体(Coding Agents)常常严重高估开发周期,动辄声称某个功能需要耗费一整个周末甚至整整一个月,结果人类借助工具三小时就搞定了。Aaron Levie 幽默地解释道,这是因为模型训练语料里塞满了 AI 时代之前人类工程师在 Slack 里的聊天记录,而当时的工程师习惯性地把需求评估为“这玩意儿得做两年”。在数学领域同样如此,若询问 AI 何时能证伪数学公开猜想,它会预测大概还要五年,而现实中类似突破早已发生。 随后话题转向企业级市场的核心战略:随着前沿大模型发布频率越来越高、相互超越周期变短,企业只绑定单一模型提供商已不再可行。关于模型路由(Model Routing)是否是终局,Aaron Levie 坦言自己存在立场偏见,但他坚信应用层(Applied AI Layer)将汇聚巨大的价值。当一个复杂业务场景需要同时调用便宜的“跑腿模型(workhorse models)”和极其昂贵的“前沿编排模型(frontier orchestrators)”时,处于顶层的应用路由不仅能解决性价比问题,还能解除企业的选型顾虑。 ```mermaid flowchart TD accTitle: 企业级模型路由与应用层架构 accDescr: 展示企业数据和工作流如何通过应用层路由分发至多个底层水平模型 subgraph AppLayer ["应用层与路由系统 (Applied AI Layer)"] Workflows["企业垂直工作流 (法律 / 医疗 / 金融)"] ContextData["企业内部权限与上下文数据"] Router["动态模型路由器 (Model Router)"] Workflows --> Router ContextData --> Router end subgraph FrontierModels ["底层基础模型提供商 (Horizontal Models)"] M1["OpenAI (GPT 系列)"] M2["Anthropic (Claude / Fable)"] M3["xAI (Grok 系列)"] M4["Google (Gemini 系列)"] end Router -->|"前沿任务编排"| M1 Router -->|"代码与长上下文"| M2 Router -->|"低成本通用任务"| M3 Router -->|"特化推理检索"| M4 ``` 企业不需要在第一天就赌谁能永远赢下去,今天可以用 Claude,明天切换到 GPT-5.6,后天对接 Grok 4.5。Aaron Levie 强调:“The more that you need multiple models to do a task or a set of tasks, the more value accrues to the layer that can understand the task and get access to the data and handle the workflow, which obviously is a better outcome for the, let's say, applied AI layer, which is where we tend to sit.” 纯水平(Horizontal)基础模型很难直接深入法律、医疗或金融等纵深领域,障碍不在于模型智能本身,而在于模型周边缺乏整合企业数据与特定业务流的完整配套机制。 - 行业竞争格局:美国本土有五家左右顶尖模型开发商正处于既压低算力成本又推高智能上限的激战状态。 - 应用层红利:像 Cursor、Replit、Cognition、Factory 以及 Box 这样的应用层服务,正凭借解耦底层模型、提供灵活路由与企业数据集成而建立起更坚固的护城河。 --- ### `30:00` 告别与行业节奏的荒诞加速 节目接近尾声,嘉宾和主持人们感慨过去一周乃至一天内 AI 圈内信息密度之大、变化之快。从开源权重的激辩、前沿模型的频繁释出,到前几天发生的 OpenAI 访问 Hugging Face 等突发新闻,整个行业的发展节奏已经严重压缩了时间感——几天前的大新闻在当下的体感中恍如上个月发生的古老事件。主持人和 Aaron 相互致谢告别,随后播客播放了标准的 a16z 订阅指南与免责声明,本期播客在对 AI 演进狂飙突进的惊叹声中正式结束。 ## Notable quotes > `20:00` I generally think if you think that you've kind of eliminated the need for software engineers, there's just no chance you're being ambitious enough with your product roadmap. — Aaron Levie > `00:00` I almost unequivocally take the stance that more open innovation and open weights innovation is good for AI broadly and the diffusion of AI. — Aaron Levie > `06:50` If you block off China, China is not going to give up on AI. They're not going to just decide that this is not that important of a technology category for them to play in. — Aaron Levie ## Mentioned Aaron Levie, Theo Jaffee, Sofia Puccini, Jensen Huang, Dwarkesh Patel, Box, NVIDIA, Anthropic, OpenAI, Google, xAI, Hugging Face, DeepSeek, Moonshot AI, Cursor, Replit, Cognition, Factory, Claude, Claude Opus 5, Claude Opus 4.8, Fable, GPT, GPT-5.6, Gemma, Gemini, Grok, Grok 4.5, Kimi k3, iPhone ## Video description Box co-founder and CEO Aaron Levie joins MTS hosts Theo Jaffee and Sofia Puccini to make the case for open-weight AI, unpack the economics of open versus closed models, and explain why he believes more openness could strengthen rather than undermine the U.S. AI ecosystem. Aaron argues that open models create more use cases, push closed labs to innovate faster, and don't fundamentally change where the economics of AI ultimately accrue. They debate model distillation, America's competition with China, why restricting access may simply accelerate competing AI ecosystems, and whether U.S. labs should begin releasing open-weight versions of previous-generation models. They also get into what the latest frontier models mean for knowledge work, how AI has changed software engineering at Box, and why Aaron believes companies cutting engineers may simply not be ambitious enough. Finally, they discuss why enterprises are unlikely to bet on a single model and why the layer that routes between models, data, and workflows could become increasingly valuable. [Source](https://mgln.ai/e/1344/afp-848985-injected.calisto.simplecastaudio.com/3f86df7b-51c6-4101-88a2-550dba782de8/episodes/fa4d1de0-221c-4305-9b44-d8ee5ef2a0db/audio/128/default.mp3?aid=rss_feed&awCollectionId=3f86df7b-51c6-4101-88a2-550dba782de8&awEpisodeId=fa4d1de0-221c-4305-9b44-d8ee5ef2a0db&feed=JGE3yC0V)

Source quotes

[20:00] Aaron Levie: I generally think if you think that you've kind of eliminated the need for software engineers, there's just no chance you're being ambitious enough with your product roadmap. [0:00] Aaron Levie: I almost unequivocally take the stance that more open innovation and open weights innovation is good for AI broadly and the diffusion of AI. [6:50] Aaron Levie: If you block off China, China is not going to give up on AI. They're not going to just decide that this is not that important of a technology category for them to play in.

Source quotes

[22:30] Aaron Levie: I generally think if you think that you've kind of eliminated the need for software engineers, there's just no chance you're being ambitious enough with your product roadmap. [0:00] Aaron Levie: I almost unequivocally take the stance that more open innovation and open weights innovation is good for AI broadly and the diffusion of AI. [10:00] Aaron Levie: I just don't think there's a scenario here where you can kind of close off completely to China and somehow you dramatically slow them down.

Original transcript

[0:00] Open-weight AI is often for him as a threat to frontier labs. Aaron Levy thinks that gets the economics backwards. The Box co-founder and CEO joins Theo Jaffe and Sofia Puccini on MTS to discuss why open models could make the AI ecosystem more competitive, the debate around distillation in China, and why America needs more open-weight AI. They also get into the latest frontier models, how AI is expanding rather than shrinking Box's engineering roadmap, could become the default for enterprise AI. We are live with Aaron Levy, the co-founder and CEO of Box, which does all kinds of things, cloud content management, enterprise documents, permissions, collaboration, a lot of different AI functions. He has an incredible Twitter account, at Levy, He's been around on the website forever and he writes about AI and many other topics. We have two huge stories today. I wonder which should we start with? Astrology. Of course, astrology. Yeah, huge acquisition in the astrology image gen space. Mm-hmm. Something we will be monitoring. Is it an open source play or not yet? I think not yet. I think astrology might remain closed source for the time being. Okay, that's too bad. We've got to fight that. Yeah, we've really got to fight that. But going to the real story, So, Today, there was an open weights letter that Jensen Huang wrote and Box signed. So can you tell us sort of like your interpretation of this letter? What exactly is it aimed at? And like, what are you guys trying to shape? What do you think Jensen was trying to shape? Yeah. Is the letter maybe like a, it's like a Rorschach test of like, what do you see in this letter? Well, what we saw when we read it was, hopefully it's like the default stance of the folks that signed it, but basically kind of almost two fold sort of main points. One, the reason why open weights AI is super important is because it actually drives AI progress. We get more innovation, we get more options. You can build on top of these models. You can train them for your own use cases. So like open weights in general, I would argue is actually a very important think it's actually kind of mis-framed as zero sum with closed weights. It actually just adds to the number of use cases that people then do with AI. So that's kind of probably part one. And then part two, I think embedded in there was a little bit of a call to arms on the U.S. actually needs to be probably even more invested in open weights models. And we probably want even more companies kind of showing up to the table with this innovation. And so it didn't seem like it was directly about we must support all of the things that are happening in China as much as U.S. needs here. I know, by the way, like distillation is actually not always bad and there's lots of use cases around it. So let's maybe like calm down on some of the foot on that. We support every one of those stances. You know, open models are, I think, very important to the AI ecosystem. And I actually think it pushes even the closed model providers to innovate faster and be able to deliver more for the market. So I think everybody is sort of a winner as a result of open weights. To be fair to the other side of the argument, I think there's a category for getting kind of commercial and that obviously has real arguments around the safety elements of open weight at some point in the future of capability. I don't agree with that point of view, but I think it's like a healthy debate to have and to have conversations around it. But I almost unequivocally take the stance that more open innovation and open weights innovation is good for AI broadly and the diffusion of AI. So diving into the distillation point, how would you separate distillation that is like just normal, basically normal economic activity from distillation that crosses a line into like some sort of civil or criminal violation? Well, I don't know if I would make that argument. I don't know where that line would exist. I'm almost deeply on the side of, I think it's very hard to make the argument that AI models should be trained on broadly the public internet, but another AI model can't be trained on the outputs of an AI model. I think it's a very tenuous argument to make. I don't see how you can kind of pull it off. At the exact same time, I understand, and if I were running a lab, I would want to lock these things down as much as humanly possible. So I'd be trying to find every defensive models. But I don't know that you'd be able to kind of credibly argue that there's some ethical kind of line that is crossed simply because then you would be basically arguing against the underlying training runs of these models. Most people didn't get to opt in or out of their data being trained on. Maybe it's in some kind of terms of service from the underlying provider somewhere in the fine print. But like, this is a thing that is sort of like, we are assuming that the general knowledge of the world is going to be trained into these models. And that general I don't see the distinction between those in any meaningful way. Yeah, I mean, we heard a take yesterday that was kind of exactly that. It was just like, we're focusing on the wrong part of the chain when we blame distillation. It should really be like, how is Anthropic thinking about like, how to restrict their API use or like how to very effectively [5:00] prevent the sort of... We were also talking about how distillation, they still have to pay for the API usage. Anthropic is getting paid more for distillation than most people have ever gotten paid for the original training run. And if you kind of like, you're almost going to do a thought experiment of like, well, what's the difference between distillation in a very direct, like I'm using the API across 10,000 accounts versus just quite literally, if we all generate code from Fable or GPT-5-6 and all that code ends up in public repos, what's the kind of compelling difference between those two scenarios that a model will get trained against? why there'd be arguments, why there'd be some kind of ethical line between those two. And then you kind of layer in another element, which is I think there's a lot of people that argue that actually China in this case are doing kind of breakthrough innovation in general, independent of distillation that's causing models to progress. But also I'm sure that there's going to be other kind of controversies and conspiracies about what's happening. And I don't know enough to be able to kind of credibly argue that other things are or are not happening and why these models are progressing. I'll let obviously the labs to make those cases and the government to that as they see fit. But all of that to me is independent of do we want open weights models and do we want this innovation in general from the ecosystem? I think the best case scenario personally would be You get a few people that are at a stage in life where they can just be like, yep, I'm going to drop $10 billion on building an open lab in America. And we have our own version of, you know, Moonshot. Like, I think that would be a great service to America and to innovation in general. So I've been kind of waiting for the day that, you know, somebody does that. But, you know, for now, still waiting. We're going to attack the Gates Foundation under this post. They might do it. They might do it. There's another angle here, which is, you know, most open weights models are coming from China. If we become too dependent, if the American startup ecosystem becomes too dependent on Chinese open-weight models, and then they shut off the open-weights, they stop releasing new open-weights models, that this could be very bad for the American tech industry. Or that because these are Chinese open-weight models, they undercut the margins of American companies. And it's a national security concern, say some people. And I think those are great arguments, but it's like, okay, so what do you do about that? Some people say that the iPhone should cost $5,000 instead of $1,000 because we shouldn't rely on manufacturing advancements that exist in China. I don't know. If you kind of play out the alternative, then all you would basically be arguing is America should have really expensive AI and the rest of the world should have very cheap AI. And then we'll see how that works competitively over the next five or 10 years. open weights models exist. China knows how to produce them. I lean more on the Jensen side of the argument. Everybody had this moment where they watched the Jensen-Dorakesh podcast, and that was the original Rorschach test. Some people parse Dorakesh as like, obviously, that's the exact right position to be taking, and you should be interrogating Jensen. And then other people watched it and was like, why is Dorakesh not understanding Jensen's point and letting him expand on that? I was watching it and just was like, yeah, Jensen's obviously right. disagree with it, but he's obviously right that the following will happen. If you block off China, China is not going to give up on AI. They're not going to just decide that this is not that important of a technology category for them to play in. So if you just assume that China considers AI to be very strategically important, and, oh, by the way, all these funny meme tweets of, we have more Chinese AI researchers than the Chinese labs do in the U.S., obviously they can produce incredible talent working on AI. base to be able to compete against. So it's incredibly important strategically for China. They actually have a lot of the core raw materials needed between raw human talent and industrial might for building chips and fabs and whatnot over time. Getting the training data, you could just go hire 100,000 people in China to go generate an insane amount of data. There's ways of getting the data. So at some point, it's not becoming a very, very strong player in AI. And if they're a very strong player in AI, and the world adopts their models and adopts their architecture, that obviously is going to be bad for the US economically over the long run. So Jensen's point is, instead of sort of forcing that and catalyzing that to happen even faster, by the constraints that you impose, maybe we should actually be a part of the infrastructure build out that's sort of going on. And I actually going to happen is the alternative is that these models are still going to get trained one way or another, but now they're going to be trained on a different hardware stack. Ultimately, over time, that hardware stack can be the one that gets deployed in sovereign clouds and whatnot. And so, [10:00] So I think it's, I just don't think there's a scenario here where you can kind of close off completely to China and somehow you dramatically slow them down. And then kind of hand wavy, we just win. I just don't think that that plays out in this space. So, you know, all of the, you know, kind of a lot of the sort of theoretical risks of either open weights or, you know, the infrastructure side have to assume that we have such an insurmountable lead against China. And that only accelerates past the point where, like, there's just simply no catching up. and I think as we've seen recently with K3 and other models, that gap is maybe narrowing as opposed to expanding over time. Yeah, that Dworkesh Jensen interview, by the way. Generational. They had such gems in it. Like when Jensen was like, I'm not a loser. You're not talking to someone who woke up a loser. We're not a car. Yeah, that losing mindset makes no sense. No, that was some of the best content ever produced. So I don't know why they didn't charge for that one. Yeah, it felt like tech reality TV. Like he was actually just getting into it. It was awesome. Absolute cinema Yeah Well OK what do you think would have happened if like say the U would have open beat China to open a Kimi K3 capability model Because I understand the argument of, okay, we need to deploy American open-source models that are the same, if not better, than the Chinese open-source models. but what do you think are the trade-offs of completely open sourcing it to the point where obviously Chinese labs would be able to have access to it? Yeah, first of all, even the open versus closed, I actually appreciate all the debate that happens on this so I'm very passionate about the topic but I also totally appreciate all of the arguments on the other side even though I probably lean the other way in some of them but some of them do inform informs on my views and I kind of update maybe then to be a little bit more nuanced on my end. But on the open source US side, I generally think that the moneymaker in AI is inference. And so ultimately the dollars are going to flow to the infrastructure stack one way or another. I think in a world where you only had one or two labs and somehow there were these insanely only closed secrets about you had like real intellectual property that was protectable and patentable and nobody ever could know about and it like you know totally locked down Then in that world, I think you could probably argue that like, you know, there's another couple layers of the stack that you could kind of close off. But in a world where we're going to have, you know, three to five players in the U.S. that consider it sort of existential to them to have leading models, then you have enough of a competitive dynamic in the market where you have to expect that the cost of tokens converge closer and closer to the cost of the infrastructure over time. Not to zero. I'm definitely not a believer that there's no margin there, but closer. So in the 20%, 30%, 40% range on top of the cost of infrastructure, which is different from 70% or 80% or 90%, let's say. So if that's the case, then actually if you had an open model and you powered, let's say, the preferred infrastructure for that open model, or you created the post-training environment for that open model, or you were the kind of considered the safer brand for deploying that open model by enterprises, I actually would argue make almost the same amount of revenue just by, again, driving the inference of that model. And so if you assume that with things like you know I would actually make the case that even for something like an open AI if you fast followed your frontier models with open source versions of let say the prior generation at a more consistent pace, I actually think you would be even more competitive with your frontier models because it would keep more and more of the use cases within your ecosystem and your family. And you probably could just power a lot of the inference of those open models as well. So I would just argue that these are kind of flavors of ways of enabling different kinds of use cases with AI as opposed to entirely different economic structures of AI. Because at the end of the day, you're going to be paying for large GPU clusters no matter what. Open source AI does not mean that somehow I'm going to be running Fable on my laptop and I'm able to circumvent the need to have cloud infrastructure. The dollars are going to eventually flow. We just talked about this. We did, yeah. Oh, okay. So the dollars are going to flow into some infrastructure provider And there's no reason that OpenAI can't be that infrastructure provider or Anthropic can't be that infrastructure provider. You know, obviously, Meta and SpaceX now are going to be getting in that space. So I'm not convinced that OpenWays AI dramatically changes the economic structure of AI, other than to just provide even more avenues to innovation and more avenues of use cases that begin to emerge. [15:00] That, I think, would actually be a good thing for the ecosystem broadly. So I'm pro U.S. open weights. I actually think a lot of the closed labs should consider having kind of faster follow open weights models to be able to handle the post-training use cases and some of the sovereign use cases. And I don't think it would actually be as bad as probably is sort of perceived from a market standpoint. Yeah, this is a really interesting thread. I'm curious if this would be good for the business model, the labs. Why don't the labs do it? Anthropic has never open sourced anything. Google open sources Gemma, which is something, but it's not the last generation of Gemini. I think there's two categories that people fall in. One is you sort of, you have to have a, you know, your time horizon has to be longer, you know, to believe that you can monetize open weights. Because tomorrow, if I release a closed model, I just will literally make more money if I just keep it closed and I force everything to route through my API. That on paper, I'm going to make more money, no question. But over the long arc of time, where no matter what, you have to assume that the cost of token per task gets driven down regardless, then you kind of play things out two or three stages. And it's almost kind of a wash whether you were closed or open, because again, it's really just the inference cost that ends up mattering. That's the first part. And then the second part for Anthropic specifically, let's say, is I actually just believe that they consider this to be a major safety risk. So to them, they're not thinking about this. like an economic argument that they should be open source for market share reasons. I actually just think that they fundamentally believe, no, you actually need one entity to control the flow of the tokens, to be able to do, you know, kind of prevent, you know, prompt injection and make sure that you can route to different models based on the kind of queries people are doing. You can't do that in an open weights environment. So I would just almost consider them to likely never to open source their models for, you kind of reasons that are tied to just the creation of Anthropic in the first place. Yeah. I feel like, well, with regards to Frontier Labs, this is going to be a segue to Cloud Opus 4.5, or Cloud Opus 5 being out now. But yeah, with regards to the timing of the release of the models in Frontier Labs, it just feels like a timing thing now. We know they're cooking good models internally. So with that being said, what were your thoughts on Opus 5, especially from a work perspective because you have that perspective at Box. Yeah, so we've been running evals on Opus 5 for the past maybe a week or a week and a half or so, a couple weeks, and it's a fantastic model. Meaningful jumps over Opus 4.8, which already was kind of best in class at the time period that it was launched. research materials across every single industry. So this could be life sciences companies, law firms, large banks. And so you can imagine that the things that you're, if you're a large enterprise, you kind of need two major aspects within the AI model. You want a deep domain understanding, like you have to understand life sciences, you have to understand law, like that has to be packed into the model. And then you have to be extremely good at just being able to kind of work with large you know, horizontal. So you have kind of general intelligence, you know, going up that matters. And then you have very specific kind of industry intelligence. And Opus 5, you know, kind of just represents an improvement on both those axes. So we tried it against, you know, a variety of different industry tests that we do. Again, kind of meaningful jumps over 4.8. I'd expect that this, you know, becomes, you know, again, a very compelling model across knowledge work, So definitely great kind of work on the on the cloud front. And I think, you know, again, like what's exciting is, and this is why I don't think it's zero sum, like the closed labs continue to stay ahead on the frontier. And I think the vast majority of the dollars in profit will still go to the closed labs in almost all scenarios that this plays out. And so, you know, I think it's been a great month for both OpenAI and Anthropik on that front. Are you finding Fable better for any tasks than Opus? It seems on Vibes very slightly better, but also twice as expensive. So Opus seems like Pareto superior there. Yeah, so I don't think we've, like, so we have internal benchmarks that deal with kind of general knowledge work, and I would actually agree with you that probably due to the cost difference, you'd probably argue that Opus 5 is now kind of an improvement over Fable because of the cost delta. [20:00] It tested internally, Fable completely outmatched 4.8, like in a way that you couldn't make up for by the token cost difference. Just like being able to have superior solutions to hard technical problems. Sorry, 4.8 or Opus 5? So prior to having access to five, if we kind of compared like how big of a leap five was on that, I don't have enough internal coding tests to kind of compare against. So I had to see if like if how much is 4.8 meant to be, you know, kind of a superior coding model versus a lot of the benchmarks that they just came out with were these kind of general knowledge work, kind of agentic tool use type benchmarks. Fable had, and everybody's kind of tweeted about this already, is it will often, you know, again, kind of push you down to 4.8 for certain capabilities. And then that becomes a problem because you're not, you know, it's kind of hard in advance to know, like, did the thing kind of, you know, trigger some security warning because it was looking through permissions, you know, access control code. And so it kind of freaked out and, you know, isn't then giving you kind of Fable level of intelligence. So I do think that Anthropik is going to have to kind of work that effectively can't use Fable because it just, again, pushes their queries down too frequently. So you're not getting the raw intelligence from the model. And so, you know, I think we have to, like, I appreciated Anthropik's ultimate proposal on how we should kind of work through these types of dynamics with the government, have a kind of a multi-point framework where we kind of agree on what are these kind of capabilities that are of different risk levels and test the models for them. There is kind of an interesting question, though, which is like, well, who gets to decide that risk framework? And how do we agree that the risks are actually real risks that we perceive? Because I would argue that if you kind of snapshot it in time, Fable, right now, the level of things that they push down – prevent you from doing, that would be untenable for the future of AI. People will simply not use AI if this is the kind of ongoing environment. And so how should we decide now? Maybe these risks are very highly nuanced. And so that's why I generally lean toward it's all way too early to be locking these models down, given how early we are. So how is it affecting software engineering do the skills that you're looking for in software engineers change over time? How do you expect them to change in the near future? Yeah, I'm still very bullish on software engineering. The way that we've used these models is simply to just do way more than we were before. And it's just so qualitative and only people that are probably in the product roadmap reviews each day can maybe kind of fully process. But there's something... totally different When you're doing a product planning session, when you are thinking – in a world of just sheer human, you know, base constraints versus, versus now what AI unlocks, like it completely changes your mindset about the things that you'll go and tackle and take on. We have, um, multiple dozens of projects right now that we absolutely would not be doing if AI didn't exist. We would not have lit up the projects. We would have said, no, that's too complex. It's not worth it. You actually have two interesting scenarios. You either say no to the very small things because it's not worth it, or you say no to the really big things because they're simply too hard. And so most of your software projects kind of stay in this middle band, which is like, are the kind of things that we would use to kind of tackle pre-AI. Now what happens is you can tackle the multi-year projects because they're not multi-year anymore. And the things that are kind of like, well, that would take a week, but it's not that big of an issue. So we're just never going to do it. And so it just remains on the backlog, just very far down the backlog. You do those because now that takes two hours. So what happens is you end up basically being able to solve more and more problems that your customers have always had. And that actually just increases So, you know, wherever possible, I'm generally in the mode of actually trying to add more human talent to this because there's actually just more things we want to go and take on. And now actually the main problem is we have, you know, you just have financial constraints because there's other areas of the business that you want to grow and that you want to hire for. But I generally think if you think that you've kind of eliminated the need for software engineers, there's just no chance you're being ambitious enough with your product roadmap. And so we're constantly pushing ourselves of like, now what more can we take on as a result of AI? Yeah, totally. [25:00] Even talking to some of these coding agents, they will overestimate the amount of time that it takes to do a project severely. They'll be like, this is a weekend-long project. Sometimes they say it's a month. Yeah, they're like, this is a month-long project. And I'm like, oh my god, this is going to be so long. And then I knock it out in three hours. That's because it was trained on all of our Slack messages pre-AI. And so where the engineer said that's going to be two years. So I think it's definitely trained to be highly conservative on project timelines. Same with math too. If you ask an AI, what is your timeline to an AI model disproving an open conjecture in mathematics? It'll be like, maybe five years. No, it's already happened. Yeah, totally. I guess like the last question, because we were talking about this earlier, is like since it looks like model releases are just happening way more frequently, for enterprises specifically, it seems like, you know, loyalty to one provider is not going to make it basically. So what do you think is like the optimal strategy here? We were talking about how model routing is the future and like all of these services that offer that sort of thing are the future. Yeah, I mean, kind of that's my conclusion, but I'm also extremely biased in that conclusion. Like the more that you need multiple models to do a task or a set of tasks, the more value accrues to the layer that can understand the task and get access to the data and handle the workflow, which obviously is a better outcome for the, let's say, applied AI layer, which is where we tend to sit. That's a future that obviously a lot of companies are aligned to and strategically and kind of existentially in some cases. So if you're Cognition and Factory and Cursor and Replit, et cetera, obviously the outcome that you want to have happen is that you actually have many models. They're all good on different axes. Some are really like the cost-tuned kind of workhorse models, and some are like the super frontier orchestrators. multiple of those models to be able to complete the task effectively or at least cost effectively. That's actually the, that appears to be the timeline that we're on. And now, again, I think you have basically five credible US players in model development between SpaceX, Google, are all on a warpath for both driving down the cost of intelligence and improving the frontier at the same time. So having a model router that can kind of be above that and, again, pick and choose at different points, you know, which model to use, I think creates a lot of value for enterprises and actually helps with, interestingly, it actually helps with the diffusion of AI. If you have so many models that are emerging and they're constantly leapfrogging each other, you actually have a resistance to just landing on one model family or one partner. And so the applied layer effectively gives you that relief where it basically says, you know what? You don't have to make that choice. You can start to kind of get your workflows going, get your data in the right setup. And then you want to use Fable one day, go for it. You want to use GPT 5.6, go for it. Or you want to route that to Grok 4.5. Also, go for it. of the overall workflow. And so that's the layer that I think is going to become increasingly valuable over time. And that layer is actually kind of well-tuned to understand the deep industry and vertical use cases that AI needs to be applied to. Whereas the pure horizontal models, it's much harder for them to go deep in legal and finance and healthcare, not because the model can't do it, but because the surrounding kind of apparatus that you need around the model is not there. It needs to get access to the right data. It needs to be implemented into the workflow in the right way. And that's why I think you're going to have just a tremendous amount of value creation at that layer of the stack. Yeah. Totally. That does seem to be where we're heading. Well, thanks so much, Aaron. We are at time. It's been a crazy week. I don't think it's over yet. We have at least 10 more hours to go of what could happen today. Opus, Open Source, so much to talk about. We're so glad to have you on. Guys, OpenAI hacked Hugging Face just four days ago. That was four days ago. I thought that was a month ago. nine to figure out the next big story. So many things can happen today. So many things. Thank you so much, Aaron. [30:00] thanks for listening to this episode of the a16z podcast if you like this episode be sure to like comment subscribe leave us a rating or review and share it with your friends and family for more episodes go to youtube apple podcast and spotify follow us on x a16z and subscribe to our sub stack at a16z.substack.com thanks again for listening and i'll see you in the next episode this information to buy, hold, or sell any investment or financial product. This podcast has been produced by a third party and may include paid promotional advertisements, other company references, and individuals unaffiliated with A16Z. Such advertisements, companies, and individuals are not endorsed by AH Capital Management LLC, A16Z, or any of its affiliates. Information is from sources deemed reliable on the date of publication, but A16Z does not guarantee its accuracy. Thank you.