Casado, Sinofsky Say Compute Turns Software Bottlenecks Into Capital

The New Economics of AI | Martin Casado & Steven Sinofsky — Erik Torenberg, Martin Casado, Steven Sinofsky

Erik Torenberg, Martin Casado, Steven Sinofsky

Because AI directly converts compute into problem-solving capability without the coordination penalties of large engineering teams, small startups can deploy billions in capital to challenge Big Tech incumbents.

AI-assisted summary of The New Economics of AI | Martin Casado & Steven Sinofsky — original source. Check the original for full context.

Source published:

Key ideas

  • Computing has fundamentally shifted from an engineering-constrained paradigm governed by developer coordination to a capital-bound paradigm where small teams can immediately and productively deploy billions of dollars directly into compute clusters. (0:00)
  • Unlike historical computing layers that abstracted mechanical execution while preserving human logic, generative AI breaks deterministic software lineage by delegating actual reasoning, logic, and end-state definition to probabilistic models. (30:00)
  • AI startups are bypassing traditional enterprise disruption barriers, achieving balance sheet parity with incumbents and direct customer distribution without building massive operational headcount. (47:11)
  • Catastrophic AI risk should be reframed away from Nick Bostrom's recursive self-improvement fast-takeoff scenarios toward the geopolitical and market concentration of power resulting from $100 billion capital outlays for single frontier training runs. (60:00)

Detailed notes

## Background Published on August 25, 2026, on RSS and web platforms by Erik Torenberg, Martin Casado, and Steven Sinofsky, this episode features the a16z general partners and board partner discussing breakthroughs in AI and mathematics. The conversation explores whether these advancements represent genuine leaps in reasoning or merely higher layers of abstraction, examining the macroeconomic shift from talent-constrained software engineering to capital-intensive compute.

## TL;DR Martin Casado and Steven Sinofsky debate the transformative nature of modern artificial intelligence by contrasting historical milestones—from mechanical calculators and the four-color theorem to early personal computers—with generative LLMs. They argue that computing has shifted from an engineering-bound paradigm governed by headcount limits to a capital-bound paradigm where small teams can immediately productively deploy billions of dollars into compute. While Sinofsky emphasizes that each technological advance merely replaces repetitive baseline tasks, Casado questions whether delegating logic and reasoning to probabilistic models breaks historical computing lineage. Ultimately, they analyze how this unprecedented capital absorption alters startup-incumbent dynamics, rendering massive combinatorial problems solvable simply through sustained financing rather than algorithmic breakthroughs alone.

## Atmosphere & style The discussion carries the thoughtful, cerebral weight of seasoned systems architects and product veterans trading historical war stories from the trenches of early computing. Rather than falling into standard Silicon Valley hype or alarmist doomerism, the tone is deeply pragmatic, marked by witty intellectual banter, dry humor, and mutual respect. Listening feels like sitting in on an insider masterclass where foundational computer science theory effortlessly collides with boardroom venture strategy and personal anecdotes of legacy hardware.

## Bulletin - `00:00` Computing has fundamentally shifted from an engineering-constrained paradigm governed by developer coordination to a capital-bound paradigm where small teams can immediately and productively deploy billions of dollars directly into compute clusters. - `30:00` Unlike historical computing layers that abstracted mechanical execution while preserving human logic, generative AI breaks deterministic software lineage by delegating actual reasoning, logic, and end-state definition to probabilistic models. - `47:11` AI startups are bypassing traditional enterprise disruption barriers, achieving balance sheet parity with incumbents and direct customer distribution without building massive operational headcount. - `01:00:00` Catastrophic AI risk should be reframed away from Nick Bostrom's recursive self-improvement fast-takeoff scenarios toward the geopolitical and market concentration of power resulting from $100 billion capital outlays for single frontier training runs.

## Key takeaways - `00:00` The fundamental bottleneck of software has shifted from human engineering talent to raw capital, allowing startups with small teams to absorb billions of dollars efficiently via compute. - `01:47` Professional mathematicians embrace AI-assisted theorem proving because long-standing theoretical math challenges often stemmed from a lack of commercial incentives rather than insurmountable technical hurdles. - `05:22` Solving abstract high-dimensional systems and math puzzles resembles mastering complex video games like StarCraft, which does not automatically translate into resolving messy real-world market problems. - `10:00` Physical simulations rely on empirical equations of state rather than pure closed-form math, making claims that solving mathematics enables total physical prediction a flawed logical leap. - `15:00` Societal panic over automated tools recurs across generations—from mechanical calculators and graphing tools to CP/M microcomputers—primarily because observers react to changes from their arbitrary inherited baseline. - `23:36` Computing breakthroughs historically earned universal acclaim when tied to urgent economic or survival imperatives like maritime navigation or wartime ballistics, whereas abstract benchmarks like AlphaGo provoke ambivalence. - `25:35` Foundational computing platforms like the World Wide Web and CP/M computers frequently emerge before their commercially dominant applications are understood or developed. - `33:14` Generative AI departs from historical abstraction layers because developers no longer specify deterministic algorithms or explicit end states, instead delegating reasoning itself to statistical models. - `42:47` By functioning as a direct substitute for labor rather than requiring massive engineering payrolls, capital deployed into AI compute clusters expands the total addressable market rather than playing a zero-sum venture game. - `44:07` High abstraction layers enable deep vertical domain experts to generate specialized software without needing to build foundational UI components or complex infrastructure from scratch. - `50:00` Incumbent tech giants struggle against nimble AI competitors due to organizational physics, quarterly earnings scrutiny on massive CapEx, and internal rationing of compute tokens. - `53:30` Dominant platform incumbents routinely suffer architectural blindness when industry paradigms shift away from their core culture, mirrored in Intel's historic dismissal of ARM architectures. - `55:00` Human intuition cannot reliably forecast what capabilities will emerge from multi-billion-dollar digital artifacts trained on quadrillions of FLOPs, even if their underlying math operates via latent manifold interpolation. - `58:30` Real-world biological and pharmaceutical progress remains constrained by physical verification bottlenecks like clinical trials rather than upstream computational molecule design. - `01:01:25` Transformer architectures continuously convert added compute and capital into capability, converting seemingly infinite combinatorial engineering hurdles into manageable, finite capital allocation problems.

## Detailed walkthrough ### `00:00` From Engineering Constraints to Capital Problems

The discussion opens with a fundamental inversion taking place across the tech landscape: whereas software engineering historically faced strict talent constraints, massive capital injections into compute can now be deployed immediately and productively. As Martin Casado puts it:

> “Right now, if I give 20 people a billion dollars, they can actually use it usefully. We've kind of moved the industry from like this engineering bound problem to a capital problem that's fundamentally very different.”

For decades, handing a small engineering team an exorbitant budget could not accelerate their output proportionally. Today, early-stage AI startups like Cursor, Anthropic, and OpenAI demonstrate meteoric growth because raw compute can absorb capital at scale. At the same time, incumbents such as Microsoft remain predominantly fixated on peer hyperscalers—Amazon and Google—often underestimating smaller startups who historically avoid getting crushed despite large-company assumptions.

Host Erik Torenberg frames the discussion around whether breakthroughs at the frontier of artificial intelligence and mathematics signal that computing's foundational assumptions are beginning to fracture. He highlights a recent tweet from Jared Sumner, who jokingly recounted commanding Claude to solve the Riemann hypothesis and simply telling the model to “try harder.” Although no genuine mathematical breakthrough was produced in that instance, it underscores a mounting public conversation around whether AI models are beginning to demonstrate genuine mathematical reasoning and problem-solving capabilities.

`01:47` The Paradox of Mathematicians Embracing AI

Steven Sinofsky observes that AI's apparent inroads into mathematics tend to divide onlookers into two distinct camps. On one side are observers who express alarm, warning that automated problem-solving marks the dawn of idiocracy, renders human intellectual work obsolete, and leaves fields without a clear future. On the other side are those thrilled by the breakthroughs, regardless of whether they understand the underlying proofs.

Paradoxically, the people most enthusiastic about these tools are professional mathematicians themselves. If automation were truly an existential threat to human intellect, one would expect the most exposed practitioners to react with dread. Instead, mathematicians welcome automated theorem proving and computational assistance, viewing models as powerful instruments rather than economic threats. Sinofsky notes that their excitement highlights the uniqueness of the current technological moment.

Both Sinofsky and Casado offer an upfront caveat: they approach the topic as systems and product veterans rather than pure mathematicians, evaluating the phenomenon through an engineering, systems, and market lens rather than academic theory.

`03:00` Economic Utility and the Axiomatic Nature of Math

Evaluating AI progress through the lens of economic utility, Casado questions whether long-unsolved academic math problems actually serve as proof of massive market value. He points out that the total sum of postdoc salaries spent attempting to crack obscure academic problems over decades is negligible, meaning a problem's longevity often reflects a lack of commercial incentive rather than an insurmountable barrier to economic productivity.

Furthermore, Casado explains that large language models are naturally well-suited to axiomatic, formal domains. A proof often does not require deep physical intuition, but rather the ability to cross-reference and synthesize disparate, highly specialized subfields that human researchers rarely have the time or breadth to bridge simultaneously. While impressive, operating within a self-contained axiomatic framework does not necessarily prove that the market is unlocking latent economic value.

```mermaid flowchart LR accTitle: Axiomatic Domain vs Economic Impact accDescr: Diagram contrasting AI's ability to combine disparate mathematical axioms with the lack of direct economic utility. subgraph AI_Axiomatic ["Axiomatic Synthesis"] A["Disparate Math Subfields"] --> B["Broad Cross-Domain Context"] B --> C["Axiomatic Proof Resolution"] end subgraph Market_Reality ["Economic Validation"] D["Low Academic Funding\n(Postdoc Budgets)"] --> E{"Market Incentive\nPresent?"} E -- "No" --> F["Minimal Economic Unlock"] E -- "Yes" --> G["Productive Value Deluge"] end ```

- Academic persistence on theoretical problems does not equal commercial demand; long-standing problems may simply lack commercial ROI. - AI excels at synthesizing solutions across obscure mathematical niches because its context breadth surpasses individual human specialization. - Math benchmarks demonstrate that AI handles rules-based closed systems effectively, but they do not prove that models can resolve messy, real-world market roadblocks.

`05:22` Abstract Games versus Real-World Value

Casado draws an analogy between solving high-dimensional mathematical problems and mastering complex video games:

> “For me, it's still in the domain of like, it's really good at playing a game. Like this is the best StarCraft player ever, which is cool. And it's very powerful. But like I have a hard time connecting that with A, like maybe the reason we didn't have them before is because there just was an economic need and B, like how does that actually map?”

He distinguishes between two types of pitches received from AI founders: 1. True believers who argue that mathematics is the foundation of reasoning and artificial general intelligence (AGI), asserting that because the universe is governed by mathematical laws, mastering math leads directly to understanding reality. 2. Pragmatists who view that stance as detached from practical reality, recognizing that manipulating symbols in 12-dimensional space does not translate automatically into commercial utility.

Sinofsky adds that mathematics inherently progresses through historical layers of abstraction, contrasting it with subjects like history that lack clean abstraction layers. For mathematicians, AI represents another layer of abstraction that eliminates repetitive, mundane chores—the estimated 20% of the job that researchers dislike doing anyway—thereby freeing them to explore new frontiers. Casado quips about the opposite extreme: if an academic problem exists purely to justify research papers and grants, automating the proof leaves researchers with an existential vacuum because nothing tangible exists on the other side of the solution.

`07:34` Computer Science Pedagogy and the Legacy of Automated Proofs

Reflecting on the history of computer science education, Sinofsky recalls taking foundational coursework in discrete mathematics and algorithmic complexity theory—staples that have largely faded from modern university curricula. Casado and Sinofsky joke about classic textbooks like *Concrete Mathematics* and the cultural differences between Cornell and Stanford computer science programs.

Sinofsky recounts being taught algorithmic complexity and P versus NP theory at Cornell by Turing Award winner John Hopcroft—a Stanford PhD graduate who invented foundational data structures such as 2-3 trees. Hopcroft and his contemporaries navigated early controversies surrounding computational verification, most notably the four-color theorem. That landmark proof divided traditional mathematicians because it relied directly on computers to exhaustively verify hundreds of reducible configurations, setting an early precedent for automated reasoning shifting the boundaries of what humans prove by hand.

`10:00` The Four-Color Theorem and the Limits of Compute in Physical Simulation

Martin Casado and Steven Sinofsky begin by reminiscing about college coursework centered on theoretical computer science, specifically the pursuit of solving hard problems in polynomial rather than exponential time. Sinofsky recalls how finding non-exponential algorithmic solutions for foundational problems had sweeping implications for graph theory dilemmas like the traveling salesperson problem. At the time, computers were so heavily compute-bound that an organization like AT&T, attempting to optimize routing across a network of 6,000 switches, would otherwise face running simulations for two years.

This leads directly into the four-color theorem, which asserts that any two-dimensional planar map requires at most four distinct colors to ensure no adjacent regions share the same color. Sinofsky points out that students of their generation had this principle imprinted on them, yet the eventual mathematical resolution did not resemble classic calculus. Instead of a purely analytical deduction, researchers proved that the universe of potential configurations was finite, spanning a 200-page combinatorial reduction. Computers were then deployed to crunch through every single case to verify that four colors sufficed. Casado characterizes this as a brute-force “bank shot proof” made possible entirely by compute. For Sinofsky, the lesson was clear: once a higher layer of abstraction is proven, practitioners can build tools atop it without continually re-solving the underlying low-level representation.

```mermaid flowchart TD accTitle: Abstraction Levels in Compute accDescr: Progression from brute compute proofs to physical simulation limits. subgraph MathTheory["Theoretical Foundations"] A["Combinatorial Proof\n(Finite Set of Map Configurations)"] B["Massive Compute\n(Brute-force verification)"] A --> B end subgraph ToolingLayer["Abstraction & Tooling"] C["New Abstraction Established\n(Four-Color Theorem Solved)"] D["High-Level Domain Tools\n(Topology, Network Routing)"] B --> C C --> D end subgraph PhysicalWorld["Physical Reality vs. Compute"] E["Empirical Equations of State\n(Observed measurements)"] F["Computationally Irreducible Simulation\n(Star explosions, wind tunnels)"] E --> F end D -.->|"Does not necessarily bridge"| F ```

Casado turns the dialogue toward the philosophy of computation, questioning whether symbolic math can truly predict physical phenomena from first principles. Drawing on his background working with large-scale scientific simulation codes—such as modeling stellar explosions or aerodynamic wind tunnels—he emphasizes that these programs were never purely derived from pure math. Instead, they relied heavily on empirical data and observed equations of state. He questions whether physical simulation is computationally irreducible, meaning the only way to know the outcome is to run the simulation step by step. Casado pushes back against claims that AI solving advanced mathematics will naturally grant it the ability to predict physical reality:

> “And then I read a lot of these discourses on the math solutions, and there's kind of these claims where if it can solve all math, you can predict anything. And I just think that that's a huge, huge logical leap, which is not clear to me that it is obviously true.”

- **Four-Color Theorem Proof**: Required demonstrating that map configurations could be reduced to a finite set, followed by a 200-page combinatorial verification executed via computer. - **Network Routing Limits**: Optimizing routing for a 6,000-switch AT&T node once represented years of continuous simulation time. - **Physical Simulation Reality**: Complex physics codes rely on empirical equations of state (such as measured temperature fields) rather than closed-form mathematical equations alone.

---

`15:00` Physical Tools, Mechanical Calculators, and Shifting Baselines of Fear

Shifting from theory to physical artifacts, Sinofsky describes himself as a tools and systems person and presents several mechanical computing devices he brought to the conversation. He displays a traditional abacus acquired in a Beijing market, which he proudly notes he bargained down to seven cents, illustrating how physical implements established the very first layer of computational abstraction.

Next, he pulls out a Curta calculator (referred to conversationally as a "Kurtteuf"), an Austrian-designed mechanical cylindrical calculator resembling a pepper grinder or coffee mill. Sinofsky explains that the mid-20th-century device, brought back from the war by his uncle, packs roughly 600 intricately machined metal parts inside a handheld cylinder. By setting stepped drums and turning a crank one way to add and another to subtract, it allowed portable, multi-digit mechanical arithmetic—an engineering marvel that would cost $50,000 to manufacture today.

```mermaid flowchart LR accTitle: Evolution of Calculation Tools accDescr: Historical progression from the abacus to AI models. A["Abacus\n(Early abstraction)"] --> B["Curta Calculator\n(600 machined parts)"] B --> C["Scientific & Graphing\n(TI-35, TI-85)"] C --> D["AI Models\n(New abstraction layer)"] ```

Sinofsky and Casado compare how every generational breakthrough in computing tools triggers panic among educators and practitioners. Sinofsky recalls the introduction of the TI-35, whose advanced capabilities extended only to a percent key and factorials capped at 59 factorial, followed by the moral panic that accompanied the TI-85 graphing calculator. Math teachers despaired that being able to automatically plot $(x, y)$ equations meant the discipline of mathematics was finished, forcing students to complete exams in blue books to prove they were not just punching equations into a device. Yet, as Sinofsky points out, those same educators never questioned calculus itself because it was their inherited baseline:

> “Those people didn't complain about when calculus came out. Because calculus was a baseline to them. And what it is is there's this notion – people react to change more than they react to the baseline of where they all started.”

Casado laughs, admitting that students of his era rarely used the TI-85 for math anyway; they spent their classes writing video games on the devices in the back of the classroom.

- **The Abacus**: Sinofsky's showpiece was bought for approximately 7 cents in a Beijing market. - **The Curta Calculator**: Mid-20th-century Austrian stepped-drum mechanical calculator containing around 600 individual precision parts. - **TI-35 Limits**: One of the earliest classroom scientific calculators, limited to factorials up to $59!$. - **TI-85 Disruption**: Prompted math departments to mandate blue books so students had to show hand-drawn work rather than relying on automatic curve plotting.

---

`17:30` Economic Utility: From Ballistics and Tides to the Cold War Space Race

Tracing the lineage further back, Sinofsky and Casado map the direct line from linear algebra and calculus to Fourier transforms, fluid dynamics, and mechanical difference engines. Casado remarks that early mechanical computers were built out of concrete economic and military necessity: they were designed to evaluate integrals to generate firing tables for artillery and missiles. Sinofsky nuances the history, reminding Casado that the need to predict ocean tides predated military firing tables and carried massive commercial and maritime value.

Those tide-predicting architectures were subsequently adapted for the military during World War II to compute logarithmic firing tables, culminating in machines like the ENIAC. Casado notes that ENIAC operated roughly 5,000 times faster than a human "computer" doing manual arithmetic, and critically, it did not make arithmetic errors. The core question for contemporary AI models, Casado argues, is whether they are simply doing a different flavor of mathematics or actually unlocking an economic bottleneck that has historically blocked human progress.

Sinofsky points out that automating basic calculus for artillery tables directly catalyzed postwar technological leaps, laying the groundwork for the space race, jet propulsion, and automated factories. Crucially, the public and cultural response at the time was celebratory rather than fearful. Parents across the country pushed their children into STEM, urging them to win corporate-sponsored science milestones like the Westinghouse and General Electric math competitions. When Casado asks whether that enthusiasm was purely an artifact of the Cold War, Sinofsky agrees that the geopolitical rivalry played a major role, but emphasizes that it was paired with a genuine cultural optimism about raising humanity's baseline of technical capability.

- **Tide Predictors to ENIAC**: Early difference engines automated maritime navigation tables before being mobilized for military ballistics; ENIAC delivered a 5,000x speedup over human calculators while eliminating computational errors. - **Downstream Unlocks**: Ballistic trajectory computation unlocked the fundamental calculations needed for jet turbine development, space exploration, and industrial factory automation. - **Cultural Optimism**: Post-war computing milestones were met with institutional and parental enthusiasm, exemplified by high-profile feeder programs like the Westinghouse Science Talent Search and the GE math competitions.

`20:00` The 1953 IBM Architecture Brochure and 75 Years of Abstraction

Steven Sinofsky brings out an artifact from his collection: a promotional booklet published by IBM in 1953 titled *Light on the Future*. The brochure dates back to the ENIAC era, predating the IBM 704 and System/370 mainframes, and attempted to introduce the public to what digital computing might become. Its cover art features mid-century nuclear motifs—complete with atomic rings orbiting around a person’s head, a rocket, a test-tube spotlight, and oscilloscope waves. The text begins with the grand declaration that it took humanity millions of years to invent and recognize the utility of the wheel, before walking readers through mechanical slide rules, hex, decimal, binary, and Roman numerals. It even includes a glossary defining terms that were completely novel at the time, such as “arithmetic unit,” “binary digit (bit),” “cathode ray tube,” and “electrostatic storage tube.”

The central revelation in the brochure is a diagram defining the five foundational elements of digital computer organization: input, storage, arithmetic, control, and output. Sinofsky points out that these five pillars governed computer science education and industry specializations for three-quarters of a century. Entire sub-disciplines and academic departments—initially spun out of mathematics programs to support military missile ballistics—formed around each component. Over decades, output evolved from line-oriented teletypes to monochrome CRT monitors, color terminals, and vector graphics, while storage advanced from paper tape and magnetic drums onward, before the disciplines collapsed together into modern systems groups. Martin Casado notes that networking was essentially subsumed into control, adding that by the late 1990s, mandatory networking courses were largely phased out because the transport layer was considered a solved problem, much like transistors had receded into abstraction a generation earlier.

```mermaid flowchart TD accTitle: Classical 1953 Computer Architecture Model accDescr: The five functional units defined in IBM's 1953 brochure that structured computer science abstractions for 75 years.

subgraph Core["1953 IBM Architecture"] IN["Input"] --> CTRL["Control"] CTRL <--> ARITH["Arithmetic Unit"] CTRL <--> MEM["Storage"] CTRL --> OUT["Output"] end

NET["Networking"] -.->|"subsumed into"| CTRL ```

- Sinofsky describes the brochure's cover aesthetic as a stylized vision of science, joking that they are doing a television-style product reveal: “The future of computing is like a guy with like atoms racing around his head.” - The glossary introduced everyday terminology from scratch because the general public had no reference point for bits, CRTs, or digital storage tubes. - Computer science curricula mirrored the hardware breakdown for decades until the low-level physical layers were abstracted away into standard systems engineering.

---

`23:36` Economic Need vs. Pure Problem Solving: From Bletchley Park to AlphaGo

Martin Casado pushes back on viewing computing history solely through shifting abstractions, emphasizing that technological leaps have historically been propelled by urgent economic and existential necessity. At Bletchley Park, the motivation was breaking military ciphers to win World War II; with the ENIAC, engineers and physicists needed automated machines to compute complex ballistic tables and nuclear integrals that took humans weeks to calculate by hand. Because those breakthroughs directly altered the outcome of historical crises, they were universally hailed as triumphs for humanity.

By contrast, modern demonstrations of artificial intelligence tackling abstract domain benchmarks—such as beating grandmasters at chess with Deep Blue, conquering Go with AlphaGo, or solving pure mathematics theorems—frequently leave the public puzzled or ambivalent. When DeepMind debuted AlphaGo, observers struggled to understand its practical utility beyond board game mastery. Sinofsky argues that when people grieve over an algorithm replacing human effort on a specialized puzzle, it often reveals that solving the puzzle had become an end in itself rather than an economic driver: “If you're really, like sad about something being solved maybe it wasn't worth working on to begin with.”

- Historical computing breakthroughs carried unmistakable utility, from cryptanalysis to the Manhattan Project and ballistics calculations. - Pure intelligence benchmarks (chess, Go, Olympiad math) lack the self-evident public necessity of wartime or industrial computing, creating communication gaps between AI researchers and the wider public. - Casado underscores that without an immediate downstream application, people struggle to see why pouring enormous resources into solving formal logic problems represents genuine economic progress.

---

`25:35` Emerging Platforms and Looking for the "Killer App": NeXT and the Internet

Sinofsky and Casado emphasize that platform technologies almost always arrive before their ultimate economic applications are understood. In 1995 and 1996, when the public internet first began spreading, the consensus reaction was confusion over how ordinary people or businesses would actually benefit. Sinofsky references the history detailed in books covering Steve Jobs's post-Apple wilderness years (such as *Becoming Steve Jobs*, drawing on interviews with Ed Catmull and Jobs's inner circle), pointing to the NeXT Computer as the ultimate example of a brilliant machine searching for an application.

When Tim Berners-Lee wrote the initial HTTP protocol and World Wide Web software, he built it on a NeXT workstation, primarily imagining it as a simple utility for researchers to locate colleague phone numbers and exchange academic papers. Around the same time, an early dot-com startup called CyberSlice (referred to colloquially as "Cyber Pizza") built one of the very first online food ordering demonstrations for NeXTSTEP/OpenStep—acting as a proto-DoorDash dedicated exclusively to ordering pizza via local pizzerias. During the live stage presentation, the developers kept backup pizzas behind the curtain in case the network failed. The audience's bewildered reaction underscored the disconnect of early platform eras: viewers marveled at the technology, yet wondered why anyone would replace a simple telephone call with a networked workstation just to order lunch.

- Sinofsky describes himself as an apps-first thinker even within systems: “We're both systems people, but I'm actually an apps person... of course, absolutely think that the way that matters are apps.” - Tim Berners-Lee utilized the NeXT computer's object-oriented software stack to quickly prototype HTTP, though its potential was unrecognized by most hardware buyers at the time. - The NeXT pizza-ordering demo illustrated the frequent absurdity of early application prototypes before consumer broadband, payments, and delivery ecosystems caught up to the software concept.

---

`27:37` The Osborne 1 and the Moral Panic of Harvard Law School Exams

To illustrate how institutional backlash inevitably accompanies disruptions to work habits, Sinofsky presents another physical machine: his personal Osborne 1 from his college days. Introduced in 1981–1982 alongside the CP/M operating system (the intellectual forerunner to MS-DOS), the Osborne was marketed as the world's first portable microcomputer. Despite being called a portable, it was an unyielding 25-pound "luggable" the size of a sewing machine, exceeding standard modern carry-on limits, and featured zero battery life, requiring wall-outlet power at all times. When Erik Torenberg guesses that its battery life was short, Sinofsky points out it had no battery at all.

```mermaid flowchart LR accTitle: Institutional Resistance Cycle to New Writing Technologies accDescr: The progression of exam-taking tools at Harvard Law School from handwriting to typewriters to personal computers, alongside recurring cultural panics.

subgraph ExamEvolution["Harvard Law Exam Tools"] HW["Handwritten Bluebooks"] -->|"Permitted for legibility"| TW["Mechanical Typewriters"] TW -->|"Banned in 1982"| PC["Osborne 1 & Apple II"] end

subgraph RecurringPanics["Historical Analogues"] P1["Graphing Calculators"] P2["Jazz & Rap Music"] P3["AI in Freshman Writing"] end

PC -.->|"Elicited same fear as"| RecurringPanics ```

During Sinofsky's senior year of high school in 1982, word processing was so disruptive that typing on a computer screen seemed unfair compared to using a traditional mechanical typewriter. At Harvard Law School, students had historically been allowed to bring typewriters to final exams so professors could actually read their handwriting. But when two law students walked into an exam room carrying digital computers—one bringing an Apple II and the other lugging an Osborne 1—the administration immediately banned the machines. The incident sparked prominent coverage across *Time* magazine and *The New York Times*, using rhetorical arguments that Sinofsky notes are identical to the moral panics surrounding graphing calculators, jazz, rap music, and current debates over generative AI in college freshman composition courses.

- The Osborne 1 weighed 25 pounds, required continuous AC power, and contained a miniature five-inch monochrome CRT display. - Harvard Law School prohibited personal computers because the ability to edit, backspace, and rewrite electronically was viewed as an unfair cognitive and mechanical advantage over mechanical typewriting. - Sinofsky compares the 1982 law school computer ban directly to the contemporary resistance against students using large language models for introductory essay writing.

`30:00` Abdicating Logic vs. Rising Through Layers of Abstraction

Steven Sinofsky opens with an anecdote from his freshman year in the fall of 1983. He was the only person in his 90-person dormitory with a personal computer and was required to get explicit permission from the dean just to use it to write papers for freshman English. Looking back on how absurd that restriction seems now when no one attends college without a PC, Sinofsky sees current AI anxieties as part of the exact same recurring pattern of moving up a level of abstraction.

```mermaid flowchart LR accTitle: Evolution of Programming Paradigms accDescr: A progression showing how software development moved from imperative recipes to declarative logic and finally probabilistic AI models. subgraph Traditional["Deterministic Systems"] direction TB A["Imperative<br/>(Explicit steps & recipe)"] --> B["Declarative<br/>(Specify end state: SQL, Prolog)"] end subgraph Modern["Probabilistic Systems"] direction TB B --> C["Statistical AI<br/>(Pray to the model god)"] end ```

Martin Casado pushes back on the idea that AI is merely another layer of abstraction. In traditional computer science, software engineers never surrendered reasoning or logic; computing simply provided resources like compute, networking, and storage, while the human architect provided the high-level logic, defined the parameters, and controlled the deterministic setup. Even search engines like Google functioned fundamentally as social indexing tools rather than independent thinkers. With modern generative AI, Casado argues, humans are abdicating actual thinking:

> “I don't think of the history of computer science that I can recall. Have we ever, um, abdicated, um, actual reasoning or logic it's always been a resource right it's been like compute network and storage and like that's what you're providing and then the human is like putting in the high level thing and then it's using the compute network and storage to to like calculate the answer but like all of the kind of initial setup we're providing we're in And I guess maybe it's not true for the internet, but now I feel like you're actually abdicating thinking.”

Sinofsky counters that every major leap in computing capabilities initially felt like illicit cheating because the tool directly answered the exam prompt. When graphing calculators were introduced, they felt like cheating because the exam question was literally "make a graph." He recalls that during his freshman year, symbolic math packages like MIT's Macsyma (developed out of Project MAC starting in the late 1960s and 1970s) began filtering down into education. For freshman engineering calculus, students used muMATH—a version running on the IBM PC. Students would walk over to the engineering library, check out a 5.25-inch PC floppy disk, type their calculus integrals directly into the software, and get immediate answers. While Casado remembers being awestruck by Mathematica ("this stuff is black magic"), he insists there is still a categorical difference between relying on symbolic math libraries where the programmer defines the boundaries and today's paradigm, where correctness and logic are handed entirely over to a third-party black box.

- In fall 1983, Sinofsky had to petition his college dean for permission to type freshman English papers on his personal computer. - Early symbolic computation originated at MIT's Macsyma project before reaching microcomputers as muMATH on the IBM PC, which allowed students to solve calculus integrals automatically. - Casado emphasizes that in traditional programming, the developer chooses libraries, defines inputs, and bounds outputs; with current models, the developer relies on an external entity to supply both the logic and the answer.

---

`33:14` Expert Systems, Prolog, and the Shift to Probabilistic Computing

The debate turns to historical precedents in artificial intelligence, specifically the expert systems boom during the 1980s AI winter. Sinofsky points out that top institutions poured immense resources into expert systems designed to take over human decision-making. Stanford University paired computer scientists with its medical school to build systems for medical diagnosis and chemotherapy planning, while Sinofsky worked on organic synthesis with a team at Harvard. Casado remembers that era well, noting that he wrote substantial amounts of Prolog code and took numerous classes on expert systems, but remarks flatly: "It just didn't work."

```mermaid flowchart TD accTitle: Shift from Algorithmic Logic to Statistical Inference accDescr: Diagram illustrating how developers moved from explicit algorithmic specifications to probabilistic language generation. subgraph Algorithmic["Algorithmic Era (Expert Systems & Prolog)"] A["Human Programmer"] -->|"Specifies rules & goal state"| B["Inference Engine"] B -->|"Deterministic deduction"| C["Verified Result"] end subgraph Statistical["Modern Era (Large Language Models)"] D["Human Prompt"] -->|"Natural language guidance"| E["Statistical Weights"] E -->|"Probabilistic sampling"| F["Generative Answer"] end ```

The crucial distinction, Sinofsky notes, is that modern systems actually do work. Yet Casado points out a deeper structural difference between declarative logic and modern models:

> “Even in the case of Prolog, you're coding it. It's algorithmic. You're still providing the end state and it's just like finding a way to get to the end state where here like you're almost asking what the end state should be.”

Sinofsky observes that societal unease ("the willies") around technological disruptions often reflects transient political and cultural contexts rather than technical reality. For instance, while data center construction currently faces intense local pushback over land and power use, just two years prior governors were aggressively competing to attract those exact same facilities, just as states fought for polluting automotive factories a decade earlier.

Casado refocuses on the computing hierarchy. Throughout their careers, software evolved by climbing layers of a deterministic stack—from transistor logic up to compute, hardware, operating systems, applications, and platforms. Every higher layer could always be mapped deterministically downward. Generative AI breaks that lineage because it is statistical, arbitrary, and probabilistic:

| Programming Paradigm | Mechanism | Programmer Role | |:--- |:--- |:--- | | **Imperative** | Explicit recipes and ordered execution steps | Defines all exact steps to reach the result | | **Declarative (SQL, Prolog, Datalog, Makefiles)** | Search algorithms evaluate logic constraints | Defines the exact end-state criteria; computer searches path | | **Modern Generative AI** | Statistical inference over human language tokens | Supplies natural language prompts ("prays to the model god") |

As Casado summarizes the current interaction model:

> “It's almost like you don't really know what the end state is specifically, and you just kind of like – you kind of like pray to the model god in like the right words, and then it produces the answer that just ends up being useful.”

---

`37:41` Rethinking Fundamental Economics: From Talent Scarcity to Capital Deployment

Erik Torenberg asks what fundamental assumptions need to be rethought if the computing model has genuinely changed. Casado explains that industry veterans have spent four or five decades building battle-tested intuitions regarding system architecture, product distribution, and software economics. Those long-held intuitions are now open questions: Will enduring enterprise value accrue to the foundational models or to the application wrapper layer? What mathematical guarantees can non-deterministic software realistically provide to customers? How does generative output truly impact knowledge worker productivity?

The most jarring shift is the physics of capital allocation in technology startups. Casado highlights how the relationship between capital, engineering headcounts, and infrastructure has fundamentally decoupled:

> “20 years ago, if you're a startup of 10 people and I gave you a billion dollars, what would you do with it? You would end up spending a... a ton of money on building and buying your own computers and things, if that's where you're going. Well, you hire people, you buy computers, you grow up. You wouldn't know what to do with a billion dollars.”

Sinofsky interjects that with $10 million two decades ago, a founder would simply buy hardware servers from Hewlett-Packard and exhaust their budget. But handing an early-stage team $1 billion was unthinkable because progress was strictly gated by how fast humans could architect systems and write lines of code. Today, because engineering constraints can be directly bypassed by renting massive compute clusters to train and run models, capital can be absorbed almost without limit. Large pools of capital are no longer just an operating buffer to pay software engineering salaries; capital itself has become an immediate substitute for raw labor.

`40:00` From Engineering-Bound to Capital-Bound Computing

Martin Casado points out a foundational break in how software development works. Historically, throwing money at software engineering ran into the hard ceiling described in *The Mythical Man-Month*: adding engineers simply slowed things down because human coordination broke under complexity. In AI, however, that dynamic has flipped: “And right now, if I give 20 people a billion dollars, they can actually use it usefully.” Casado observes that this marks a shift from computing being an engineering-bound problem to becoming a capital-bound problem, which upends long-held intuitions about innovation, competition, and defensibility. Steven Sinofsky agrees, noting that computing was actually capital-bound during its first three to four decades—when the gating item was simply whether an organization had the funds to acquire an elusive mainframe or minicomputer. Sinofsky jokes about an episode of *Mad Men* where a massive computer arrives at the advertising agency, leaving staff scrambling to explain what it actually does while celebrating that they had the capital to buy it in the first place.

Erik Torenberg mentions Patrick Collison interviewing Sam Altman roughly five years prior, contrasting the prevailing lean startup doctrine with Altman’s colossal upfront funding rounds for OpenAI, energy ventures, and anti-aging companies. Casado recalls the ideological clash between Eric Ries’s *The Lean Startup* and Ben Horowitz and Marc Andreessen’s counter-thesis on the "fat startup." While companies previously raised huge sums, engineering complexity remained an unyielding natural limiter. With AI, capital can now be deployed productively into raw compute rather than trapped in administrative bloat. Casado reflects on his own decade-long role as an investor: “I'm telling you, yeah, my 10 year job, you know, was recruited and giving, yeah, it was like literally giving these early teams money and then helping them accrue and then watching and waiting for two years.”

```mermaid flowchart LR accTitle: Evolution of Computing Constraints accDescr: Historical progression from capital-bound mainframes to engineering-bound software and back to capital-bound AI. subgraph Era1["Early Computing (1950s–1980s)"] A["Capital-Bound: High cost of mainframe hardware"] end subgraph Era2["PC & Internet Era (1990s–2010s)"] B["Engineering-Bound: Mythical Man-Month & talent coordination"] end subgraph Era3["Modern AI Era (2020s+)"] C["Capital-Bound: Raw compute, model training & token scaling"] end Era1 --> Era2 Era2 --> Era3 ```

- Early computing was primarily gated by the capital required to purchase physical mainframes before transitioning into decades of engineering and headcount bottlenecks. - The shift to capital-bound AI means small, lean teams of twenty people can effectively absorb and utilize hundreds of millions or billions of dollars in compute.

`42:47` Challenging Zero-Sum Venture Thinking and Expanding Private TAM

Casado addresses the persistent complaint among venture capitalists over the last decade that "too much capital" has flooded the ecosystem and is chasing too few deals. He argues that this reveals an absurdly zero-sum mindset among people whose entire profession is supposed to be predicated on positive-sum economic expansion: “The more capital that flows into private markets, the larger the market gets.”

Casado explains that this expansion happens for two core reasons: 1. Emerging technological waves like AI genuinely have the capacity to absorb vast amounts of capital productively. 2. Abundant private capital allows companies to stay private far longer, causing an enormous share of total enterprise value to accrue within private markets rather than public exchanges.

Because capital expands the total addressable market (TAM), Casado argues early-stage investors must abandon the scarcity mindset and recognize that capital availability itself alters the size and structure of the opportunity set.

`44:07` Unlocking Software for the Long Tail of Unserved Domains

Sinofsky connects the infusion of capital directly to an impending wave of specialized software applications. Because founders no longer need to spend a decade acting primarily as recruiters just to ship a product, software can finally penetrate industries that have historically been neglected. He highlights medicine and law as prime examples, noting the paradox of a world where people are generally skeptical of technology yet universally celebrate the prospect of automating legal workflows: “Like nobody has cheered more that, oh, my God, we're finally able to automate lawyers with AI, which is the weirdest thing in a world where everybody is against everything.”

In the previous venture paradigm, a founder with twenty years of deep domain experience—such as commercial real estate—had to find a technical co-founder, teach them the nuances of the business, and spend years manually building basic infrastructure. Today, that translation gap has become a solvable capital problem as abstraction layers rise. Sinofsky recalls his very first customer visit as a young, twenty-year-old product developer, meeting a doctor who had majored in early computer science before entering medical school: - The physician spent years writing his own DOS-based scheduling software from scratch. - The tool was not merely a simple calendar grid; it dynamically parsed the scheduler's intake phone call. - The software listened for specific medical keywords to determine whether a visit needed five or twenty minutes, and concurrently booked parallel resources like blood draws, EKG monitors, and X-ray rooms.

Sinofsky points out that whereas developers decades ago had to construct their own primitive UI controls, text boxes, and scheduling logic from scratch, rising abstraction layers—across mobile operating systems and modern AI models—mean domain experts can solve complex industry problems without writing throwaway boilerplate code.

`47:11` Reevaluating the Incumbent's Dilemma in the Age of AI

The discussion shifts to how AI upends traditional advantages held by tech giants over emerging startups. Casado admits that had he been asked six months prior, he would have repeated standard business doctrine: incumbents possess unassailable advantages in distribution, cash flow, and capital reserves. In the AI wave, however, that playbook has faltered: “And like, what's crazy is AI, A, solves the distribution problem. It solves the demand problem. And B, these companies are able to raise so much money that they're actually on competitive footing with the Microsofts and the Meta companies.”

Casado explains that distribution has historically been a brutal trial-and-error process for startups, requiring heavy investments in sales and marketing with unpredictable returns. In AI, aggregate market appetite for tokens and compute is effectively bottomless, allowing high-velocity companies to convert capital directly into top-of-funnel capacity and explosive growth. This dynamic explains the unprecedented trajectory of companies like Cursor, Anthropic, and OpenAI, which have achieved parity with incumbent balance sheets at staggering speeds.

Sinofsky reflects on his career overseeing thousands of engineers at Microsoft, where managing immense human coordination was itself the moat protecting massive systems like Windows. Casado jokes about the rare engineering legends who could bend that reality, asking, “You have to have one Cutler? Is that the...”, referencing Dave Cutler’s central role in building Windows NT. Sinofsky laughs, noting that while Cutler was brilliant, even NeXT had to bootstrap itself off the Mach kernel from Carnegie Mellon rather than starting from zero, as detailed in books covering Steve Jobs's wilderness years.

Concluding on Clayton Christensen’s disruption theory, Sinofsky recalls a running joke from Harvard Business School during Christensen's tenure: “There was an old joke at Harvard Business School when Clay was still with us, which was they really – it's weird that they teach disruption as a theory in the business school when really it should just be a fact in the physics department.” Sinofsky reflects that big company executives always harbor the illusion that they will easily crush agile new entrants, yet incumbents rarely manage to wipe them out because startups inevitably avoid direct head-to-head collisions and attack entirely unserved vectors.

`50:00` Incumbent Culture, Disruption, and the Capital-Driven Shift

```mermaid flowchart TD accTitle: Evolution of Tech Shifts from Engineering to Capital Scale accDescr: Diagram tracing the historical progression from proprietary systems to cloud abstractions, ending in capital-scale foundation models. subgraph Traditional["Systems & Cloud Era"] A["Custom Hardware & OS\n(Soul of the New Machine)"] --> B["Cloud Infrastructure\n(Distributed Systems & Hyperscale)"] B --> C["Startups Build on Oligopoly\n(Accept AWS / Azure Core)"] end subgraph Modern["Foundation Model Era"] D["Capital Access & Compute Scale"] --> E["Direct Challenges to Big Tech\n(OpenAI & Anthropic vs. Google)"] F["Big Tech Cultural Inertia\n(Sales quotas, legacy margins)"] -.->|Hobbles Incumbents| E end ```

The dynamics of disruption are dictated not by what startups do, but by the rigid cultural mechanics of large companies. Big tech incumbents focus almost exclusively on other incumbents—Microsoft worries far more about Amazon and Google than any startup. Large companies are governed by organizational laws of physics that cannot simply be altered: field sales compensation, organizational structures, legacy customer commitments, and quarterly scorecards. When an enterprise has 500,000 active customers to serve, there are entire categories of tactical moves it simply cannot make without breaking its business model.

During the rise of cloud computing, infrastructure abstraction eliminated the need for startups to build their own data centers, install egress networking, or negotiate contracts with telecom carriers like AT&T. Startups accepted the hyperscale cloud oligopoly and built applications on top, always worrying whether an incumbent like Microsoft would roll their feature into the core platform for free. The model era has inverted this relationship: startups are directly attacking the incumbents. Historically, computing was defined by massive engineering feats—depicted in Tracy Kidder's classic book *The Soul of the New Machine*, or the distributed systems breakthroughs built by Jeff Dean and Google's infrastructure engineers. Today, building frontier AI models is no longer an insurmountable engineering problem reserved for hyperscalers; it is primarily driven by access to capital. As Steven Sinofsky emphasizes:

> “The elements of disruption that matter are the cultural ones of being a big company, and those are constant.”

- Incumbent vulnerability stems from culture: Google has unmatched data, deep research talent, and exceptional infrastructure like GCP, yet its models are getting trounced by OpenAI and Anthropic because large corporate structures struggle to navigate tectonic shifts. - Big tech earnings calls reflect mounting consternation over massive capital expenditures, leading to creative financial maneuvers, such as Google using off-balance-sheet bond financing. - Token rationing within big tech has caused internal friction: enterprise customers receive priority token allocations, leaving internal product teams compute-starved while their startup competitors operate unconstrained.

---

`53:30` Intel, ARM, and the Blindness to Architectural Shifts

Steven Sinofsky recounts his firsthand experience trying to prevent Microsoft from getting disrupted by mobile computing and ARM architecture. During the development of the original Microsoft Surface, Sinofsky traveled down to Silicon Valley to meet the leadership team at Intel. He sat across the table, pulled the new Surface computer out of his bag, and showed it to them. The Intel executives were initially excited until they asked what processor powered the machine. When Sinofsky replied that it was running an ARM chip, the reaction was sheer disbelief and resistance; Intel's culture viewed ARM as an underpowered component meant for printers, not real personal computers.

Intel's executives insisted that they were ARM licensees who already understood the architecture, dismissing the value of power efficiency, mobile graphics, and always-on connectivity. Their identity was entirely anchored in advancing Moore's Law on x86, just as Google's identity is anchored in hyperscale web architecture. When computing shifts away from a company's cultural core—such as AI moving to on-device processing rather than hyperscale server farms—the incumbent is structurally ill-equipped to follow. Today's venture capital climate differs from past cycles because investors no longer view founders raising massive sums to battle the incumbents as delusional; the capital inversion makes massive funding rounds for foundation models entirely viable.

> “I sat across the table from all the Intel leadership, and I pulled out the first Surface. And I said, here's our new computer. And they got very excited. And then they were like, but what's in here? I said, well, it's an ARM chip.” — Steven Sinofsky

---

`55:00` The Unknowable Power of a $20 Billion Digital Artifact

Martin Casado reflects on an earlier podcast appearance by Vishal, who was skeptical about language models generating genuine novel scientific discoveries because of their statistical limitations. Mechanically, the behavior of these systems is understood: they are trained on datasets, operate in-distribution, traverse latent manifolds in a Bayesian fashion, lack true transfer learning, and do not represent a "fast takeoff" toward the singularity. However, Casado argues that human intuition breaks down when trying to conceptualize a digital artifact forged with unprecedented capital and compute.

Never before in human history has a single software artifact absorbed tens of billions of dollars, immense compute clusters, and quadrillions of FLOPs. While the mechanical boundaries of training appear well-defined, no one can accurately extrapolate what latent capabilities emerge from that degree of scale. Rather than debating theoretical cognitive architectures, the discourse has transformed into an empirical question about meta-economic machinery: what happens when an entity like Anthropic raises billions of dollars and pours that capital directly into massive compute? Casado notes that even if the machine is merely interpolating within vast distributions, having that much aggregated data and compute might allow it to effectively solve problems as complex as curing diseases, rendering prior mental models obsolete.

> “I think it's just so hard for a human being to reason about a digital artifact, in this case the model, that was built with $5 billion.” — Martin Casado

- Predicting technological outcomes is notoriously unreliable; Sinofsky recalls authoring 58 internal memos forecasting the future of the internet, admitting he was ultimately wrong on many of them. - The sheer financial scale of training runs introduces emergent possibilities that invalidate standard human extrapolation about software limits.

---

`58:30` AI in Biomedicine and the Bottlenecks of Drug Discovery

Steven Sinofsky shares observations from his own household, where his partner is a research physician using AI to analyze brain imaging and neurosurgical problems. At home, they run an NVIDIA DGX Spark workstation (clarifying with Martin that it is NVIDIA hardware, not a vintage Sun Microsystems SPARC station from the Scott McNealy era). The system processes thousands of medical research papers, parsing patterns across massive literature corpuses that human clinical experience could never synthesize alone. This capability uncovers novel research hypotheses, diagnostic vectors, and structural patterns that previously went unnoticed.

Sinofsky cautions that these pattern-recognition abilities should not be confused with an instant cure for diseases or an automated drug-discovery pipeline. In pharmaceutical development, producing prospective drug candidates has never been the actual bottleneck; computational and biochemical methods have generated more viable molecular candidates than could ever be evaluated since the 1980s. The true, agonizing constraint of drug development is human clinical trials, where determining biological efficacy and patient safety takes years of rigorous testing that software alone cannot shortcut.

> “It sees the patterns that only experience could tell somebody. But if there's 10,000 papers on a topic that's part of her model, then it's just finding the patterns that no one has.” — Steven Sinofsky

- AI excels at surfacing complex correlational patterns across tens of thousands of dense medical research papers beyond human cognitive throughput. - The fundamental bottleneck in medicine remains physical and regulatory: proving efficacy and safety in human patients, not identifying molecular candidate compounds.

`01:00:00` Rethinking Bostrom's Takeoff: AI as a Capital-Concentration Machine

Reflecting on how his perspective has shifted over time, Martin Casado revisits the philosophical AI debates inspired by Nick Bostrom. Early AI safety anxieties frequently centered around recursive self-improvement and the concept of an intelligence explosion or "fast takeoff," where an algorithm improves itself in a runaway loop without human intervention. Casado admits he originally dismissed that scenario: “I was responding to this Bostrom notion of recursive self-improvement, fast takeoff. You create one of these things, you step back and it takes over the world. Right. And so I kind of pooh poohed that because that's clearly not what's happening.” While most practitioners now agree that pure algorithmic self-enhancement is not the dynamic driving progress, Casado acknowledges that his initial skepticism missed something far more real and transformative: the sheer durability of empirical scaling laws.

Casado points out that the real surprise of modern foundation models is that pouring raw capital into compute continues to yield reliable capability gains without hitting a hard wall. “What I got wrong is... I did not know that we could effectively just continue to pour money in this. Like, the scaling laws are holding,” he observes. He raises the question of what happens when society reaches a single $100 billion training run funded by meta-economic machinery. That unprecedented scale of investment could just as easily be channeled toward curing cancer or manufacturing catastrophic automated weapons. For Casado, the debate should pivot away from speculative sci-fi doomsday narratives toward the concrete reality of unprecedented resource concentration: “And so this... concentration of this many resources in a useful way, I think, is very new. I don't think we understand the implications. I think you could reasonably argue that that's very dangerous if you kind of apply that $100 billion in the wrong way. So I think that's kind of where this conversation needs to evolve. two, so less the foom, you know, and more the what does it mean to be able to concentrate resources?”

```mermaid flowchart TD accTitle: AI Progress Paradigms accDescr: Contrasting Bostrom's recursive takeoff model with the modern capital-driven scaling model. subgraph Bostrom["Bostrom Takeoff (Theoretical)"] A["Single AI Model"] -->|"Recursive self-improvement"| B["Autonomous Intelligence Explosion"] B -->|"Runaway loop"| C["Fast Takeoff / World Takeover"] end subgraph CapitalScale["Capital Scaling (Observed Reality)"] D["Meta-Economic Capital ($100B+)"] -->|"Massive compute clusters"| E["Empirical Scaling Laws"] E -->|"Brute-force parameter search"| F["Finite Solution Spaces (Proteins, Code, Weapons)"] end ```

`01:01:25` Converting Infinite Problems into Capital Problems

Steven Sinofsky frames this dynamic as another manifestation of exponential growth, but with a crucial twist: it is an exponential curve denominated directly in capital. “I mean, you're basically talking about exponential growth. And this is just exponential in dollars. And we all know none of us can model exponential very well,” Sinofsky explains. Historically, pouring billions of dollars into a complex software or engineering project never guaranteed a linear—let alone exponential—leap in capability; throwing massive budgets at traditional engineering often introduced organizational drag rather than solving the underlying technical bottleneck. Sinofsky recalls sitting in enterprise hardware briefings during the PC revolution where vendors continually pushed raw specs without clear demand: “But I remember just sitting and meeting after meeting, Intel saying we have five gigahertz, we have this many gigahertz, this many transistors. And literally, nobody knows what we're going to do with them all.”

The breakthrough in the current AI era is that the architecture can directly absorb and convert capital into useful capability. Casado emphasizes that domains that once appeared intractable due to combinatorics can now be brute-forced if you have sufficient compute: “if you're like i want to exhaustively explore every protein combination right we can just turn that into a money problem.” The hosts agree that this fundamentally changes the economics of technology: problems that used to be considered functionally infinite engineering hurdles have been transformed into solvable, finite expenditures of balance-sheet capital. The group wraps up the conversation on this realization before transitioning into the closing podcast credits.

- Martin Casado highlights that the primary risk is not Bostrom's runaway algorithmic "foom," but the unprecedented societal and geopolitical power concentrated in $100 billion computational training runs. - Traditional software and hardware scaling previously suffered from diminishing returns or unutilized capacity (such as Intel pushing gigahertz and transistor counts beyond what software could immediately exploit), whereas modern transformer models seamlessly convert added compute into problem-solving capability. - Deep-learning scaling effectively transforms combinatorial scientific bottlenecks—such as exhaustive protein folding exploration—from open-ended engineering barriers into finite capital allocation equations.

## Notable quotes > `50:00` The elements of disruption that matter are the cultural ones of being a big company, and those are constant. — Steven Sinofsky

> `00:00` Right now, if I give 20 people a billion dollars, they can actually use it usefully. We've kind of moved the industry from like this engineering bound problem to a capital problem that's fundamentally very different. — Martin Casado

> `55:00` I think it's just so hard for a human being to reason about a digital artifact, in this case the model, that was built with $5 billion. — Martin Casado

> `42:47` The more capital that flows into private markets, the larger the market gets. — Martin Casado

> `15:00` People react to change more than they react to the baseline of where they all started. — Steven Sinofsky

> `23:36` If you're really, like sad about something being solved maybe it wasn't worth working on to begin with. — Steven Sinofsky

## Mentioned Amazon, Amazon Web Services (AWS), Anthropic, Apple II, ARM, AT&T, Becoming Steve Jobs, Ben Horowitz, Bletchley Park, Carnegie Mellon University, Clayton Christensen, Concrete Mathematics, CP/M, Cursor, Curta calculator, CyberSlice, Dave Cutler, Deep Blue, Ed Catmull, ENIAC, Eric Ries, Erik Torenberg, General Electric, Google, Harvard Business School, Harvard Law School, Hewlett-Packard, IBM, IBM 704, IBM PC, IBM System/370, Intel, Jared Sumner, Jeff Dean, John Hopcroft, Light on the Future, Macsyma, Marc Andreessen, Martin Casado, Mathematica, Meta, Microsoft, Microsoft Azure, Microsoft Surface, muMATH, NeXT, NeXT Computer, Nick Bostrom, NVIDIA DGX Spark, OpenAI, Osborne 1, Patrick Collison, Project MAC, Prolog, Sam Altman, Scott McNealy, Steve Jobs, Steven Sinofsky, Sun Microsystems, The Lean Startup, The Mythical Man-Month, The New York Times, The Soul of the New Machine, TI-35, TI-85, Tim Berners-Lee, Time magazine, Tracy Kidder, Westinghouse Science Talent Search, Windows NT

## Video description a16z General Partners Martin Casado and Erik Torenberg are joined by Board Partner Steven Sinofsky to explore what recent breakthroughs in AI and mathematics tell us about where the technology is headed, and whether some of the basic assumptions that have governed computing for decades are starting to break. Martin and Steven debate whether AI's progress in mathematics represents a genuine leap in reasoning or simply a new tool for solving problems at a higher level of abstraction. From the four-color theorem and early computers to graphing calculators and today's models, they trace how new technologies have repeatedly changed which problems humans need to solve themselves, and ask what makes this moment different. The conversation then turns to one of the biggest shifts in AI: problems that were once constrained by engineering talent can increasingly be attacked with capital and compute. They discuss what that means for startups versus incumbents, venture capital, the coming wave of AI applications, and why pouring billions into increasingly capable models may force us to rethink what these systems can ultimately accomplish.

[Source](https://mgln.ai/e/1344/afp-848985-injected.calisto.simplecastaudio.com/3f86df7b-51c6-4101-88a2-550dba782de8/episodes/038a6355-dd87-461a-84db-419d4c3f2643/audio/128/default.mp3?aid=rss_feed&awCollectionId=3f86df7b-51c6-4101-88a2-550dba782de8&awEpisodeId=038a6355-dd87-461a-84db-419d4c3f2643&feed=JGE3yC0V)

中文简报

Casado与Sinofsky指出:算力正将软件瓶颈转化为资本问题 由于AI能够直接将算力转化为解决问题的能力,且无需承担大型工程团队的协作损耗,小型初创公司已能够调动数十亿美元资本来挑战大型科技巨头。 Martin Casado与Steven Sinofsky通过对比从机械计算器、四色定理、早期个人电脑到生成式大语言模型等历史里程碑,探讨了现代人工智能的变革本质。他们认为,计算已从受制于人员规模的工程受限范式,转向小团队即可直接且高效将数十亿美元投入算力的资本受限范式。尽管Sinofsky强调每一代技术进步都只是替代了重复的基础任务,但Casado质疑将逻辑与推理委托给概率模型是否打破了历史上的计算谱系。最终,他们分析了这种前所未有的资本吸收能力如何重塑初创公司与行业巨头之间的竞争格局,使得大规模组合问题仅凭持续的资金投入即可迎刃而解,而不再完全依赖算法上的突破。 计算已从受开发者协作制约的工程受限范式,根本性地转变为小团队即可直接且高效地将数十亿美元投入计算集群的资本受限范式。 (0:00) 与以往在保留人类逻辑的同时抽象化机械执行的历史计算层不同,生成式AI通过将实际推理、逻辑和最终状态定义委托给概率模型,打破了确定性软件的谱系。 (30:00) AI初创企业正在绕过传统的企业颠覆壁垒,无需建立庞大的运营团队即可在资产负债表规模上与老牌巨头平起平坐,并实现直接触达客户的分发能力。 (47:11) 灾难性AI风险应重新审视:不应聚焦于Nick Bostrom提出的递归自我改进“快速爆发”场景,而应关注单次前沿模型训练耗资千亿美元所引发的地缘政治与市场权力集中。 (60:00)

Reading summary

Martin Casado and Steven Sinofsky argue that artificial intelligence has inverted computing from an engineering-constrained discipline into a capital-bound one. Rather than software development being gated by human talent and organizational coordination, raw capital can now be deployed directly into compute, overturning long-held assumptions regarding startup scaling, software abstraction, and incumbent defensibility. Capital Replaces Headcount in Software Development (40:00) Historically, software engineering hit a hard coordination ceiling governed by The Mythical Man-Month: adding developers to a complex project introduced communication overhead that slowed progress rather than accelerating delivery. Casado observes that modern foundation models break this limitation; an early-stage startup of twenty people can now productively absorb $1 billion directly into compute clusters. While early computing in the 1950s was similarly capital-bound due to the physical costs of mainframes, the modern AI shift decouples software development from human recruiting cycles. This capital elasticity alters startup economics and venture dynamics. Rather than using capital solely as a runway buffer to fund engineering payroll over years, modern AI startups like OpenAI, Anthropic, and Cursor transform capital directly into raw compute and token throughput, achieving parity with incumbent balance sheets at unprecedented speeds. Probabilistic Inference Breaks the Deterministic Stack (30:00) For three-quarters of a century, computing progressed by ascending layers of deterministic abstraction. As Sinofsky illustrates through IBM's 1953 architecture brochure—which established input, storage, arithmetic, control, and output—engineers historically provided explicit system logic while machines executed deterministic operations. Even declarative systems such as SQL, Prolog, and 1980s expert systems required human programmers to define exact boundary conditions and goal states. Casado emphasizes that modern generative AI fundamentally departs from this deterministic heritage. Instead of engineers constructing verifiable, rules-based logic downward through the stack, large language models operate via statistical inference over human language tokens. Developers no longer provide rigid algorithmic parameters; they supply natural language prompts to a probabilistic model, surrendering deterministic execution in exchange for broad, statistical utility. Incumbent Cultural Inertia and Startup Parity (50:00) Incumbent tech giants typically rely on massive distribution networks, established sales forces, and strong cash flows to neutralize emerging startups. However, Sinofsky and Casado argue that large companies are constrained by organizational physics, such as sales commission structures, legacy scorecards, and internal token rationing that starves internal product teams to satisfy commercial cloud commitments. Sinofsky compares this institutional blindness to Intel dismissing ARM architecture during the development of Microsoft's original Surface because it did not align with Intel's x86 identity. Because the AI wave solves traditional distribution and demand bottlenecks through bottomless market appetite for compute, well-funded startups can bypass traditional sales cycles. Unprecedented access to private capital enables smaller teams to operate without the cultural inertia, margin defense, or legacy product commitments that hobble incumbents. Empirical Scaling Over Autonomous Takeoff Theories (60:00) Casado and Sinofsky caution against assuming that AI mastering closed, axiomatic domains—such as pure mathematics or games like AlphaGo—means it can seamlessly predict the physical world from first principles. Just as the 1976 proof of the four-color theorem required brute-force combinatorial compute rather than analytical deduction, physical simulations rely on empirical equations of state. Similarly, Sinofsky notes that while AI can identify literature patterns for biomedical research, drug development remains gated by the physical and regulatory constraints of human clinical trials. Consequently, Casado reassesses artificial intelligence safety debates: the real shift is not Nick Bostrom's speculative, recursive algorithmic "fast takeoff," but the durability of empirical scaling laws. Pouring tens of billions of dollars into compute turns combinatorial scientific bottlenecks into finite capital-allocation problems, concentrating unprecedented power in massive, capital-backed digital artifacts. Casado and Sinofsky conclude that as foundation model investments expand toward potential $100 billion training runs, computing functions primarily as a capital-concentration mechanism. However, whether sheer computational scaling can bridge the divide between statistical pattern synthesis and computationally irreducible physical phenomena remains an unresolved question.

精炼阅读摘要

Martin Casado 与 Steven Sinofsky 提出,人工智能正在驱动计算产业发生根本性的经济学逆转:软件工程已从受制于人力协同与“人月神话”的工程约束问题,转变为可由巨额资金直接兑换算力与产出的资本密集型问题。这一转变重塑了颠覆创新的发生机制,同时也引发了关于人类是否正在让渡底层逻辑思考、以及形式公理推理能否真正跨越物理现实约束的深刻分歧。 软件经济学逆转:从工程人才瓶颈到资本吸收机器 (40:00) Casado 指出,过去数十年软件行业始终受到《人月神话》所揭示的规律制约:给早期工程团队投入过多资金往往无法成倍加速交付,反而会因复杂的沟通与协作成本拖慢进度。然而在现代 AI 生态中,给一支仅有20人的小团队注入10亿美元,团队能够立即将其全额转化为可用算力并产生实用产出,如 Cursor、Anthropic 和 OpenAI 的爆发式增长所示。计算模式由此从早期的主机资本约束,历经数十年的工程人才约束,最终重新回到了资本驱动阶段。 Casado 进一步反驳了风险投资领域所谓“资本过剩追逐过少项目”的零和观点。他认为,AI 具备前所未有的资本吸收能力,充沛的私人资本让高估值企业能够长期保持私有化状态,从而使得大量企业价值直接沉淀在非公开市场中。资本的规模化注入实质上扩大了潜在市场总额(TAM),使得巨额资金不再只是支付研发薪酬的运营缓冲垫,而是直接转变成替代底层工程劳动的生产要素。 形式公理与物理现实脱节:数学解题不等于商业价值 (3:00) 针对当前学术界和公众对大语言模型攻克复杂数学定理的热潮,Casado 提出了审慎的经济效用评估。他认为,许多长期未解的纯数学学术难题,其数十年来消耗的博士后研究经费总和微乎其微;这些问题之所以未被攻克,往往是因为缺乏明确的商业回报驱动,而非代表着阻碍社会生产力跃迁的重大技术路障。LLM 极度擅长在自洽的封闭规则体系内进行跨领域的公理综合,这与成为顶尖的星际争霸玩家类似,但不能直接证明其具备解决现实市场痛点的能力。 此外,Casado 结合过去大型科学模拟(如恒星爆炸或空气动力学风洞)的工程经历指出,真实的物理系统计算往往是计算不可简化的,高度依赖实测的经验状态方程,而非纯粹的闭式数学推导。因此,“攻克数学即能预测一切现实”在逻辑上存在巨大跳跃。Sinofsky 同样以医学研究为例指出,AI 虽能在居家工作站上高效综合上万篇论文并发现隐蔽的病理关联,但制药产业真正的瓶颈始终在于耗时数年的人体临床试验与安全性验证,而非前端候选分子的计算生成。 计算抽象的历史演进:从辅助工具到认知思考让渡 (30:00) Sinofsky 梳理了计算工具的历史演进,展示了从传统算盘、拥有约600个精密零件的 Curta 机械计算器,到1953年 IBM 确立输入、存储、运算、控制和输出五大要素的计算架构,再到1981年重达25磅的 Osborne 1 微型电脑。他强调,技术工具在跃迁时总会引发周期性的社会恐慌:从 TI-35 和 TI-85 图形计算器引发教育界强制要求手算绘图的“蓝皮书”规定,到1982年哈佛法学院禁止学生携带微机参加考试,既得认知范式对效率工具的抵触屡见不鲜。 然而 Casado 强调,当前的生成式 AI 并不能单纯等同于历史上另一层常规的软件抽象。在以往从命令式代码到 SQL 或 Prolog 等声明式逻辑的发展中,人类开发者始终严密控制着输入边界、目标终态与确定性推理规则,计算仅作为算力、存储和网络的资源支撑。生成式 AI 则是纯粹的概率统计推断,开发者在缺乏明确过程控制的情况下向模型输入提示词并“向模型之神祈祷”,这在计算历史上首次体现为人类将实际的逻辑推理与思考过程全面让渡给不可解释的黑盒系统。 在位巨头的组织重负与初创企业的颠覆新动能 (50:00) Sinofsky 与 Casado 探讨了克里斯坦森颠覆创新理论在 AI 时代的适用性。Sinofsky 认为,大企业往往并非被初创公司的技术直接击垮,而是被自身的组织物理学机制所绑架:现任巨头受困于庞大的既有客户承诺、销售配额激励机制与既得利润率诉求,往往将全部注意力集中于同体量的竞争对手(如微软盯防亚马逊和谷歌)。这种惯性在历史上屡见不鲜,正如英特尔高管曾因过度自信于 x86 架构与摩尔定律,而将 ARM 处理器轻视为主机外围设备的低端芯片。 在生成式模型时代,这一组织负重正在削弱巨头传统的分发优势。例如,谷歌尽管拥有无可匹敌的数据沉淀、顶尖算法人才和自研云基础设施,却在模型竞争中受到严密组织架构的掣肘;其内部计算资源必须优先保证外部大客户的 Token 配给,反使自身产品团队陷入算力饥渴。与此同时,外部市场对模型算力的需求近乎无限,初创企业得以跨越艰难的分发试错期,凭借巨额外部融资迅速获得与巨头平起平坐的算力底座,开辟出传统巨头无法迅速跟进的非正面对抗航道。 资本规模化取代算法起飞:千亿美元数字造物的未知边界 (60:00) 对话重新审视了 Nick Bostrom 关于超级智能通过递归自我改进实现“快速起飞”(foom)的末日预言。Casado 承认自己早期对该假说的怀疑是正确的,因为 AI 并没有展现出脱离人类干预的失控自我迭代代码能力;但他同时坦言低估了实证“缩放定律”(Scaling Laws)的持久生命力——单纯通过工程化地向算力堆砌天量资本,模型的综合能力依然能够维持稳定提升,并未过早触碰收益递减的死墙。 Sinofsky 与 Casado 一致认为,技术界必须将关注焦点从科幻式的算法失控,转移到现实中前所未有的“资本超高度集中机制”。以往硬件和软件升级常面临算力过剩却缺乏应用场景的困境,而 Transformer 架构能够完整吞吐巨额资本并将其转化为解题能力。当企业斥资数十亿乃至未来数千亿美元训练单一数字人工物时,蛋白质折叠等原本看似无限维度的组合工程难题被降维为有限的资产负债表资本消耗,而全社会目前仍缺乏有效评估和理解这种超大规模资本造物潜在力量的心智模型。 本期节目确立了一个核心论点:AI 正在将历史上依赖长期人才协同与工程试错的复杂难题,重构为一种由算力吸收天量资金的资本密集型产业。然而,两位嘉宾留下的关键未决问题在于:这种高度依赖资本规模化的概率系统,能否真正突破现实物理世界不可简化的经验边界,而当单次模型训练成本跃升至千亿美元量级时,这种前所未有的资源集中将如何重塑全球技术权力结构。

Detailed notes — zh

## Background 本期节目由 a16z 普通合伙人 Martin Casado、Erik Torenberg 以及投资合伙人 Steven Sinofsky 主持与对谈,于 2026 年 8 月 25 日通过 RSS 及播客平台发布。节目围绕近期 AI 在前沿数学领域取得的突破展开,深入探讨了这些进展是否颠覆了统治计算机领域数十年的基础假设,以及技术范式转移对未来计算与经济格局的深远影响。 ## TL;DR 对话从 AI 尝试证明复杂数学猜想的争议切入,回顾了从算盘、机械计算器、四色定理证明到图形计算器的工具演进史,剖析了数学与计算不断向上封装抽象层的本质规律。Martin 与 Steven 尖锐指出,当前行业最根本的质变在于计算规律从过去的“工程受限”彻底倒挂为“资本受限”,几十人的小团队如今能有效利用数十亿美元算力直接驱动模型能力的指数级跃迁。这种范式颠覆了大厂传统的渠道与工程护城河,让此前看似无限复杂的科学难题直接转化为可由资本砸开的有限问题,但也引发了关于资源极限集中与技术不可预测性的全新反思。 ## Atmosphere & style 整场对话洋溢着硅谷老兵与系统先驱特有的极客浪漫与冷峻思辨,既有 Steven Sinofsky 现场拿出算盘、1982 年 Osborne 电脑和 Curta 机械计算器时的怀旧幽默,也有面对时代剧变时的清醒自嘲。两位嘉宾在技术狂热与商业实用主义之间反复拉扯,从早年编译代码的微观痛点一路延展至百亿美元人造物的哲学深水区。整期讨论节奏张弛有度、视野宏大,听众仿佛置身于一场连接半个世纪计算文明史与当下最前沿 AI 巨浪的高密度脑力激荡之中。 ## Bulletin - `00:00` 软件行业正经历底层规律质变,从过去受制于人才招募与沟通成本的“工程受限”模式,彻底转变为依赖巨额算力投入的“资本受限”模式,精简团队调度数十亿美元直接转化为生产力成为现实。 - `50:00` 传统巨头受制于组织架构、考核指标及庞大存量客户的文化包袱,在 AI 浪潮中难以敏捷调配算力,使 OpenAI、Anthropic 等初创团队得以直接在正面战场与其并驾齐驱。 - `05:00` 纯数学领域对 AI 的热衷源于其公理化闭环特性与层层抽象属性,AI 承担了繁琐的底层符号推演,成为研究者迈向更高理论维度的新型抽象工具,重演了当年计算机辅助证明四色定理的历程。 - `01:00:00` 随着扩展律(Scaling Laws)在资本灌注下持续生效,原本看似无限复杂的科研难题(如穷尽蛋白质折叠)正被直接折算为可解的“资金问题”,单次耗资数百亿至千亿美元的训练运行正在重构科技创新的本质法则。 ## Key takeaways - `00:00` 传统软件工程受《人月神话》限制,无法通过无脑堆砌资金线性换取交付速度,而现代大模型能直接将天量资本转化为有效计算与智能跃升。 - `01:25` 公众往往担忧 AI 会淘汰特定群体引发失业,但一线纯数学家反而最感兴奋,因为 AI 帮其接管了枯燥的底层符号演算,构建起全新的理论研究抽象层。 - `02:50` 攻克百年纯数学谜题未必能带来直接的商业红利,数学领域在历史上缺乏商业资本驱动,且具备纯公理闭环与规则明确的特征,本质上极适宜 AI 进行类似游戏的高效求解。 - `10:00` 历史上计算机靠穷举辅助证明四色定理,开启了用算力确立全新抽象层的先例,使后人无需从底层逻辑反复造轮子,而能直接站在新台阶上开发工具。 - `12:30` 真实物理世界的复杂模拟本质上高度依赖实验测得的经验状态方程,存在“计算不可约性”,AI 在纯抽象数学上的突破并不能直接推导并预测复杂的物理现实。 - `17:15` 从古代算盘、二战后的 Curta 机械计算器到学生时代的图形计算器,人类对技术变革的剧烈恐慌往往源于心理偏差——人们习惯将已有的技术基座视作理所当然,却对帮自己省去演算的新工具充满抵触。 - `20:00` 1953 年 IBM 手册确立的“输入、存储、算术、控制、输出”五大体系统治了计算机科学 75 年,底层技术的成熟最终都会被封装归并进更高维度的抽象系统中。 - `23:45` 二战时期的图灵破译与 ENIAC 均由明确的现实生存危机驱动,因而广受社会拥护;相比之下,纯算法棋类博弈或高深数学猜想更像是闭门解题,价值悬空导致大众反响相对冷淡。 - `32:45` 传统编程体系始终由人类严格掌控输入、输出与确定性业务逻辑,而大模型时代则带来了非确定性的统计黑盒,人类正在前所未有地向“模型之神”让渡底层的核心逻辑思考。 - `47:11` 大语言模型的爆炸式需求直接打破了传统软件极其依赖渠道分发的获客瓶颈,使顶层流量与用户需求天然处于饥渴状态。 - `50:00` 大型科技巨头往往紧盯同体量的对手(如微软紧盯亚马逊与谷歌),受限于庞大的组织文化和存量客户承诺,反而在内部算力调配与商业化节奏上陷入束手束脚的颠覆困境。 - `55:00` 人类认知目前难以推演耗资数十亿乃至百亿美元打造的单一数字人造物究竟具备何种能力,单纯从算法机制断言其无法做科学发现,可能低估了超大尺度资本投入催生的质变。 - `55:00` AI 在生物医疗领域最擅长的是吞吐海量跨学科文献并捕捉隐藏的数据关联,但新药研发的终极瓶颈依然在于漫长的人体临床安全性与有效性验证,无法纯靠计算完全规避。 - `01:00:00` AI 带来的最大现实安全隐患并非科幻式的“递归自我改进与算法暴走”,而是宏观经济机制将千亿美元级别的海量算力与资本集中投向错误甚至危险的方向。 ## Detailed walkthrough ### `00:00` 资本与工程的倒挂:AI 范式转移与前沿数学讨论 在节目开篇,几位对话者抛出了一个颠覆传统软件工程规律的核心论断:过去几十年里,软件行业的最大瓶颈始终是工程团队的规模与人才限制,你不可能给一个小团队堆砌数亿美元就让他们把产品开发速度提升十倍;然而今天,行业规则已经从“工程受限问题”彻底变成了“资本受限问题”。正如 Martin Casado 所指出的:“Right now, if I give 20 people a billion dollars, they can actually use it usefully. We've kind of moved the industry from like this engineering bound problem to a capital problem that's fundamentally very different.” 这种转变解释了为什么诸如 Cursor、Anthropic 和 OpenAI 这样的团队能够在极小的人员规模下展现出彗星般的爆发式增长。与此同时,科技巨头与初创公司的动态关系也发生了扭曲——微软等大公司往往紧盯着亚马逊和谷歌的动作,无暇顾及边缘崛起的初创企业;在大公司工作过的人总以为巨头可以轻易碾压小团队,但现实中颠覆者却屡屡突围。 为了深入探究这一底层巨变的本质,主持人 Erik Torenberg、Martin Casado 与 Steven Sinofsky 将切入点选在了看似遥远却处于聚光灯下的领域:AI 在前沿数学领域取得的突破。前不久,Bun 的创始人 Jared Sumner 在社交平台上发推称自己让 Claude 尝试证明黎曼猜想(Riemann hypothesis)并让它“再加把劲”,这一插曲引发了技术圈对于 AI 是否真正具备数学推理能力的激烈争论。 ```mermaid flowchart LR accTitle: 软件范式从工程瓶颈向资本瓶颈的转变 accDescr: 对比传统软件工程模式与现代 AI 驱动模式的资本与算力转化逻辑 subgraph TRAD["传统软件工程范式"] T1["资本注入"] -->|边际收益递减| T2["工程团队规模"] T2 -->|人月神话/沟通成本| T3["线性开发进度"] end subgraph AI["现代 AI 算力范式"] A1["海量资本注入"] -->|直接转化为| A2["前沿算力与计算资源"] A2 -->|极小团队调度| A3["指数级模型能力跃升"] end ``` ### `01:25` 数学界的反直觉狂欢:为什么最受冲击的人反而最兴奋? 面对 AI 在复杂数学难题上的突破,公众舆论迅速割裂为两大阵营。一方面是对此兴奋不已的拥护者,即便全球真正能够看懂那些高深推导证明的人屈指可数;另一方面则是冷嘲热讽的怀疑论者,他们认为这些成果不过是拼凑伪造的假象,甚至悲观地认定这会导致研究人员大批失业,预示着电影《蠢蛋搞怪秀》(Idiocracy)中人类因过度依赖机器而全面退化的黑暗黎明。 然而,整个现象中最耐人寻味、也最让旁观者困惑的反直觉之处在于,对这一进展表现得最为狂热和激动的,恰恰是处于风暴中心的数学家群体。Steven Sinofsky 敏锐地指出,在常规认知中,如果一项技术即将自动化某个群体的核心专业技能,该群体理应充满焦虑,但数学家们的态度却截然相反:“Because if you're of the school, the people who are like, it's going to put people out of work, and we're going to all get dumber, and it's the dawn of idiocracy because computers are doing all of our work, you're confused that the people who are impacted most by what this level of AI did are the most excited.” - 大众普遍以为 AI 取代人类工作会引发业内恐慌,但纯数学家却将其视为解放思维的全新研究仪器。 - 真正理解顶尖数学突破细节的人类学者在全社会占比极小,但这并未阻止关于 AI 认知边界的讨论在科技圈蔓延。 ### `02:50` 经济效用拷问:公理化系统的游戏与现实价值的鸿沟 作为系统与产品领域的老兵,Martin Casado 坦言自己并非数学专家,但他习惯从商业与“经济效用”(economic utility)的角度去冷静拆解这一现象。他提出了两点尖锐的观察: 首先,一个数学谜题悬而未决了几十年甚至上百年,并不必然代表攻克它就能释放出天量的经济红利。现实情况往往是,这类纯理论问题之所以长期无人解决,仅仅是因为其缺乏足够的商业利益驱动。Martin 调侃道,如果把历年来所有试图攻克某个纯数学猜想的博士后薪资加在一起,总额可能少得可怜——一个年薪仅有 3 万美元的博士后在象牙塔里苦思冥想五年,与整个市场为了撬动生产力而倾注巨资攻关某个工业级瓶颈,完全是两码事。因此,不能因为 AI 解决了一个陈年理论难题,就盲目推断它已经找到了通往现实经济价值的钥匙。 其次,从技术机理来看,AI 极其擅长在一个完全由公理构成的纯粹闭环系统(axiomatic domain)中寻找解法。这类任务的特点是,它需要同时调动极度跨学科的广泛知识背景,将来自完全不同数学分支的概念拼装在一起。对于绝大多数人类学者而言,受限于精力和专业细分,他们的知识面往往难以覆盖得如此宽广,而 AI 却能轻而易举地借用某个冷门分支的定理来破局。 Martin Casado 直言,这在某种程度上依然没有脱离游戏求解的范畴:“For me, it's still in the domain of like, it's really good at playing a game. Like this is the best Starcraft player ever, which is cool. And it's very powerful. But like I have a hard time connecting that with A, like maybe the reason we didn't have them before is because there just was an economic need and B, like how does that actually map?” - **知识广度碾压**:人类专家受制于学术分工难以兼顾所有数学支流,AI 则通过海量语料实现了超宽维度的跨领域概念调用。 - **公理闭环优势**:数学具备严密的符号规则与验证闭环,这使得模型无需面对现实世界的嘈杂噪声即可进行快速自我博弈。 ### `05:00` 抽象的层级与计算机证明的往事:从离散数学到四色定理 在投资实践中,a16z 经常会遇到两种截然对立的创业团队。一派创始人笃信数学是通往通用人工智能(AGI)和高级推理的绝对基石,他们认为宇宙万物在底层都遵循着数学逻辑,只要彻底攻克了数学推理,AI 就具备了解释世间一切现象的能力;而另一派实用主义创业者则对此不屑一顾,认为纯数学在高度抽象的符号世界里打转,根本无法映射复杂的现实环境。 Steven Sinofsky 进一步剖析了数学家之所以感到兴奋的深层学术逻辑。不同于历史学这种几乎没有严密抽象层、主要依赖史实与因果因数模型(force diagrams)来解释战争或饥荒的学科,数学在漫长的历史长河中,是一门不断在已有抽象之上层层叠加新抽象(layering on abstractions)的学科。对于很多一线数学家来说,AI 的介入并不是砸碎了他们的饭碗,而是将他们原本厌恶的 20% 的枯燥符号推演自动化了,从而形成了一层全新的抽象基座,让他们能够站上更高的台阶去眺望未知疆域。Casado 带着一丝自嘲地打趣道,如果是攻克癌症,从业者绝不会感到存在主义的抑郁,大家只会狂欢;但某些纯数学问题一旦被机器解决了,那些靠每隔几年写一篇“论某某猜想证明为何再次出错”来混饭吃的研究人员,可能就真的失去了这项活动的意义。 这番探讨勾起了两人对计算机科学早期教育的回忆。在过去的计算机专业培养方案中,离散数学(Discrete Math)和算法复杂度理论(Algorithmic Complexity Theory)是不可撼动的必修硬核课程,比如当年高德纳(Donald Knuth)参与合著的《具体数学》(*Concrete Mathematics*)。Sinofsky 回忆起自己在康奈尔大学求学的经历,当时讲授这些算法理论与 P vs NP 复杂度的教授,正是算法领域的泰斗级学者、图灵奖得主 John Hopcroft。当年 Hopcroft 在斯坦福攻读博士学位期间发明了 2-3 树等众多经典数据结构。正是在那个计算机科学从底层硬件与基础数学交织演进的年代,学术界见证了计算机历史上最著名的机器辅助证明里程碑——四色定理(Four Color Theorem)的诞生,计算技术首次以这种极具争议却又无可奈何的方式,强行重塑了人类对“证明”二字的传统定义。 - **抽象的累加性**:数学发展依赖层层构建的公理与模型抽象;AI 自动完成了繁重的底层逻辑排查,成为了数学家迈向更高维度理论的新跳板。 - **四色定理的先例**:历史上四色定理的计算机辅助证明曾引发过长期的哲学争论,当下的 AI 证明热潮正是该历史轨迹在现代模型上的重演。 ### `10:00` 四色定理与计算带来的抽象跃迁 对话从大学里令人痛苦的理论计算课程切入。Martin Casado 和 Steven Sinofsky 回忆起当年大学里整门课程的核心命题:理论学家假设,如果某个问题能在多项式时间(而非指数时间)内解决,那么像旅行商问题(Traveling Salesperson Problem)等一大批 NP 难问题都能迎刃而解。当时计算机的算力极度匮乏,这一理论至关重要——比如 AT&T 面对一个包含 6000 个交换机的节点网络,想要做最优路由规划,如果用模拟穷举,得让机器跑上整整两年。 随后他们谈到了著名的四色定理(Four-Color Theorem)。该定理指出,在任何二维平面地图上,只需要四种颜色就能给所有区域着色,并保证任意两个相邻区域颜色不同,永远不需要第五种颜色。这道题在几代计算机系学生的记忆中留下了深刻的烙印。然而,它的证明方式并不是人们传统认知中那种充满微积分优雅美感的逻辑推导,而是先证明潜在解的集合是有限的(长达两百多页的组合推导),接着直接借助计算机把所有可能性穷举了一遍。Steven Sinofsky 将其形容为一种“台球借力反弹式的证明(bank shot proof)”,完全是靠算力暴力硬解出来的。Martin 借此指出,这证明了计算能力可以确立强有力的边界。 Steven Sinofsky 由此提炼出一个核心技术规律: > “When you have a new level of abstraction that says this is a whole class of problems that can be solved, you can then build tools working at that level of abstraction.” 一旦某个层面的抽象成立,后人就不必每次都从最底层的表示法从头摸索,而是可以踩在新的抽象层上开发工具。 ```mermaid flowchart LR accTitle: Abstraction Jump in Computing accDescr: Shows how computational power enabled the four-color theorem and created a new level of abstraction for tool building. subgraph Problem["理论瓶颈"] A["高复杂度难题<br/>(网络路由 / 旅行商)"] --> B["算力匮乏<br/>无法暴力穷举"] end subgraph Solution["算力破局"] B --> C["有限状态理论证明"] C --> D["算力穷举验证<br/>(四色定理证明)"] end subgraph Impact["抽象跃迁"] D --> E["确立全新抽象层"] E --> F["构建更高维度工具<br/>告别底层重复劳动"] end ``` --- ### `12:30` 物理模拟的不可约性与对 AI 全能论的质疑 Martin Casado 坦言讨论 AI 很难不滑向哲学层面的探讨。他提出了一个尖锐的根本性问题:纯数学究竟能否真正代表物理现象?人们是否真的曾用纯粹的方程式推导,就能精准预测现实物理世界?Martin 分享了自己早年在大型模拟程序(Large Simulation Codes)中的工作经历,当时他们试图模拟超新星爆发、飞机风洞或空气动力学行为等极其复杂的物理现象。在这些模拟中,尽管机器解的是庞大的微分方程组,但支撑这些方程的,完完全全是从实验室里测出来的经验状态方程(Empirical Equations of State)。 Steven Sinofsky 补充说,这些归根结底只是“模型”——人们在特定位置测量温度并建立近似,而不是全知全能的真理。Martin 由此质疑:物理模拟在计算上是否本质上是“计算不可约的(Computationally Irreducible)”?如果是不可约的,你就必须一步一步把模拟完整跑一遍,无法靠高阶数学走捷径。 现在业内很多人声称,只要 AI 攻克了全部数学,人类就能预测世间的一切。Martin 对此泼了冷水,认为这种论调跨越了巨大的逻辑鸿沟: > “And then I read a lot of these discourses on the math solutions, and there's kind of these claims where if it can solve all math, you can predict anything. And I just think that that's a huge, huge logical leap, which is not clear to me that it is obviously true.” 在 Martin 看来,纯算法领域、物流排产模型与真实的物理爆缩、高楼是否会倒塌的模拟之间存在巨大鸿沟,AI 攻克抽象数学未必能对真实的物理模拟产生颠覆性影响。 --- ### `14:35` 从北京算盘到 Curta 机械计算器:工具演进史 面对数学本质的争辩,Steven 自嘲纯数学领域超出了系统工程师的能力范畴,但他骨子里是个“做工具的人(tools person)”。他认为 AI 未必是用来直接在宏大尺度上解数学题的终极武器,但它很可能会催生出一种全新层级的“模型工具”。为了具象化这种认知,Steven 在现场拿出了随身带来的实体道具展示计算工具的演进: 首先是算盘。Steven 掏出一个他在北京市场买到的算盘,得意地提到自己当年跟小贩讨价还价,一路砍到了 7 美分成交。算盘代表了人类将基础算术固化为实物工具的第一个重要抽象层。 紧接着,Steven 拿出了一个极其精致的掌上机械装置——奥地利研发的 Curta 计算器(俗称机械胡椒研磨机)。大家熟知普通的滑动计算尺(Slide Rule),但极少有人真会用它,而 Curta 则是一个圆柱形的精密机械计算尺。它上面有像研磨器一样的摇把,外圈密布着设置数值的滑轨,顺时针摇动是加法,逆时针转动则是减法。Steven 解释说: - 这台 Curta 是他叔叔二战后带回来的战利品,大约制造于 20 世纪中叶; - 装置内部包含大约 600 个微型精密机械金属零件; - 如果放到今天重新加工制造一个,成本可能高达 50,000 美元; - 尽管这台机器在他书架上落灰多年,但他为了这次录制不当“完全的白痴”,还特地重新把它学了一遍,搞懂了如何用它做四则运算。 无论是算盘还是 Curta,每一次实物工具的突破,都把原本需要大脑费尽周折的繁重算力打包成了现成操作,从而让人类得以在更高的抽象层去解决全新问题。 --- ### `17:15` 从图形计算器恐慌到大模型对经济价值的解锁 Martin 接着问道,这是否意味着今天的大语言模型本质上就是新时代的图形计算器?这番类比引发了两人对学生时代技术恐慌的共鸣。Steven 回忆起 TI-85 图形计算器刚在学校出现时,数学老师们陷入了前所未有的行业生存危机:老师们原本让学生在坐标纸上手动描点绘制 $X-Y$ 图像,现在学生按一下计算器就能把方程全画出来并自动求解,老师们哀叹“我们的学科彻底完了”。当时考试甚至要求学生必须在蓝色答题本(Blue Book)上写满全部推导步骤,以证明自己不是靠图形计算器抄出来的;而台下的学生们要么偷偷在计算器背后自己写游戏玩,要么连百分比和阶乘键都搞不明白(当时的 TI-35 算到 59! 屏幕就爆满了)。 Steven Sinofsky 尖锐地指出了人们对技术变革的典型心理偏差: > “Those people didn't complain about when calculus came out. Because calculus was a baseline to them. And what it is is there's this notion – people react to change more than they react to the baseline of where they all started.” 大家对微积分视若理所当然,却对帮人算微积分的计算器充满敌意,根源就在于人总是对“变化”剧烈反应,却忽略了自己立足的起点本身也是前人的技术变革。 ```mermaid flowchart TD accTitle: Evolution of Calculation Tools and Economic Drivers accDescr: Displays the history of calculating devices from difference engines to modern AI, driven by military and economic needs. subgraph History["历史演进:从算力到工程"] A["差分机 / 模拟计算<br/>(计算潮汐经济与弹道轨迹)"] --> B["ENIAC 电子计算机<br/>(军用弹道表,比人快5000倍)"] B --> C["工业体系爆发<br/>(太空竞赛 / 喷气引擎 / 自动化)"] end subgraph Modern["现代演进:抽象工具升级"] C --> D["手持与图形计算器<br/>(TI-35 / TI-85 教学危机)"] D --> E["前沿 AI 模型<br/>(新层级数学与逻辑抽象)"] E --> F["解锁全新产业经济瓶颈?"] end ``` 随后 Martin 纠正并补充了计算机的演进史:差分机最初其实是为了预测潮汐,这具有极大的商业航海价值;后来这些架构才被军方接管,用来计算导弹和火炮弹道轨迹,进而催生了 ENIAC。ENIAC 计算弹道表的速度比人类快 5000 倍,而且绝不会犯算术错误。正是这些算力工具的诞生,直接解锁了后来的太空竞赛、喷气发动机研发和整个工业自动化时代。而在美苏冷战的社会背景下,不仅没有人排斥这种技术跳跃,所有的父母反而在全民狂热中催促自己的孩子:“去学校学好数学,去赢得西屋科学奖(Westinghouse Competition),去拿下通用电气的数学竞赛奖项!”全社会都在为这种由工具解放出来的生产力欢呼雀跃。 ### `20:00` 从 1953 年 IBM 手册看计算机架构与抽象层的演进 Steven Sinofsky 拿出一本自己在家里偶然翻到的老物件——一份 1953 年由 IBM 出版、名为《IBM: Light on the Future》(IBM:点亮未来)的宣传小册子。封面印着一个脑袋周围环绕着原子轨道的未来人形象,还配有火箭、试管、探照灯光束以及示波器波形,充满典型的冷战早期未来主义风格。这本手册甚至早于 IBM 704 和 IBM 370,当时的计算机世界还处于 ENIAC 时代。手册的第一句话甚至写道:“发明轮子并认识到它的实用性花费了数百万年”,接着向当年的读者科普滑尺(slide rule),甚至费尽心思解释十六进制、十进制、二进制与罗马数字的区别。册子末尾还附有一份术语词汇表,里面列着“算术单元(Arithmetic unit)”、“二进制数字位(Binary digit bit)”、“阴极射线管(Cathode ray tube)”以及“静电存储管(Electrostatic storage tube)”。 让 Sinofsky 特别感慨的是手册中总结的数字计算机基础架构页面:输入(Input)、存储(Storage)、算术运算(Arithmetic)、控制(Control)和输出(Output)。过去 75 年里,计算机科学的教育与发展完全建立在这五个抽象层之上;大学计算机系最早脱胎于战时为了计算导弹弹道而设的数学系,其早期的课程与教研室就是围绕这些板块分别建立的。随着技术发展,输出领域经历了从电传打字机(teletype)、面向行的电传机,到黑白终端、彩色终端和矢量图形的变迁;存储领域也历经磁带等数十年的迭代。然而,当这些底层抽象被彻底解决后,各分支纷纷合并,最终归并成了今天大家所熟知的“系统组(Systems group)”。 两人由此谈及网络(Networking)在抽象层中的演变。网络本质上属于控制层的一部分,但正如 Martin Casado 所指出的,大家往往一旦数据包离开本机就不再去想它,到了 90 年代末,网络课程在许多高校甚至不再是计算机必修课,因为人们觉得网络底层已经被“解决”了;就像晶体管一样,早期的计算机专业学生必须理解晶体管,如今大家看到它只觉得是一个代表逻辑门的三角形符号。Sinofsky 借此指出,每一代技术的成熟都是在向上封装抽象层: > “These have been, for 75 years, how we thought computers were organized: input, storage, arithmetic, control, and output.” —— Steven Sinofsky - **1953 年 IBM 手册核心概念**:在《IBM: Light on the Future》中,IBM 试图向公众定义计算机体系,将计算机划分为“输入、存储、算术、控制、输出”五大模块,这构成了随后大半个世纪计算机科学的底层抽象支柱。 --- ### `23:45` 战争驱动、经济需求与“为了解题而解题”的冷淡反响 Martin Casado 针对抽象层的演进提出了一个关键分歧:每一次抽象层提升后确实都会产生新的问题,但技术被社会迅速拥抱的核心动力依然在于**经济与现实需求**。Casado 回顾了计算史上的两个里程碑:二战时期的布莱奇利庄园(Bletchley Park)是为了破译德军密码赢得战争;ENIAC 也是为了战时核武器研发与弹道积分计算而造,当时没有计算机器就只能靠人力手算积分。由于这些技术直接对应着迫切的现实危机与拯救人类层面的成果,物理学家与公众不仅全力支持,更对它们充满敬畏。 然而在当下的 AI 突破中——比如用 AI 去解决高难度纯数学猜想——Casado 坦言他看不清“另一端接住的现实产物是什么”。这种反差此前在 AlphaGo 击败李世石,甚至是更早 IBM 深蓝(Deep Blue)击败国际象棋世界冠军卡斯帕罗夫时就已经出现过。当年 DeepMind 取得胜利后,Casado、Frank Chen 等人录制播客时,还得苦口婆心地向大众解释这为什么是一件好事、有什么实际价值。Sinofsky 尖锐地剖析了这种公众与从业者的冷漠感: > “I would submit that's because it's almost like solving the problem had become the end as opposed to the actual end. But as we should maybe all step back and be like, if you're really like sad about something being solved, maybe it wasn't worth working on to begin with, right?” —— Steven Sinofsky Sinofsky 调侃道,如果解出一道难题只是像绘制沙曼荼罗(sand mandala)一样追求内心的宁静,它并不能推动实际经济发展。Casado 和 Sinofsky 虽都是系统背景出身,但 Sinofsky 强调自己本质上是个“应用派(apps person)”,因为技术唯有沉淀为能够解决现实问题的应用程序,其价值才真正成立。 ```mermaid flowchart TD accTitle: Computing Innovation Drivers Comparison accDescr: 对比早期任务驱动型计算与现代技术驱动型 AI 在解决目标与公众接受度上的差异。 subgraph EarlyEra ["早期任务驱动型创新"] W1["二战破译密码 (Bletchley Park)"] --> E1["赢得世界大战"] W2["核武器研发与弹道计算 (ENIAC)"] --> E2["替代繁复手工积分"] E1 --> V1["现实危机解决:极高社会认同"] E2 --> V1 end subgraph ModernEra ["现代前沿 AI 抽象突破"] A1["棋类博弈 (Deep Blue / AlphaGo)"] --> Q["目标往往停留在问题本身"] A2["纯数学复杂定理证明"] --> Q Q --> V2["价值悬空:公众困惑与应用脱节"] end ``` --- ### `26:30` 杀手级应用的迷雾:从 NeXT 的 Cyber Pizza 到哈佛法学院禁止 Osborne 电脑 谈到平台诞生之初“人们根本不知道它能干什么”,Sinofsky 提到了 1995 到 1996 年互联网刚兴起时的迷茫——当时很多人也只是冷眼旁观,表示完全不知道互联网对自己有什么用。他特别推荐了新书《Steve Jobs in Exile》(乔布斯流亡记),该书记录了乔布斯创办 NeXT 以及在皮克斯与 Ed Catmull、Dana Lewin 等人共事的岁月。蒂姆·伯纳斯-李(Tim Berners-Lee)当年正是用一台 NeXT 工作站写出了 HTTP 协议并构筑了万维网,然而在当时,根本没人知道 NeXT 这台机器能用来干嘛,它的日常用途仅限于查找研究人员的电话号码和共享学术论文。 Sinofsky 讲了一个生动的案例:在 NeXTSTEP / OPENSTEP 的一次发布会演示中,一家西雅图名为“Cyber Pizza”的初创公司上台展示。该项目堪称只送披萨的早期 DoorDash——用户在线点单,系统匹配附近的披萨店并派送。为了防止现场演示翻车,团队甚至在后台偷偷备好了真实的披萨。然而现场观众看完整场演示后的真实反应却是:“哇,确实很酷,但你听说过电话这门技术吗?”——平台已经造好,但真正切中经济刚需的杀手级应用尚未出现。 接着,Sinofsky 拿出了他的压轴实物道具——1982 年的 Osborne 计算机。当时运行 CPM 系统(DOS 的前身)的文字处理软件刚露头,很多人还在质疑:“打字机用得好好的,为什么需要电脑?”在 Harvard Law School(哈佛法学院),学生历来被要求携带打字机参加考试,以确保教授能看清卷面。到了 Sinofsky 读高中最后一年时,有两名哈佛法学院学生把电脑带进了考场,一人带了 Apple II,另一人带了 Osborne。结果校方当即下令全面禁止携带电脑考试。 Sinofsky 让 Erik Torenberg 猜猜自己上大学时用的这台重达 25 磅(约 11.3 公斤)、外形大如老式缝纫机、尺寸超过标准登机箱的 Osborne 电脑续航有多久。Erik 犹豫地回答“可能不长”,Sinofsky 笑着揭晓答案:它根本没有电池,必须插电使用,是一台名副其实的“可搬运电脑(luggable)”。而当年《时代周刊》和《纽约时报》关于哈佛禁止电脑考试的报道口吻,与后来社会批判图形计算器、抵制说唱乐和爵士乐,乃至于今天大学针对学生在写作课上使用 AI 的恐慌与声讨如出一辙: > “Every article you could read reads like 'don't use the graphing calculator', 'don't listen to rap music', or 'no jazz'—or the arguments that are going on now: AI in freshman writing.” —— Steven Sinofsky ### `30:00` 抽象层级的演进:从打字机、图形计算器到符号数学软件 Steven Sinofsky 回忆起 1983 年秋天自己刚上大学一年级时的情景。在那个住着 90 人的大学宿舍里,他是唯一拥有个人电脑的人,甚至当时写大一英文论文还得专门向系主任(Dean)申请使用电脑的许可。他感叹,今天人们面对 AI 的恐慌与争议,与当年电脑初入校园如出一辙,但这也是技术抽象层级演进的必然过程——如今已经没有任何人上大学能离开电脑了。 ```mermaid flowchart TD accTitle: 抽象层级演进与逻辑让渡争议 accDescr: 对比传统确定性抽象层级与大模型带来的非确定性让渡 subgraph Traditional["传统计算抽象层级(确定性)"] direction TB T1["底层资源:算力 / 网络 / 存储"] --> T2["系统与平台:OS / 数据库 / 运行库"] T2 --> T3["程序员掌控:明确输入输出与业务逻辑"] end subgraph Shift["AI 新范式(非确定性)"] direction TB S1["自然语言提示(Prompting)"] --> S2["统计概率黑盒模型(LLM)"] S2 --> S3["让渡逻辑与思考:模型输出答案"] end Traditional -.->|"本质断裂?"| Shift ``` 对此,Martin Casado 提出了审慎的反思。他回顾计算机科学史,指出以往所有技术跃迁本质上都是在提供“资源”——算力、网络和存储,人类始终在定义高级目标并设定前置条件;而现在的生成式 AI 让人感觉是在“让渡真正的思考与逻辑”。即使是当年的谷歌搜索,本质上也具有强烈的社会化索引属性,而今天的用户则是直接问“告诉我答案”,甚至连问题本身都没完全想清楚。Martin 强调,传统的向上抽象依然是确定性系统(Deterministic System),问题陈述的方方面面仍由人类严密把控。 Steven Sinofsky 承认这种体验确实截然不同,但他指出这种“作弊感”在历史上屡见不鲜: - **图形计算器(Graphing Calculator):** 过去考试的题目本身就是“画一个函数图像”,图形计算器直接把答案画了出来,在当时看来就是赤裸裸的作弊,因为工具的能力直接覆盖了考试要考查的核心。 - **MIT 的 Maxima 与 PC 端的 muMATH:** 1980 年代初,起源于 MIT 60 年代末、70 年代初的项目符号数学计算软件包(Symbolic Math Package)开始普及。Steven 回忆大一工程课做微积分作业时,学生们直接跑到工程图书馆借一张软盘,在 IBM PC 上运行 muMATH,敲入一个积分公式就能自动算出结果。 - Martin 随后由衷感叹道:“我记得第一次看到 Mathematica 时,心想这玩意儿简直是黑魔法。” --- ### `32:45` 专家系统与 Prolog:传统算法与“让渡逻辑”的区别 Martin Casado 进一步追问两者的本质差异。在传统编程中,无论开发者使用云数据库、对象存储还是网络库,程序的正确性与核心业务逻辑始终在程序员的完全掌控之下;开发者挑选库,清楚所有输入与输出。但现在人类正在将逻辑本身推给第三方黑盒模型。 Steven Sinofsky 举出了自己在斯坦福大学经历的“AI 寒冬”(1980年代)作为类比。当时斯坦福最重大的方向之一就是将 AI 与医学院结合,研发用于医疗诊断、化疗方案推荐的项目,Steven 本人还曾与哈佛大学团队合作开发有机化学合成系统。这些正是历史上最早试图“把决策权转交给机器”的尝试,也就是当年风靡一时的“专家系统”(Expert Systems)。 面对 Steven 的例子,Martin Casado 一针见血地指出了其中的关键分歧: - **专家系统与 Prolog 的本质:** Martin 强调自己上过很多这方面的课,写过大量 Prolog 代码,深知其运作机理。Prolog 这类声明式语言虽然也是基于规则推导,但它依然是算法性的(Algorithmic)、确定性的。人类设定好终态规则,计算机负责找出通往终态的路径。 - **历史与现在的分水岭:** “当年的专家系统根本行不通,而现在的系统却真正奏效了,并且我们正在让渡逻辑。”现在的 AI 甚至让人类在不知道明确终态是什么的情况下,直接询问机器“终态应该是什么”。 关于当年专家系统与现状的差异,Martin Casado 概括道: > “Hons of excellent expert systems. I've had to build expert systems. I've written a lot of prolog. I very much understand it. I just thought that never really worked.” --- ### `35:00` 三种编程范式与向“模型之神”祈祷 Martin Casado 梳理了计算机体系的发展历程。从晶体管逻辑、底层硬件、操作系统、应用程序到平台层,整个计算机史都是在沿着抽象层级向上攀升,且每一层都能以确定性的方式向下映射到下一层。但如今的大模型表现出随机性、统计性和任意性,似乎标志着一种全新的“人类层级抽象(Human Level Abstraction)”,迫使从业者必须重构对计算底层规律的认知。 | 编程范式 | 核心特征与机制 | 代表技术 / 示例 | |:--- |:--- |:--- | | **命令式编程 (Imperative Programming)** | 开发者知晓所有步骤,编写明确的“操作食谱”,计算系统严格按步骤执行。 | C、Java、Python 等传统编程 | | **声明式编程 (Declarative Programming)** | 开发者明确知晓“终态”是什么,计算系统在不确定计算耗时的情况下寻找通往终态的路径。 | Prolog、Datalog、SQL、Makefiles | | **概率/统计范式 (AI Prompting)** | 开发者甚至无法具体描述终态,通过自然语言提示词生成答案。 | 现代大语言模型(LLMs) | 关于现代人与大语言模型的交互方式,Martin 生动地调侃道: > “It's almost like you don't really know what the end state is specifically, and you just kind of like – you kind of like pray to the model god in like the right words, and then it produces the answer that just ends up being useful.” Steven Sinofsky 认同这种描述贴切地刻画了现状,并指出语言作为人类的输出成果,使计算与自然现象在这一层级发生了前所未有的深度交织。 --- ### `37:30` 物理法则的转变:如果给初创公司 10 亿美元 面对主持人关于“如果需要重新审视基本假设,那具体意味着什么”的提问,Martin Casado 指出,像他和 Steven 这样在科技行业拥有三四十年经验的人,已经对系统如何运作、软件如何商业化建立了极其深厚且牢固的直觉。但面对 AI,很多旧直觉正在经受冲击: 1. 价值最终会流向底层基础模型还是上层应用软件? 2. 资本注入能否突破以往的效率边际,资本能够撬动的上限究竟在哪里? 3. 哪些类型的问题是可以被解决的,哪些是无法解决的?系统到底能提供何种程度的确定性保证? 4. 它将对全社会的生产力产生何种实际影响? 为了说明底层商业与技术“物理规律”的巨变,Martin 抛出了一个经典的思维实验: - **20 年前(传统软件时代):** 如果给一家只有 10 个人的初创公司 10 亿美元,他们根本不知道该拿这笔巨资做什么。即使给 1000 万美元,团队可能从惠普(HP)采购一堆服务器,钱就花完了;但如果给 10 亿美元,招募工程师写代码的速度根本消化不了这种量级的资本。 - **两年前至今(AI 时代):** 算力与模型训练的资本吸纳能力彻底改写了游戏规则,海量资本可以直接转化为强大的计算集群和更聪明的模型,资本与工程人才之间的传统制约关系被彻底打破。 在谈到两代科技周期的资本吞吐能力时,Martin Casado 总结道: > “The important part of that is it's a billion. It's not that you got money, it's that it's a huge, it's a ton of money.” ### `40:00` 从“工程瓶颈”到“资本瓶颈”的历史轮回 以往的传统软件工程始终摆脱不了《人月神话》(*The Mythical Man-Month*)的铁律:即使不断招人,也无法让交付速度成倍提升,工程复杂度本身就是天然的上限。然而如今的 AI 浪潮完全颠覆了这一规律——哪怕只有 20 个人的精简团队,如果给他们 10 亿美元,他们也能高效利用这笔资金直接购买算力、训练前沿模型并转化为有效产出。Martin Casado 指出,整个软件行业正经历底层物理规律般的质变:从原本的“工程瓶颈”(engineering-bound)彻底转向了“资本瓶颈”(capital-bound)。 Steven Sinofsky 补充道,这种状况实际上与早期计算史形成了奇妙的闭环。计算机诞生后的前三四十年,行业本身就是高度依赖资本的:如果想要用电脑干点什么,首要门槛是必须买得起一台机器,而当时大多数人根本无力负担。这就如同美剧《广告狂人》(*Mad Men*)里的桥段——当一台庞大的计算机被运进广告公司时,所有人兴奋地围着它打转,试图向外界解释它能做什么,因为能够拥有它本身就是雄厚资本和前沿实力的象征。此后软件行业经历了数十年的工程瓶颈期,而如今随着 AI 的爆发,整个行业再次回到了必须依靠海量资本来砸开大门的时代。 Erik Torenberg 提及 Patrick Collison 几年前采访 Sam Altman 时谈到的现象:硅谷长期崇尚精益创业(Lean Startup),但无论是 OpenAI 还是新能源与延寿项目,从一开始就需要筹集天量资金。Martin Casado 回顾了 Eric Ries 的精益创业理念与 Ben Horowitz、Marc Andreessen 倡导的“肥创业”(Fat Startup,即筹集重金强行推进)之间的论战;过去哪怕有钱,“工程复杂度”依然是不可逾越的硬性物理制约,而现在 20 人的团队却能实打实地将数十亿美元转化为真实生产力。Martin Casado 感慨道,自己做投资的头十年,日常工作就是“投钱给早期团队,帮他们招聘招人,然后干坐着等上两年看产出”,因为九个人无论如何也不能在一个月内生出一个孩子。但现在,凭借资本和算力,产出可以在极短周期内爆发。 ```mermaid flowchart LR accTitle: 计算与软件开发核心约束演进图 accDescr: 展示计算行业从早期硬件资本约束,演化到软件工程人力约束,再回到大模型时代资本约束的三个阶段。 subgraph EarlyStage["早期计算时代 (1950s-1980s)"] A["资本瓶颈<br/>(昂贵硬件与机房)"] end subgraph SoftwareEra["传统软件时代 (1990s-2010s)"] B["工程瓶颈<br/>(招聘工程师/人月神话)"] end subgraph AIEra["现代 AI 时代 (2020s-)"] C["资本瓶颈<br/>(海量算力/大模型训练)"] end A -->|"硬件商品化<br/>软件复杂度上升"| B B -->|"模型能吞噬海量算力<br/>小团队驱动庞大资本"| C ``` - Martin Casado 强调资本转化率的跃迁:“And right now, if I give 20 people a billion dollars, they can actually use it usefully.”(现在,如果我给 20 个人 10 亿美元,他们真的能把它切实有效地花掉并转化出成果。) - Steven Sinofsky 概括这一历史回旋:“You were capital bound and then you were engineering bound and now we're capital bound again.”(你曾受制于资本瓶颈,接着受制于工程瓶颈,而现在我们又回到了资本瓶颈。) --- ### `42:47` 风险投资的正和博弈与垂直应用爆发的前夜 由于大模型研发对算力有着无底洞般的胃口,Martin Casado 严厉批驳了过去十年风险投资圈常见的“钱太多、好案子太少”这一零和博弈思维。他认为作为风投如果陷入这种心态是非常可悲的,资本注入一级市场绝非抢食存量,而是在做大整个潜在市场规模(TAM):一方面,像 AI 这样具备极高吸纳能力的底层技术浪潮可以有效消化资本;另一方面,私募资金越充沛,优质企业留在未上市阶段的时间就越长,从而将更多的价值沉淀在私人市场中。 伴随着资本直接驱动生产力,软件应用的真正大潮即将到来。Steven Sinofsky 兴奋地指出,人类社会绝大多数垂直行业——医疗病历、看病预约、法律服务等——过去根本没有被优秀的软件真正服务过。在当下人人都批判抵触技术的社会氛围中,唯一能让人拍手叫好的竟然是“用 AI 让法律服务自动化”。过去风险投资界最棘手的难题莫过于此:商业地产等传统行业极其复杂,懂地产的人不会写代码,懂写代码的工程师又得花 20 年去学地产业务;而如今,具备垂直行业专门知识的人不再需要被困在漫长的工程师招聘泥潭中,他们可以直接借助 AI 将业务逻辑转化为软件。 - Martin Casado 批评 VC 圈的零和心态:“Too much capital is chasing too few deals. And all this is like, you're a venture capitalist. Don't you believe in positive sum stuff, right? The more capital that flows into private markets, the larger the market gets.”(‘过剩的资本在争夺太少的优质项目’——你是个风险投资人,难道你连正和博弈都不相信了吗?涌入一级市场的资本越多,市场本身就会变得越大。) - 资本充裕导致公司长期保持私有化状态,从而使更多企业升值收益直接沉淀在私人市场,做大了整个生态的体量。 --- ### `45:00` 抽象层跃升与“无代码”时代的真正降临 Steven Sinofsky 回忆起自己刚踏入职业产品开发领域时的第一次客户拜访经历:当时他去拜访一位既学了早期计算机科学、后来又考入医学院当上医生的创始人。那位医生在 DOS 系统上敲了一套给门诊排班的软件。外行人听起来觉得排班不过是个带着时间格子的日历表,但那位医生向 20 岁的 Sinofsky 解释,病患打电话给预约员时,预约员要根据患者描述的关键词当场判断:这需要问诊 5 分钟还是 20 分钟?需要提前开 X 光机还是心电图机?抽血检查和医生问诊必须并行排期。为了把这套复杂的医学调度逻辑用代码敲出来,那位医生耗费了整整好几年。 Sinofsky 认为,大模型和现代开发环境正在让那个时代彻底终结,真正的“无代码”(No-Code)时代终于到来了。现在的软件开发者面对的是全面抬升的技术抽象层:如果为智能手机开发应用,操作系统层面早就把底层文本框、UI 控制件全部封装完毕,开发者根本不需要从零手搓控件;而加上大模型对复杂业务逻辑的理解能力,拥有垂直领域知识的专家可以直接实现产品落地,而不再需要把几十年心血耗费在编写底层的丢弃型代码上。 - Steven Sinofsky 回顾那次震撼的拜访经历:“And so they're actually scheduling like a blood draw and all of this stuff in parallel, not just the 10 minutes you need with the doctor. And so that's what his software did. It took him years to bang that out himself.”(所以他们实际上是在并行调度抽血化验等一系列检查,而不仅仅是医生问诊的这 10 分钟。他的软件实现的就是这个功能,为此他自己硬生生磕了许多年才搞定。) --- ### `47:11` 大卫与歌利亚:初创企业如何打破分发护城河 既然资本和规模优势如此关键,那么手握庞大现金流和渠道的传统大厂(Incumbents)是否会直接碾压初创公司?Martin Casado 坦言,如果半年前有人问他这个问题,他也会给出传统答案:大厂拥有资本、现金流和现成的客户分发渠道(Distribution)。然而,大语言模型的出现颠覆了旧秩序: 1. **需求反向击穿分发屏障**:以往初创公司最艰难的瓶颈在于获客和建立分发渠道,必须组建庞大营销团队且 ROI 极不可控;但在 AI 时代,市场对 Token 和算力的需求是无限且饥渴的,用户自发涌入,顶层漏斗(Top of funnel)自然拉满。 2. **资本动员能力并驾齐驱**:像 OpenAI、Anthropic 这样的头部模型公司,以及 Cursor 这种爆款工具,其惊人的吸金能力使它们在一级市场筹措的资金体量足以直接叫板微软或 Meta,消除了与大厂的资本壁垒。 Steven Sinofsky 结合自身在微软主导大型操作系统开发的经历指出,过去建造操作系统的护城河是“无限的”,因为需要成千上万名顶级工程师协同作战(正如 Dave Cutler 打造 Windows NT 时的神话,哪怕是乔布斯的 NeXT 也必须基于卡内基梅隆大学的 Mach 微内核展开),小团队绝对无法从头复制。然而在商业世界中,大厂常常迷信自身能凭体量碾压小公司,但颠覆创新却一次次上演。Sinofsky 提到在哈佛商学院与克莱顿·克里斯坦森(Clay Christensen)共事时的旧笑话——克氏颠覆理论本不该作为商学院理论来教,它更像是物理学里的客观规律。大企业总以为自己能轻易踩碎小公司,但初创企业往往另辟蹊径,从未直挺挺地冲向大厂的正面战场;正如当年 AWS 崛起时,各大巨头并没有在其萌芽期直接将其掐死一样。 - Martin Casado 阐释 AI 初创企业获得的颠覆性优势:“And what's crazy is AI solves the distribution problem. It solves the demand problem. And these companies are able to raise so much money that they're actually on competitive footing with the Microsofts and the Meta companies.”(疯狂的是,AI 解决了分发问题,也解决了需求问题。而且这些初创公司能融到如此庞大的资金,以至于它们在竞争层面上足以直接与微软、Meta 这样的巨头平起平坐。) - Steven Sinofsky 引用哈佛商学院时期的经典论调:“There was an old joke at Harvard Business School when Clay was still with us, which was they really – it's weird that they teach disruption as a theory in the business school when really it should just be a fact in the physics department.”(克莱顿还在世时哈佛商学院有个老梗:把颠覆创新当作商学院理论来教实在太奇怪了,它本该是物理系里的一条既定客观事实。) ### `50:00` 巨头的文化包袱与初创企业的资本反转 ```mermaid flowchart TD accTitle: 颠覆式创新的动力学机制 accDescr: 展现大公司受制于文化与组织包袱,而初创公司凭借资本与云原生抽象层直接发起颠覆 subgraph Incumbents["现有行业巨头 (Incumbents)"] A["相互盯防,忽视初创公司\n(如微软紧盯亚马逊与谷歌)"] --> B["组织与文化包袱\n(考核指标/销售分成/50万客户承诺)"] B --> C["难以重构业务基因与资源分配\n(算力配给/链条僵化)"] end subgraph Startups["初创公司突破口 (Startups)"] D["云与模型抽象层普及\n(无需自建机房或底层基建)"] --> E["资本密集度反转\n(巨额算力投入取代数十年工程壁垒)"] E --> F["直接挑战巨头腹地\n(如 OpenAI / Anthropic 领先谷歌)"] end C -.->|"让出颠覆空间"| F ``` Steven Sinofsky 剖析了大公司在面对颠覆时的典型盲区:巨头们从来不在意初创小公司,他们眼里只有其他巨头——微软天天死盯着亚马逊和谷歌的一举一动,根本不把初创生态放在心上。颠覆的核心驱动力是恒定不变的“物理定律”,即大企业特有的组织文化:销售体系、考核标准(Scorecards)、薪酬机制、既有架构以及为了维系 50 万存量客户而不得不背负的历史包袱。当一家公司坐拥庞大客群时,有很多事情它天然就做不了,整家公司被彻底锁死在既有轨道上。正如 Steven Sinofsky 所言:“Because the way you behave, if you have 500,000 customers you're serving, there's a bunch of stuff you just can't do. Like, you just... you're just stuck. And that is really the essence of disruption.”(因为当你服务着 50 万客户时,很多事情你是根本做不了的。你就是……彻底被困住了。而这正是颠覆的本质所在。) Martin Casado 借此对比了云计算时代与当前 AI 时代的范式差异。在云计算浪潮中,抽象层虽然极大地解放了创业者(无需自建数据中心、拉专线或联系 AT&T,在吃一顿晚餐的时间里就能让产品上线),但当时没有任何初创公司幻想能将 AWS 彻底拉下马,行业默认接受了寡头垄断,创业者只考虑在寡头的夹缝中做应用,时刻担忧巨头会不会随手把自己的功能当成免费插件吃掉。然而在当前的 AI 浪潮中,初创企业正在正面迎战巨头。 从历史上看,计算领域的壁垒一直是由极其复杂的超大规模工程构建的——无论是特雷西·基德尔(Tracy Kidder)在《新机器的灵魂》(*The Soul of the New Machine*)中描写的造芯片、研发操作系统,还是杰夫·迪安(Jeff Dean)那代人从零搭建分布式集群,这些需要数十年工程积累的底座是小团队根本无法逾越的护城河。然而今天的模型训练正在经历“资本反转”(Capital Inversion):这不再是单纯的工程能力竞赛,而变成了资本获取能力的比拼。拥有全世界最顶尖数据和工程储备的谷歌(Google),其基础模型却一度被 OpenAI 和 Anthropic 压制打得措手不及。这再次印证了文化的制约——巨头在工程执行上无可挑剔(例如 GCP 的工程实力极强),但要在内部调配出如此巨大的资本和算力资源,阻力重重。 - **巨头的资本困局与算力饥渴**:从财报电话会议中可以明显看到大科技公司对巨额资本开支的焦虑,谷歌甚至不得不通过债券交易将部分压力移出资产负债表;市场上更有传闻指出,某些巨头为了保障外部企业客户的算力,不得不限制内部团队的 Token 使用,导致其内部 AI 产品反而处于“算力饥饿”状态,而外部竞争对手却在全力狂飙。 - **Intel 与 Surface 的 ARM 冲突轶事**:Sinofsky 回忆当年为了防止微软在移动端被 ARM 彻底颠覆,他曾带着初代 Surface 样机造访 Intel 领导层。Intel 高管最初兴奋不已,但当得知机器内部搭载的是 ARM 芯片时,全场震惊且难以接受,反驳称“ARM 只是用在打印机里的芯片”并声称自己也是 ARM 被授权方。Sinofsky 极力强调低功耗、优秀图形与全天候连接的未来,但 Intel 的文化唯摩尔定律独尊,正如同谷歌深植于超大规模数据中心(Hyperscale)一样;一旦 AI 走向端侧设备,这种底色将导致他们彻底无所适从。 ### `55:00` 无法预知的百亿美元级数字人造物与生物医疗边界 探讨完资本反转的现象后,讨论切入到模型能力的本质推演。针对此前嘉宾 Vishal 对大模型做出重大原创科学发现持悲观态度的观点,Martin Casado 提出了全新的观察框架:从机械机制层面看,大模型的工作原理已经被完全摸清——它吃进海量数据,严格处于“分布内”(In-distribution),以纯粹的贝叶斯方式在流形上移动;它无法做“分布外”(Out-of-distribution)推理,不存在泛化的迁移学习(Transfer learning),技术奇点(Singularity)也未在短期内发生。但整个行业正在犯的错误,是低估了“尺度”带来的绝对质变。人类历史上从未创造过一个单体消耗了 50 亿乃至 100 亿到 200 亿美元算力和数据的数字人造物(Digital artifact)。正如 Martin Casado 所说:“I think it's just so hard for a human being to reason about a digital artifact, in this case the model, that was built with $5 billion.”(我认为人类的大脑根本无法去推演一个用 50 亿美元打造出来的数字人造物——也就是这个模型——到底意味着什么。) 当 Anthropic 这样的公司能够源源不断地从市场募集海量资金,并把几百亿美元一股脑注入到一个单一模型中时,这种“元经济机器”(Meta-economic machinery)的涌现边界已经超出了人类的预测认知。人们还在机械地追问“AI 到底能不能治愈癌症”,但真相或许是:虽然纯靠现有算法机制看似不行,可一旦把 200 亿美元砸进一个模型里,它可能就真的能在实际层面解决癌症。面对这股浪潮,业内人士能做出的最诚实也是最重要的态度,就是坦诚承认自己“根本无法预测未来”。Sinofsky 对此深表赞同,笑称自己当年针对互联网的发展写过 58 份战略备忘录,事后证明大部分预测都错得离谱。 Sinofsky 进一步结合自己的家庭生活谈及 AI 在生物医疗领域的实际应用。他的妻子是一位研究型临床医生,在家中部署了搭载英伟达硬件的工作站(两人开玩笑澄清绝非当年 Scott McNealy 时代的 Sun SPARC 工作站,而是现代 GPU 算力平台),用于处理神经外科和脑科学研究。在实际科研中,AI 展现出的强大威力在于“跨越海量经验发现隐藏模式”:一名普通医生无法读完某个细分领域的 10,000 篇论文,但吞吐了全部文献的模型能够瞬间捕捉到人类经验无法企及的数据关联,从而启发全新的科研方向和解题思路。 - **新药研发的核心瓶颈澄清**:Sinofsky 特别指出,AI 绝非自动发现新药的万能魔法;制药工业自 1980 年代起,候选分子(Candidates)的产出速度就远远超过了测试能力。制药最艰难的关卡从来不是候选分子的生成,而是真正的“药物有效性与安全性评估”(Efficacy and safety),这需要漫长、极度严苛的人体临床试验,这是纯计算方法无法一蹴而就跨越的现实壁垒。 ### `01:00:00` 从“递归自我改进”到“资本驱动的扩展律”:算力集中的新现实 Martin Casado 回顾了自己过去对 AI 发展轨迹的思考演变。他曾对 Nick Bostrom 提出的“递归自我改进(recursive self-improvement)”以及所谓的“快速起飞(fast takeoff / foom)”假说嗤之以鼻——那种认为只要创造出某种智能系统,人类退后一步,它就会迅速自我迭代并接管世界的末日论调,在现实中显然并未发生,业界许多同行也持有相同看法。然而,Martin 坦诚承认了自己当年的判断失误:他完全没有预料到,Scaling Laws(扩展律)竟然能够持续有效,并且社会可以近乎无休止地通过砸钱来推进模型能力。 Martin 指出,问题的本质已经从科幻式的算法自我进化,转变为现实中庞大经济机器对资源的极限集中。设想一次耗资高达 1,000 亿美元的训练运行(training run),由全球宏观经济机制汇集海量资金灌注进这套系统中。如果这笔天文数字般的资本被用来攻克癌症,固然是人类之福;但如果它被挪用来研发新型超级武器,后果将不堪设想。人类目前根本没有准备好应对这种规模的资源集中与转化能力,关于 AI 风险的公共讨论重心亟需从“智能奇点爆炸”转向“如何管控这种以前所未见的方式集中巨额资本与算力”。 Steven Sinofsky 对此表示认同,指出人们本质上面对的是一种以“美元投入”为度量衡的指数级增长,而人类的大脑向来极不擅长对指数级趋势建立直观认知。以往在复杂工程项目中,光砸钱根本无法直接解决单一的具体难题。Sinofsky 回忆起当年在英特尔(Intel)开会的情景:英特尔的高管们在一次又一次的会议上反复宣扬芯片主频达到了 5 GHz、集成了天文数字级别的晶体管,但在当时,整个行业里根本没有人清楚该拿这么恐怖的硬件性能去做什么。 然而现在的游戏规则彻底变了。Martin 强调,如今若想穷尽探索某种蛋白质的所有可能折叠与组合,人们可以直接把这个曾经深不可测的技术天堑,直接折算为一个“资金问题(money problem)”。Sinofsky 随之精辟地总结道,这种转变将那些曾经看似无限、不可逾越的难题,通过倾注巨额资本直接转化为了有限的问题,从而彻底改变了创新的本质定律——它不再单纯依赖传统的复杂工程研发,而是变成了纯粹的资本规模之战。对谈最后,主持人 Erik Torenberg 以此深刻结论为本期节目收尾,感谢观众收听并提示关注 a16z 播客的后续内容。 - “I did not know that we could effectively just continue to pour money in this.” —— Martin Casado 承认自己当年低估了扩展律的持久生命力,没预料到资本能如此直接、持续地放大模型能力。 - “I think you could reasonably argue that that's very dangerous if you kind of apply that $100 billion in the wrong way.” —— Martin Casado 指出将千亿美元级别的算力与资本集中投向错误方向,所带来的现实威胁远超科幻小说式的“算法暴走”。 - “Which is a great way to say it that we can take previously infinite problems and apply capital and it becomes finite.” —— Steven Sinofsky 总结了当今 AI 时代的全新经济学法则,即通过资本注入使曾经无限的工程难题变为有限可解的问题。 ```mermaid flowchart LR accTitle: 传统工程模式与现代资本驱动AI模式对比 accDescr: 对比传统工程中面对复杂问题时砸钱无法解决的困境,与现代AI中通过扩展律和千亿美元资本将无限问题转化为有限问题的演进路径。 subgraph OLD["传统工程范式"] A["复杂科研/工程难题"] --> B["堆叠芯片晶体管与算力"] B --> C["缺乏明确应用方向<br/>(砸钱无法直接攻克)"] end subgraph NEW["现代 AI 范式 (Scaling Laws)"] D["看似无限的难题<br/>(例如:穷尽蛋白质组合)"] --> E["千亿美元集中注资<br/>(规模化训练运行)"] E --> F["转化为有限的资本问题<br/>(以算力直接求解)"] end ``` ## Notable quotes > `40:00` You were capital bound and then you were engineering bound and now we're capital bound again. — Steven Sinofsky > `01:00:00` Which is a great way to say it that we can take previously infinite problems and apply capital and it becomes finite. — Steven Sinofsky > `00:00` Right now, if I give 20 people a billion dollars, they can actually use it usefully. We've kind of moved the industry from like this engineering bound problem to a capital problem that's fundamentally very different. — Martin Casado > `10:00` When you have a new level of abstraction that says this is a whole class of problems that can be solved, you can then build tools working at that level of abstraction. — Steven Sinofsky > `50:00` Because the way you behave, if you have 500,000 customers you're serving, there's a bunch of stuff you just can't do. Like, you just... you're just stuck. And that is really the essence of disruption. — Steven Sinofsky > `55:00` I think it's just so hard for a human being to reason about a digital artifact, in this case the model, that was built with $5 billion. — Martin Casado > `17:15` Those people didn't complain about when calculus came out. Because calculus was a baseline to them. And what it is is there's this notion – people react to change more than they react to the baseline of where they all started. — Steven Sinofsky ## Mentioned Martin Casado, Steven Sinofsky, Erik Torenberg, Jared Sumner, Claude, Bun, Cursor, Anthropic, OpenAI, Microsoft, Amazon, Google, Donald Knuth, John Hopcroft, AT&T, Curta, TI-85, TI-35, ENIAC, IBM, Bletchley Park, AlphaGo, Deep Blue, Frank Chen, Steve Jobs, Ed Catmull, Dana Lewin, NeXT, Tim Berners-Lee, Cyber Pizza, Osborne, Harvard Law School, Maxima, muMATH, Mathematica, Prolog, Patrick Collison, Sam Altman, Eric Ries, Ben Horowitz, Marc Andreessen, Dave Cutler, Windows NT, Clay Christensen, AWS, Tracy Kidder, Jeff Dean, Intel, Surface, ARM, Vishal, Scott McNealy, Nick Bostrom ## Video description a16z General Partners Martin Casado and Erik Torenberg are joined by Board Partner Steven Sinofsky to explore what recent breakthroughs in AI and mathematics tell us about where the technology is headed, and whether some of the basic assumptions that have governed computing for decades are starting to break. Martin and Steven debate whether AI's progress in mathematics represents a genuine leap in reasoning or simply a new tool for solving problems at a higher level of abstraction. From the four-color theorem and early computers to graphing calculators and today's models, they trace how new technologies have repeatedly changed which problems humans need to solve themselves, and ask what makes this moment different. The conversation then turns to one of the biggest shifts in AI: problems that were once constrained by engineering talent can increasingly be attacked with capital and compute. They discuss what that means for startups versus incumbents, venture capital, the coming wave of AI applications, and why pouring billions into increasingly capable models may force us to rethink what these systems can ultimately accomplish. [Source](https://mgln.ai/e/1344/afp-848985-injected.calisto.simplecastaudio.com/3f86df7b-51c6-4101-88a2-550dba782de8/episodes/038a6355-dd87-461a-84db-419d4c3f2643/audio/128/default.mp3?aid=rss_feed&awCollectionId=3f86df7b-51c6-4101-88a2-550dba782de8&awEpisodeId=038a6355-dd87-461a-84db-419d4c3f2643&feed=JGE3yC0V)

Source quotes

[40:00] Steven Sinofsky: You were capital bound and then you were engineering bound and now we're capital bound again. [60:00] Steven Sinofsky: Which is a great way to say it that we can take previously infinite problems and apply capital and it becomes finite. [0:00] Martin Casado: Right now, if I give 20 people a billion dollars, they can actually use it usefully. We've kind of moved the industry from like this engineering bound problem to a capital problem that's fundamentally very different. [10:00] Steven Sinofsky: When you have a new level of abstraction that says this is a whole class of problems that can be solved, you can then build tools working at that level of abstraction. [50:00] Steven Sinofsky: Because the way you behave, if you have 500,000 customers you're serving, there's a bunch of stuff you just can't do. Like, you just... you're just stuck. And that is really the essence of disruption. [55:00] Martin Casado: I think it's just so hard for a human being to reason about a digital artifact, in this case the model, that was built with $5 billion. [17:15] Steven Sinofsky: Those people didn't complain about when calculus came out. Because calculus was a baseline to them. And what it is is there's this notion – people react to change more than they react to the baseline of where they all started.

Source quotes

[50:00] Steven Sinofsky: The elements of disruption that matter are the cultural ones of being a big company, and those are constant. [0:00] Martin Casado: Right now, if I give 20 people a billion dollars, they can actually use it usefully. We've kind of moved the industry from like this engineering bound problem to a capital problem that's fundamentally very different. [55:00] Martin Casado: I think it's just so hard for a human being to reason about a digital artifact, in this case the model, that was built with $5 billion. [42:47] Martin Casado: The more capital that flows into private markets, the larger the market gets. [15:00] Steven Sinofsky: People react to change more than they react to the baseline of where they all started. [23:36] Steven Sinofsky: If you're really, like sad about something being solved maybe it wasn't worth working on to begin with.

Original transcript

[0:00] Right now, if I give 20 people a billion dollars, they can actually use it usefully. We've kind of moved the industry from like this engineering bound problem to a capital problem that's fundamentally very different. Math is very much a leading edge indicator of what the market might be interested in and why. Some people will walk in and say, the foundations to AGI and to reasoning is going to be math. But like that doesn't tell you anything about reality. For me, it's still in the domain of like, it's really good at playing a game. at the incumbents, and the incumbents just don't pay attention. Microsoft is worried way more about what Amazon and Google are doing than anyone in a startup space. Everybody who's from a big company in Silicon Valley, you always think, oh, my God, we're just going to crush all of these little companies. And then you realize they never get crushed. I think this is why we're seeing such meteoric growth of the cursors, the anthropics and the open AIs. the bottleneck was engineering. AI may be turning it back into a capital problem. In this episode, I sit down with Martin Cassato and Steven Sanofsky to ask whether AI is changing some of the fundamental assumptions we've built up over decades of computing. They start with AI's recent progress in mathematics, what these breakthroughs actually tell us about reasoning, why mathematicians are paying attention, and whether math is a leading indicator for where AI creates economic value. From there, they easy amount to a much bigger shift. For decades, giving a small engineering team vastly more money couldn't make them build vastly faster. Today, a team of 20 can productively deploy enormous amounts of capital into compute. Martine and Stephen explore what that inversion means for startups, incumbents, venture capital, and what happens when previously intractable problems can increasingly be turned into capital problems. So very curious about what's going on on the frontier of AI, and we're actually going to start getting into math. So Persol, thanks for both of you making time to come on the podcast. Jared Sumner tweeted a few days ago something along the lines of how he told Claude to try to solve the Riemann hypothesis and to try harder. And I don't know if there was actually any progress made, but it's part of the larger conversation around, hey, it seems like there's some accomplishments that are being made. How do we make sense of this in terms of what is actually happening and what does it mean for math? I'm no mathematician at all, but I mean, I think it's an important moment because it sort of divides the world into... Two groups. The groups that are just very, very excited. That, oh my god, these things are being solved. It doesn't matter if you understand them. Actually, nobody understands. The universe of people who understand what these things are is very small. And then there are the people who are just like, oh, it's fake. It's going to put people out of jobs. Then no one's going to know the future of where these fields go. And the most interesting thing about it is the group that's most excited, are mostly the mathematicians. And so that actually confuses everybody. Because if you're of the school, the people who are like, it's going to put people out of work, and we're going to all get dumber, and it's the dawn of idiocracy because computers are doing all of our work, you're confused that the people who are impacted most by what this level of AI did are the most excited. I think that is itself shining a light on this moment that we're in right now. You're talking to two systems, guys. Two product guys. I have the same caveat. I feel there's some things we're actually both very expert on. This is not one of them. So I'm going to kind of, from the peanut gallery, I've got two comments. So one of them is, okay, so I view economic utility to be a very important measure when you're talking about AI, right? So I was trying to think. There's a lot of hours been trying to solve some math thing, right? But if you sum up the entire... postdoc salaries of all the people that have been working over the years on these problems is probably not very much. And so part of me saying it's great that there's these capabilities. I'm not sure that the fact they've been longstanding is that much of an indication because there hasn't been a huge economic incentive in order to solve. Now, that doesn't mean that it's not hard or whatever. I just don't think we have that validation of this unlock some deluge of economic value. And the second one is It's kind of not surprising to me that AI is very good at solving problems. almost purely axiomatic Domain. that... you know, requires knowing a whole bunch of different things and putting the solutions together from very disparate spaces. Because often really when I read, so I've been reading all these, like everybody else has been obsessively, they're like, oh, like it came up with the solutions. Yeah, the solution is pretty straightforward. It's just like, barred from a bit of math that I didn't know. And so I think if there's like a meta learning here, the meta learning is there is a set of problems that probably require you to be too broad for most humans or [5:00] So education, then it's going to solve those. It's clearly very good at solving axiomatic systems, but I don't think it provides a strong indication of is this solving things that the market hasn't been able to solve? Because there really hasn't been a market around these. And so I think that's the next question for us to answer. So very exciting. It seems kind of reasonable, understandable, not sure what the longer term implications are. I do think that there's something interesting, that math is very much a leading edge indicator of what the market might be interested in, why. I remember when I was in school, Like there was some big thing that someone at AT&T invented a new technology algorithmic, a new program for doing linear algebra, like a new way to solve linear algebra, which is super important right now in the AI world. But his big thing was, well, now we can just calculate like the United Airlines flight map in three hours less time than we could last week. Right. But let's take it. So it's just not clear to me that the problems being solved are those that are roadblocks to like existingly economically useful tasks. Right. And if they were, it's not clear to me that they wouldn't have been solved. Like postdoc has been ruminating on a problem getting paid 30k a year for five years. Like it's very different than like the market has decided that this is like the one thing to unlock. And maybe they're there. Maybe these problems that economically productive use case. I just haven't seen that yet. So that for me is like the next thing I'm kind of looking for. I don't even know what 12 dimensional space is or what that means. And so like I'm completely with you. Like I don't even know what problems are in 12 dimensional space. Are you very skinny? Are you very tiny? I'm really confused by that. And maybe I'm wrong here, but for me, it's still in the domain of it's really good at playing a game. Yeah. Like this is the best Starcraft player ever, which is cool. And it's very powerful. But like I have a hard time connecting that. with A, like maybe the reason we didn't have them before is because there just was an economic need and B, like how does that actually map? And so listen, there's a huge range of these things. We get pitches all the time. Some people will walk in and say, The Foundations to AGI anti-reasoning is going to be math. And once you do that, you'll be able to answer every question because the universe is based on some fundamental mathematical principles. And once you understand that, you understand everything. And then there's other people candidly that walk in the door and they're just like, listen, that's great, but that doesn't tell you anything about reality. And so I think that there's more work to do. And this isn't just about getting better at math. I do think what's interesting is that part of the reason that mathematicians are very excited Basically, No abstraction in history. There's just a bunch of facts. And then people develop sort of these models that you can think of almost as force diagrams that explain war or famine or whatever. Whereas mathematicians and mathematics has this super long historic arc of layering on abstractions after abstractions. Don't worry, we'll get to OSI in a minute. But this idea that why they're so excited is a bunch of math all of a sudden becomes a new level of abstraction. So is it true that they're – so I've found that it's a mix. basis, the ones that are excited, they basically say, listen, it solves 20% of my job. Is it 20% I didn't like anyways? Yeah. So this allows me to explore a new frontier that's very important or whatever. And what I've always wondered is, is that... a function of the type of problem being solved. I just can't imagine if AI came and solved cancer, Like whatever, someone that works on Castro would be like, oh, I'm so existentially depressed. I feel like this is amazing. But let me – we're on the other end. I've always had this math for a while. I'm so depressed. I saw the math problem. Maybe like literally the entire utility of that problem was keeping somebody employed to solve the problem. Or just writing articles in the back like another attempt at and here's why I went wrong. So let me offer it this way. There's nothing on the other side of the solution. like this useless activity is gone. Let me stop. No, I think I'm too cynical on this thing. I love math. It's great. I think we caught you. But like being a little cynical, but not really. But more that it's just, let me take a side of it this way, looking at the history of computer science. Because I had to take this class, which I looked at all the course catalogs for a bunch of schools. You don't have to take it anymore. That was like discrete math. Yeah. Or algorithmic complexity theory, which was a required class for a very long time. And now. Do you remember Concrete Mathematics? Oh, yeah, yeah. I mean, you're a Stanford guy. I'm not. But like I stayed at school. We didn't have that. But that's a Cornell joke for us. Cornellians. But my class, I got taught by one of the luminaries in the field of algorithms. Ironically, a Stanford Ph.D. John Hopcroft. Of course. Who invented for the people who are pragmatic, invented like two, three trees and a bunch of as his thesis at Stanford. That's a legend. But John was our professor in all this crap. And we had to learn like all this P equals NP stuff. And I remember like this is the four. Is that the four colors? This is the four colors. Proven by computers. No, but that's where I'm going. You just buried the lead. [10:00] - But like, so those of you that don't know, we had to take a whole course in college on, that basically boiled down to this problem. And the interesting thing is why? And it was because... The theoreticians have postulated that if you can solve this problem in an algorithmic, in exponential, in non-exponential time, in polynomial time, then you could solve all these other problems like the traveling salesperson problem and all these other problems much, much faster. which mattered because all of our computers were just so compute bound. So if you were the AT&T people that gave... you know, like here's our node of like 6000 switches, like how do you route optimally? You'd be like, well, we don't have enough. That's like two years of running the simulation to solve this. And so it turns out that one of the interesting things was They proved the four-color theorem, but they did it. Which, by the way, the four-color theorem says for any 2D planar map, you can use only four colors such that no two adjacent areas have the same color. Exactly. And you only need four colors. You'll never need five colors. And we learn it just so you kids know. That's literally how we learned it, and we could all repeat it like that. It's this very weird imprint over this problem. What sort of happened was no one ever arrived at a basically what you could think of as a proof that looked like calculus. Instead, what they did is they actually proved that the number of potential solutions was finite. Have you actually seen the proof? Yeah, yeah, yeah. 200 pages of combination. But they basically proved that there's a finite number of them. And then they just computed all of them and said, look, it's only four dollars. And so it's this sort of bank shot proof. But it was only possible because of compute. the practical applications. Right, right. And certainly as a topology person. Like setting strong bounds and things like that. And I think that that... to me was just a really good lesson in, in, When you have a new level of abstraction that says this is a whole class of problems that can be solved, you can then build tools working at that level of abstraction. And everybody doesn't have to start from, like, okay, what's the 2-3-3 representation of what we're doing? It's hard not to get philosophical when you're talking about AI. So I'm going to get philosophical, and you can tell me to shut up, but I just can't. You kind of do. So this math thing seems to me a little different because it kind of begs the following question, Will math ever be represented a physical phenomenon, right? Like, has anybody ever, like, taken a bunch of equations and actually predicted something, like, physical? And I don't know the answer to that. So I worked in these large simulation codes. And these large simulation codes are actually trying to compute physical phenomenon like the explosion of a star or like, you know, what would happen to like whatever, an airplane in like an air simulator or a wind simulator. But all of those, and even though they're just calculating these like large, you know, differential equations, I don't know. They were all based on empirical results. Yeah. Like literally the equations of state for the – Well, they were a model. They were like, we can measure temperature in these places. That's exactly right. So it was all based on empirical equations of state. And so I've always wondered like – Like, is simulation computationally irreducible? And so you actually have to actually run the simulation. In that case, it's not clear to me to what extent AI helps. Like, I know people are trying to solve this problem with AI, but, like, I don't know if these math answers have any impact on that type of stuff, right? So maybe there's some separate algorithmic domain, to your point, where they do, or, you know, maybe, like, modeling or logistics. Thank you. Will this star explode? Will this building stand up like the actual simulation? I think these things are pretty disjoined. And then I read a lot of these discourses on the math solutions, and there's kind of these claims where if it can solve all math, you can predict anything. And I just think that that's a huge, huge logical leap, which is not clear to me that it is obviously true. Yeah, I think— there's any indication it's true at all. So the way, one way that I think I might But talk about that. Again, this is so out of my league on the actual math. That's what I'm doing to systems people. I'm inherently a tools person. And so I kind of get this part of it, which is – that What's happened is that... AI might not be the next tool to solve math problems at some scale that matters, but it might lead to the development of a new level of model. And so I brought like Prost to show this off. So of course, this is the original math tool. And so before something like this, this is one of these real ones from like Beijing, Mark. Oh, it's like actual. You know, it's the ones [15:00] I tell tourists, but I'm very proud of that because I negotiated it down to like seven cents. But, you know. That became a level of abstraction. And all of a sudden, like, you just had this basic math thing. And then you just fast forward a whole bunch. I brought this because it's just so freaking cool. I didn't. So this, everybody knows what slide rules are. You know, nobody knows how to use them. Yeah. This is called a Kurtteuf, which is an Austrian... Basically, it's a round slide rule. And so it's like a coffee grinder or a pepper mill. And you have all these ways you set the numbers on the side, and then you turn it one way to add, another way to subtract. And this thing is... Wait, is that used for multi-number arithmetic, or is it used for stuff like logarithms? No, it's only arithmetic, I think. But of course, it depends on how you use it. But... it's from the... mid-20th century, I think. And my uncle brought this back from the war. But what's incredible is this is like 600 pieces of machined metal. inside this. It would cost like $50,000 to make one now. Do you try to use it? I actually did, but I'm not going to try to do it. We're prepping for this so I wouldn't be a complete moron. Just go, ooh, look what I have. I actually went through the trouble of learning how to use it, although it's been sitting on my shelf for years. But the interesting thing is then all of a sudden a whole new level of problems gets solved. So you're saying that the new model is the new calculator or the new graphing calculator? I actually remember the TI-85. I remember when that came out They're like, all of the math teachers had this crisis. I'm like, you know, we used to give you a piece of paper where you plot the X, Y equation. Now they can do it on the calculator and they can solve equations and our field is dead. But what's interesting is this is why it's so important to AI today. Those people didn't complain about when calculus came out. Because calculus was a baseline to them. And what it is is there's this notion – people react to change more than they react to the baseline of where they all started. And so much of the concerns in a – I lived – I literally got like the TI-35 were the first calculators in schools. The only advanced math they did. They had a percent key and factorial, which we didn't even know what it was. And you could do like 59 factorial, and that was the max that you could display. allowed the whole deal i was on that i my whole life i've been on the cusp of allowed and not allowed for everybody i was i was there for the graphing calculator oh the graph like you literally have a blue book yeah just to show all of your work just to show that you weren't plugging it into the graphing yeah i missed the graphics which most of us were like actually writing video games in the back and could care less about its ability to write math but absolutely absolutely and but but you just play that backwards and you realize that after you know after these guys you went and then linear algebra and then calculus. And then with calculus, then you ended up with Fourier transforms and dynamics. And all that was first to your earlier point were all based on need. I mean, so much of this map... Well, all of computers... Computers are basically from difference engines which are just trying to calculate integrals. And of course, but to be really clear, to calculate integrals so that we could shoot missiles and cannons at each other. Okay, so that's what... Which I'm not judging. I'm just saying. I don't mean to be pedantic about this, but it's one of my favorite parts of history. It actually started with tides, which also has massive economic value, which you're trying to calculate the tides. And this is where you kind of have the old, you know. And then those architectures got co-opted into, of course, the Ward effort for the logarithms for that. This is where Ennei came from. Actually, it was very interesting. Ennei was about 5,000 times faster than a human being. when it came to, like, you know, doing this. And then, of course, model... And it didn't make mistakes, which was sort of the... But it was very specifically math. It was very specific for economic utility. And the interesting question to me is, is, like, these models are clearly going to do a type of math. Is it one that has somehow blocked some sort of economic? Yeah. And I don't know of the answer to that. Oh, yeah. But I think it's super interesting to keep going with that, because to me, what's so cool is that... That, that, Doing that, that basic calculus for the war and making those missile tables and things like that, then it unlocked the space race, basically, and jet engines and factory automation and all of these things. And, you know, people were cheering that on. Like, that, to me, culturally, is the most interesting thing. Like, there was just this... Not only were they cheering it on, every parent was looking at their kids saying, go learn that in school. Go win the Westinghouse competition. Go win the GE math competition. Was that because of the Cold War? Was it because – Well, obviously the Cold War was a big cultural part of it, for sure, but it was just a general, [20:00] The future, I found this incredibly cool brochure. from IBM, It's from 1953. Do you just have this stuff in your house? I just stumbled across it. This one I just got. I can't even believe this exists. But this is like, This is a brochure about the future is computing. I want to see it. But, but, but like, First, you've got to look. It's got like nuclear – like the whole thing. The future of computing is like a guy with like atoms racing around his head. Oh, wait. We're zooming in and doing the – Carol Merrill thing. But the fascinating thing is it's from 1953. So your ENIAC point, like, that's it. That's the computer at the time. This is pre-704, pre-370. And so it's a brochure from IBM. explaining what a computer might be not even is and it's like it took millions of years to invent and recognize the usefulness of the wheel that's the opening sentence on of of the and and but like you people were eating the stuff of it but here's the part that i want to get to it talks about computers and it's the two families of computers yeah and so of course you get the slide rule yeah and that's explaining the history and what this is really leading up to is we could do this for who's reading this in 1983 that it has to explain hex and decimal and binary and compare it to Roman. That's amazing. Because like nobody like nobody knew. What's the name of that thing? It's just called IBM Light on the Future. I love this. With like a rocket test tube-ish spotlight looking thing. And it's incredible. There's like oscilloscope waves in the back. It is the most incredible thing. It has this dictionary in the back. Imagine the first time someone explains a computer and the dictionary is, you know, Arithmetic unit. Binary digit bit, you know, like cathode ray tube, electrostatic storage tube. But the thing is, the reason I open this is because there's one cool page that really matters. What is the organization of digital computers? And so this is the thing that gets to this point about abstraction for us and AI. These have been, for 75 years, how we thought computers were organized. Input, storage, arithmetic, control, and output. And that's all – that's what we learn in school. You took courses basically in each one of those. Last night, we were going back and forth on the abstractions that will remain in computer science. And you tossed in networking, which is sort of control. Everybody forgets networking, by the way. Yeah. Of course that was. Well, because most people – Stop worrying about networking. Stop worrying about it as soon as the packet leaves the computer. Well, and probably – I would say the late 90s was the end of basically a mandatory networking class. Because, like, it was solved. Like, there was no, you know, for me, it was the transistor. I was, like, the last time that computer science majors had to know what a transistor was. And trust me, I actually don't get what one is now. It's like a triangle symbol. But the interesting thing is those abstractions led to, okay, so now we have those abstractions. They were basically fields that did each one of them. Like, you spent 20 years of your career on storage. to tapes and so on. And if you did output You watch the invention of going from a teletype to a line-oriented teletype to a terminal, black and white, to color, to vector, and the whole deal. And all of those were the fields, and they all rose in parallel. Any CS department, which came out of the MAP department because of the missiles, ended up being like departments made up of those things. And then it all collapsed and produced us to the systems group. Yeah, yeah, yeah. So let me just push on one angle of this. Sure, sure. love the framing and we move up in abstraction and every abstraction there's still a set of problems it's just a higher level of abstraction but i still think this kind of notion of economic need is very oh yeah yeah right so for example um we we we you know bletzley park was about cracking a code for a war and so like there's this effort that created innovation, that the outcome was, you know, winning world war two, um, any act, we were trying to do nuclear, not just research, but like innovation, you know, in terms of a war effort. And so we needed to like calculate integrals and we were doing it by hand. And so, so, At that point, These things were lauded as like saving humanity. Everybody's super excited. All the physicists loved computers and used computers. And for me, the thing about the current solving math is I don't know what that thing on the other. Oh, yeah. No, but the other side is. And I do think we've had that in the past. And so. Well, we did. We had the AlphaGo moment. It was the same thing. Like, we did a podcast, not in this room, but... But even before AlphaGo, we had, like, remember when Chassel was bitten in a chest? Yeah, we had the IBM chest thing, whatever it was. And Frank, Chad and I, we did this podcast at AlphaGo, and we had to try to make people understand, like, [25:00] Why it was a good idea. And I think it's actually pretty reasonable for us to ask the question, which is there's things that these things solve. And, you know, there's a lot of utility and value in that. And like that's going to move things forward. And when that tends to happen, people tend to be excited and get behind it. And it's these things you saw where I think – people don't have as positive a view. I would submit that's because it's almost like solving the problem had become the the end as opposed to the actual end. But as we should maybe all step back and be like, if you're really, like sad about something being solved maybe it wasn't worth working on to begin with right and so look of course you know and you're like doing the sand mandala and like you think inner peace or something like that's not moving the economy forward right well we're both look we're systems people but i'm actually an apps person i know you don't like system yeah we're both systems people but but like i or system i of course absolutely think that the way that matters are apps. And of course, the Internet Also, this same problem happened in 1995 and 96 with the internet, which was – It was very exciting, but most people just sat around saying, I don't know what that does for me. Look, there's a great book out now called Steve Jobs in Exile, which I absolutely think is required reading if you're listening to this podcast. So Kane wrote the book, but it's with Catmull at Pixar and with Dana Lewin, who was at Steve's super good friend and was also at Microsoft. This book is just fantastic because it explains all of – it encapsulates all of this notion of like building things that people actually need and solve problems. But it pointed out very clearly, you know, the Next was actually the machine that Tim Berners-Lee used to write the HTTP protocol. Right, so he actually – A Next machine? And he used the Next machine. That's interesting. And it's super interesting because nobody knew what this machine was for or what it did. machine was for what it did because he's like well it's to find the phone numbers and other researchers and to share papers and and like yeah Like, and I think there was a great example of a company, a Seattle-based company, That was called Cyber Pizza. And this was like a dot-com thing that didn't even make it to the 2000, I think. But the idea was it was basically on – or DoorDash for pizza, only pizza. And they would basically – you would order, and then they would figure out a pizza place near you and send the pizza. That was the launch demo for the next on stage. They did that, and they had actually pizzas in the back in case it didn't work. And I should say for next step or open step. showing what you could do with it and literally the reaction was like wow that's really cool but have you heard of the telephone yeah your point is not everything we've known how to use so i'm a little focused on like there was a solution on the other side that people are going for you're making a point that there's a lot of platforms that get built where that's not clear but clearly well the you know the spreadsheet was like i i will i will show here's my probably one of my last visual aids for today but like the word processor came out and and and this is in 1982 this new kind of computer called CPM, which is the origin of DOS. And people were like, I don't understand. I think you just type. And the people, once you used a computer, the idea of typing really, really just didn't work anymore. And so some people at law school. Well, you have to show it now. Yeah, I will. I'm just like building up. But these people at Harvard Law School, they brought in the first laptop. So that's the first laptop. Weren't those called luggables? Well, no, this was literally just called an Osborne, and it was the only one. So as a guess, how, Eric, You're a kid. How long was the battery life in this? Um, I, Not long. There was no battery. This giant case that weighed 25 pounds, there's no battery in it. It just plugged in. But that was a trick question because every time I've ever vlogged mine out, I have mine from college. Like people are like, well, how long does the battery last? And so it's literally the size of a sewing machine. It's bigger than a legal carry-on. ever was. And that was my college computer. But in in my senior year of high school, it got banned from Harvard Law School. So some someone showed up to do their exams. So at Harvard, they used to bring your typewriter to exams. Because that way the professor could read it. And two kids brought computers in. One brought an Apple II and one brought the Osborne. And the school banned them. They just said this is – and for every reason you could read – and I have the Time Magazine articles and the New York Times. Every article you could read reads like don't use the graphing calculator. Don't listen to rap music. Or don't read – no jazz. Or the arguments that are going on now. AI in freshman writing. and they just stopped talking to me. [30:00] Wow. But here's the irony of that. My freshman year, when I had this computer, I was, of course, the only person in my 90 person dorm with a computer. And and I had to get permission from the dean to use it to write my papers. For freshman English. This is the fall of 1983. And so, And so that's exactly where we are now on all of this stuff and this whole – but the thing is it's a – you can also think of it as a level of abstraction because like no one's going to college now without a computer. Can I just put... So I agree with you, but let me... Right, right. Every once in a while, I'm like, well, maybe it's a little different. So here'd be the argument. Um... I don't think of the history of computer science that I can recall. Have we ever, um, abdicated, um, actual reasoning or logic it's always been a resource right it's been like compute network and storage and like that's what you're providing and then the human is like putting in the high level thing and then it's using the compute network and storage to to like calculate the answer but like all of the kind of initial setup we're providing we're in And I guess maybe it's not true for the internet, but now I feel like you're actually abdicating thinking. in a way, where you're like, tell me the answer. Like, I'm not even really sure what the question is. Right, right. And again, like, I think maybe you could say, well, Google was kind of like that, too, but it was still very much a social thing and not very much. And so it does feel like that's a little different than just going up in abstractions, because... Going up into abstractions, you still tend to have like a deterministic system that's a higher level of abstraction that like you have a computer and like it's the human being that's kind of defining everything about the problem statement. It feels a little different. Well, it definitely feels different. I also think, for me, graphing calculators felt different. To me, graphing calculators felt like cheating. And because, you know, the test question was make a graph. And so that's what's going on right now is that the capabilities match the test question. Now, getting us full circle to what we were talking about. about computers and mathematicians. My freshman year, also a new product, a new thing came out, and it was Maxima. which was the MIT... symbolic math package. And so this was a way you could literally type in like an integral. into a computer. I remember the first time I saw Mathematica, I'm like, this stuff has black. So Maxima, it was, you know, machine-aided What was it? Machine... Aided computation, symbolic math, I think was the, and that was the lab at MIT started in the late 60s, early 70s. And that had started to sweep through. So my freshman engineering class, we had a version of it that ran on IBM PC. It was called MuMath. And like you could like we got our calculus homework. You marched over to the engineering library, checked out a PC disk and then just typed in the answers to. And that was cheating. Let me just push on just a little bit. Because I tend to agree, but every once in a while I have moments of doubt. So I don't remember writing programs where you actually abdicate logic. Like if I'm writing a program, I'll like whatever. I'll use a cloud database. I'll use storage. I'll use networking, whatever it is. But like correctness and logic for the program is under the programmer's control. But again, like I'm choosing the library. I know the inputs. I know the outputs. And I feel like we're entering this realm where you're actually abdicating logic to a third party. You're like, tell me the answer. So maybe that's just a higher level of attraction. It feels a little different to me. No, look, that's the debate. I'm like, I'm all in on the debate. Like, here's an example of that, a Stanford example. So in the, during the AI winter, that was the 80s. Stanford, the biggest. One of the AI winters. from 15 years ago. One of the biggest things at Stanford was to combine new AI with the medical school. And so there were all of these projects to do like medical diagnosis, chemotherapy, and kind of stuff. I worked on one that was doing organic synthesis with a team at Harvard And all of those were sort of the earliest, like, let me turn over the decision making. In fact, that's the whole era of the 80s and computers were the dawn of what they used to call expert systems. I remember them. And so expert systems were the first time we got a taste of this debate. I remember very well. Your classes were all this. It just didn't work. Well, your classes were mostly… You had a bunch of classes on this stuff. Hons of excellent expert systems. I've had to build expert systems. I've written a lot of prologue. I very much understand it. I just thought that never really worked. Right. So the big difference is that stuff was working. But now it's working. And we're abdicating logic. So it's interesting because to compare and contrast. Even in the case of prologue, you're coding it. It's algorithmic. [35:00] You're still providing the end state and it's just like finding a way to get to the end state where here like you're almost asking what the end state should be. So it just feels a little different. And it's especially so I agree like I love having this debate because I think. So much of it boils down to the concern and the willies that you get thinking about it. It's actually because of the context we're in. And like because, you know, think about like we have all this stuff going on where people don't want to build data centers. But like two years ago, people were like beating each other to please governors were racing to have data centers built. Or, you know, 10 years ago, like build a car factory in our state, the one that billows smoke and is really hard labor. discussions. You can't separate them from... Right, but I just want to go back to this later. Yeah, and I don't mean to... I just think, so... Your, my entire career has been moving up layers of stack, but like it's always a computer layer of stack. Yeah. Yeah. You can always map it down to like the next layer in basically a deterministic way. Yeah. Yeah. It's high levels of like compute abstractions. this is the first time it feels like a different layer of the stack. Like maybe this is like really is the next abstraction, which is more of a human level abstraction, which doesn't map directly. And so it's actually different. So it may like, I think, you know, whatever it is, starting with like, you know, Like transistor logic and then going to compute and then going to like hardware and then going to OSs and then going to like applications and then going to platforms. Like you've been moving up the stack that way. It could be the case that like we're at a layer where like we have to rethink fundamentals. Because it feels a lot different to me than just like this is the next layer. Yeah. which is where we've been and where everybody is, to now, and then we were in this, for a brief time we were in this mode where basically the data really determined the program. And that was the first recognition, all of the inference and everything. And now we're at this where it's arbitrary, it's random, and it's statistical. Right, so the way that I think about it is the following. So imperative programming, you know all of the steps, so you write the recipe and it follows the steps. Okay, then there's declarative programming. end state. Which is this prologgy kind of thing. Or data log. Or SQL. You know the end state, but then the computer does all this stuff to get to that end state. And you can't really bound the compute time. So you're like, this is like a make files. Here's what the end state looks like, and it does it. And this is like this new thing where – It's almost like you don't really know what the end state is specifically, and you just kind of like – you kind of like pray to the model god in like the right words, and then it produces the answer that just ends up being useful. Yeah, yeah. In a way. But I – look – And it is fantastic. That's a factual statement like that, but it's also interesting to think about it going forward. in terms of Is that itself the next layer of abstraction in how we think of computing? Yeah, and it may be like computing. It may be like this is where I compute. Or like natural phenomenon actually intersects pretty heavily because the answer is produced from human output, which is language, which is kind of different than like… If we do need to rethink some fundamental assumptions, what may that look like? Thank you. Well, I just think that people like... Steve and myself have built these deep intuitions on how systems function and how they hit the industry based on – 40, 50 years of like watching this stuff. And I just don't know, like things like will value go to the model or to the app? How much capital can you apply to this stuff? What classes of problems can you solve versus not solve? What guarantees can you provide? How does this impact productivity? There's a lot of things that we've got intuitions on. And for me, the big question is, do we have to reshape those assumptions or not? And to what extent do we have to? Because lots of physics feel a little bit different. I'll just give you one example. I mean, I've said this many times. I think it's so important. 20 years ago, if you're a startup of 10 people and I gave you a billion dollars, what would you do with it? You would end up spending a... a ton of money on building and buying your own computers and things, if that's where you're going. Well, you hire people, you buy computers, you grow up. You wouldn't know what to do with a billion dollars. Oh, I see what you're saying. You hire engineers and you'd be fine. What do you do? Write code. You've got to, you know, you've got The important part of that is it's a billion. It's not that you got money, it's that it's a huge, it's a ton of money. If I give you a billion dollars two years ago. Because 10 million, you'd buy a bunch of stuff from Hewlett Packard and the money would be gone. Yeah, for sure. Right, right. This one is a billion dollar, yeah. [40:00] in software, you hire people and then there's nothing you can do. The mythical man month is very real. And right now, if I give 20 people a billion dollars, they can actually use it usefully. It's very, so it's like, it's like we've kind of moved the industry from like this engineering bound problem to a capital problem. That's fundamentally very different. We've never been like that before. And so like, this is like a law of physics where like our early intuition, which is like all problems, your engineering problem starts to change. So I think there's this very open question we should, especially people like us asking, which is like, to what extent do we have to reevaluate our priors on this stuff? versus innovation versus competition versus defensibility, etc. That's a great way to... to think about it because it forces you to think about a new model. It's also interesting that Computing was capital bound. for the first 30 or 40 years. Like if you wanted to do something, that's an important point. If you want to do something with a computer, Like your first step was we have to get one and then you couldn't. You were capital bound and then you were engineering bound and now we're capital bound again. Yeah, which is crazy. So it's almost like you have to like hop back 40 years. Yeah. Mad Men goes through the scenario where the computer shows up at the advertising agency. And they run around trying to figure out, explain what it does for people. Which they also got a copy machine, the same thing they did. But it was interesting because they couldn't figure out what to do, but they were excited that they had the capital to acquire one, and it made them look like they knew what they were doing. Five years ago, Patrick Olson interviewed Sam Altman in a podcast, and Patrick was saying, hey, we've been in this era of lean startup, but for your projects, OpenAI, this sort of energy project you was involved with, a few other aging thing, you've raised colossal amounts of money right out the gate. And it's sort of just speaking to what you're saying. Yeah, yeah. You know, it's interesting. So prior to AI, there was always this battle between Eric Rize and Ben Horowitz, right? Yeah, yeah. So you lean startup, and then Mark and Ben wrote, like, the art of the fat startup. Which basically, you'd raise the money and go for it. But there's always been this natural limiter, actually, which is the engineering complexity. Oh, that's actually been the reality. And so Patrick Collison is right. using it productively. That's a very, very big change. I don't think we've internalized this. Which also, it's incredibly... That is... why there can be so much optimism now. Because although capital is scarce and it's hard to get and all of these other things, once you get it, As we know, the building based on people was also hard, like just scaling that and doing more. And then nine people can't do anything faster. I'm telling you, yeah, my... 10 year job, you know, was recruited and giving, yeah, it was like literally giving, these early teams' money and then helping them accrue and then watching and waiting for two years. Well, yeah. And I think engineering just doesn't scale. It also has implications for venture capital because for the last decade, people have been saying, hey, there's way too much capital. Yeah. Way too much capital. I just think this is such a crazy view. So there's been this view in venture, this zero-sum thinking, which is funny. Yeah. People, it shouldn't be zero-sum thinking. You know, like, and they'll go up on. Too much capital is chasing too few deals. And all this is like, you're a venture capitalist. Don't you believe in positive sum stuff, right? The more capital that flows into private markets, the larger the market gets. And there's a couple of reasons. One of them is the one we've talked about, like technical waves that actually are able to consume capital like AI. But there's another one is if there's more capital available on the private markets, companies will stay private longer. So more value accrues on the private side. And so I think capital going to private markets grows the TAM. It's not a limited TAM. And I think the people that should be, there's some funny early stage venture investors who should think of like, you know, positive sum outcomes need to stop thinking about zero sum. Well, one way to think about that is, bring it back to what I I think your foundation enables what I think is the most exciting thing, which is we're really on the cusp of a wave of apps. And like the fact that now you can apply capital without also being a recruiter for 10 years and have output. Now all of the world that's unserved by software, which is literally all of it. Like everybody who complains about whether it's medical records or scheduling to go to a doctor or my favorite are lawyers. Like nobody has cheered more that, oh, my God, we're finally able to automate lawyers with AI, which is the weirdest thing in a world where everybody is against everything. more lawyers. But all of this, this means that the person who has the domain experience, like we used to love the venture capital thing, like, oh, it turns out it's really, really hard to build commercial real estate. Wouldn't it be great if somebody who understands commercial real estate built a software company, but then they don't know how to build software? Well, they should get a co-founder who knows how to build software and teach them about 20 years of commercial real estate. It's really hard. [45:00] Oh, the path... from that kind of idea is a capital problem. And that's a new level of abstraction. And I mean, I remember my very, very first customer visit as a professional product developer was, was to visit a doctor who happened to have gone to medical school after majoring in the earliest computer science. Oh, wow. And he wrote like a DOS program to schedule a doctor's office. That's amazing. Which you'd think it's just scheduling. It's a calendar with hours. But it turns out this was me, a 20-year-old me, hearing this guy explain, no, you don't understand. You call the doctor, and you're talking to a scheduler. So they're listening for keywords – to decide, is this five minutes, 20 minutes? Do they need the x-ray machines? Do they need the EKG? And so they're actually scheduling like a blood draw and all of this stuff in parallel, not just the 10 minutes you need with the doctor. And so that's what his software did. It took him years to bang that out himself. And that's the kind of thing that's going to be able to happen. Like now that problem... can get solved by the person who knows no code is finally here. Well, it could really be. And, and, and it, and it might actually be that, that you're not just building this throwaway code that's hard to do, but also everybody else's abstraction layer is rising. So the, You don't need to design that piece of code. If you're doing it for a phone, well, the phone's abstraction level has risen. So you're not building a text control. You're not building UI controls. Whereas 20 years ago, step one of building a company was building all of those things. And so there's a lot to how important this is in terms of what you're able to do. I want to talk about any other fundamental assumptions that might be interesting to revisit. Is it sort of, how about incumbents versus startups? You know, we've talked a lot about the innovator's dilemma. Does that, you know, now that these startups or these incumbents have the capital advantage, are they able to do more? But at the same time, we're seeing startups that you would think incumbents would just destroy. This is the craziest thing. If you would have told me. Six months ago, you'd have asked this question, say, what advantages do incumbents have? They have the same advantage incumbents always have. They have the capital. and they have the cash flow, and they have like, whatever. Distribution. They have distribution. And like, what's crazy is AI... A, solves the distribution problem. It solves the demand problem. And B, these companies are able to raise so much money that they're actually on competitive footing with the Microsofts and the medicine companies. and the Microsoft. And so I think we're in a very new territory when it comes to these new challenges versus the income, specifically for these two reasons. You know, I think that the distribution point is often misunderstood how impactful it is. In the past, if you had a company and you wanted to get people to use your stuff, it was hard. You'd hire marketing. You have no idea how much to invest and where. You didn't know what you were getting on return on investment. But the demand is so unlimited for tokens and for GPUs. Literally, you can just decide how much money you're putting into it in order to drive top of funnel and growth. And so the things have typically been very, very hard for startups. are much easier. And I think this is why we're seeing such meteoric growth of the cursors, the anthropics, and the open AIs, That is results in capital access, and that has put them on uneven footing. So very high space. And I think it's to your point about – Look, my whole life was managing thousands of people, of engineers, to build things that couldn't be built anywhere else. Like, it was the moat to build an operating system. It was infinite. And I think... You have to have one cutler? Is that the... Well, it's... But it's... It really... Read... That was mostly it. Yeah, I know. No, I get it. He's brilliant. But read the... Read the Steve Jobs in Exile book because you really get a sense for building up. In fact, of course, Next was famously just – it took the code from Mock at Carnegie Mellon and started from there. We couldn't have done it from scratch completely. But this whole idea – of just... how important it is to think through the domain-specific and how you disrupt people because There was an old joke at Harvard Business School when Clay was still with us, which was they really – it's weird that they teach disruption as a theory in the business school when really it should just be a fact in the physics department. and I love that I was there in 98 when he was writing the book and the paper and everything that's when I was teaching and I And I really – I used to be – of course, there's a lore with everybody who's from a big company in Silicon Valley or when you arrive like I did. The theory is always like you always think, oh my god, we're just going to crush all of these little companies. You always think that when you're at the big company. And then you realize that they never get crushed. Ben always makes this point. They just, and Mark does in his movie. It was AWS actually put out of business. Right, right, exactly. Because the startups don't aim straight at the incumbents. Yeah. [50:00] just don't pay attention. The incumbents are only interested in what the other incumbents are doing. Microsoft is worried way more about what Amazon and Google are doing than anyone in a startup space. But that The elements of disruption that matter are the cultural ones of being a big company, and those are constant. Those are the laws of physics. And so you just can't change those. You can't change scorecards. You can't change field sales and go-to-market and compensation and org structures and legacy and customers. Because the way you behave, if you have 500,000 customers you're serving, there's a bunch of stuff you just can't do. Like, you just... you're just stuck. And that... is really the essence of disruption. And that's why we're at a magic moment where – It's not just that the culture is there like it always is, but the startup ecosystem, it has – It's a reflection of what happened during Cloud, which was a whole bunch of stuff that you needed, again, it's this abstraction layer, you don't, you know, if you're a startup like you were, you don't have to go build a data center and build your own egress and call AT&T and do all of that stuff. Now you're up and running in the first hours of your first dinner. But the thing with cloud, I actually think it's – you actually articulated it very well. I'm going to actually use this because this is great. The thing with cloud is nobody thought they could put AWS out of business. Right, right. You just kind of accepted the oligopoly and you built on top of it. And the question is, will they kill us in our little kind of pipsqueak corner? Will they just add you for free or for some price you couldn't add or whatever? I actually think, and that's always been the question, will Microsoft take the app? But now these companies are actually taking on the incumbents. And you make this great point, which I actually had thought about it this way, but like, Kofi's been defined by these very complex, large engineering efforts building a chip. Building a system. What's that? The Age of the New Machine? Yeah, yeah, yeah. The Soul of the New Machine. What a beautiful book, right? It talks about how hard it is to build these systems, building an operating system. Even in the cloud, I mean, Jeff Dean in that era of people were building these distributed clusters, and they're the first time that people could figure out how to do that. And once you had that, that was a massive advantage. So these were these massive engineering efforts that no startup could do. And now for these models, it really is just capital access. There's some very different laws of physics where like if you can amass a capital, you can do something like, you know, I mean, Google is Google. They have all the data. They have all the intelligence and like their models are getting trounced by open AI and by anthropic. It just goes because the cultural element. I think that People on the outside underestimated it until you've lived the cultural element of trying to – to do siding. I'll bet it's cultural. It's not like a typical, you know, engineering problem. Like, they're very good at it. Because they've out-executed, like, GCP is fantastic. That's an asset of engineering. And then also, I bet it's probably hard to free up that much capital for one of these companies, honestly. Well, all the big companies, You can tell from their earnings calls, how consternated they've been over the capital. You have Google doing their bond deal to move it off balance sheet basically in some weird way. You had the rumors of, I don't remember which company, you know, the rumors of like, well, they're rationing the tokens so that they go to the enterprise customers and not to the internal products. And so the internal products are AI starved. And of course, none of their competitors to those products are starved. And I... I've learned to really appreciate the... I mean, look, I fought and fought and fought to not be disrupted by the mobile platforms, like by ARM. basically, and Intel just didn't care. You know, I came down here, I sat across the table from all the Intel leadership, and I pulled out the first Surface. And I said, here's our new computer. And they got very excited. And then they were like, but what's in here? I said, well, it's an arm chip. Oh, wow. And, you know, like the fact that I even brought one into the building – You know, and it was very, very tough. And, and, And they just never felt that that was going to, that, that was like a chip used in a, in a printer. And also, and they looked at me and like, we're in, we're, we're arm licensees. We, we knew all, and I'm like, But it's the power, it's the graphics, it's always connected, all of this stuff. And the culture was they do Moore's Law. at Intel. And just like with Google, they do hyperscale. Yeah. So like if AI moves on device... Yeah, of course. Like that's not what they do. Yeah, sure. And, you know, with Microsoft, they were squeezed. They're squeezed now. you know, and, I think you've raised super interesting points about the opportunity, though, with this capital inversion. Yeah, go raise capital and go after the bill. Well, and it's not just... [55:00] It's like you're also saying like we're actually not going to question you. if you're trying to raise that capital. We're not going to look at you like you're crazy. And you just look at the raises that are happening, right? You know, these companies have been quite successful as a result. Yeah. Die um. Last thing, when Vishal came in and we had him on the podcast, he was sort of, he thought all of them were a great achievement, but he was bearish on their ability to invent new discoveries, particularly like scientific breakthroughs or things like that. So here's kind of my new view, which is, I think we know exactly how these things work. You put a bunch of data in them, they're stuck to that data. They can only do in distribution stuff. and they can move along that manifold. in a perfectly Bayesian way. So we can say these words. And then the question is, okay, but what are the implications of that? Like what problems can it solve, right? I think it's just so hard for a human being to reason to reason about a digital artifact, in this case the model, that was built with $5 billion. So like in the history of humanity, we've never created a single digital artifact that had that many flops and that much data in it. So on one hand, we know exactly how it works from a mechanic standpoint. On the other hand, that is so much data and it is so much compute. Maybe all of that stuff's already in there and it can solve anything that you want. And so, The conversation has moved from the how do these things work. We know. Can it do out of distribution stuff? No. Does, you know, is there transfer learning? Probably not. Like if I don't know one thing, it doesn't teach something else. Like is the singularity here? Probably not. I think everybody kind of, many people kind of agree on, like we're not in fast takeoff. You know, we're stuck to it being in distribution. We haven't closed it. We all agree about that. Boat. What I don't think anybody knows is Okay, but you're still putting 10 billions of dollars in that thing. What's it capable of now? And if you consider this meta-economic machinery, which means The ability from Anthropic to raise lots of money and then pour all of that money into this thing to create this super powerful thing. I don't think any of us can predict what that means and where that goes. And so it's a different conversation, but the question is the same. It's like, will that be able to cure cancer? Maybe. But if you put $20 billion into something, maybe it can cure cancer effectively. And that's where I think the discourse has evolved and where it is now. And I honestly have decided that I cannot predict. But an artifact that was... You use $20 billion to create as capable of. Look, I think it's just so important. It's important for people who are deep in watching everything that's new to admit that they can't predict. And I think that that's great because it turns out, like, I wrote 58 memos on what the Internet was going to be. And I was wrong, a lot of them. by far. But I do think on the... But even this one is a little different. This is like, I take $20 billion and I put it into a model, and then you and I look at that model, and we can do whatever we want. I don't think we can comprehend the like what that even means. Yes. So many flops and so much data. Like, I don't know what that's capable. I, I, and I think we are, I think that that's really true. And I, and I think, but I will say on, on, Biomedicine in particular, look, the other half of my household is a research doctor. who uses ai we have a spark at home and she's loaded us like art like a ton of sun spark no no uh uh uh nvidia spark oh yeah no no no not not with a c or the k oh yeah wow we were in old times there for i was like not a scott mcnealy spark no no um and and no and and um And it's all AI. She does brain stuff and surgical brain stuff, all AI. And it's so interesting to see because what it really can do is it just – It sees the patterns that only experience could tell somebody. But if there's 10,000 papers on a topic that's part of her model, then it's just finding the patterns that no one has. And that's a pretty basic AI capability at this point, but it's actually opening up solutions or problems or research directions and things like that. I will say just for the like, this is not a magic to discover drugs because the hard part of drugs has always been candidates, not candidates. It's always been efficacy and safety. The candidates have, since the 80s, have been able to develop more than we could test. It's human patience, and it's very, very, very hard. can I please tell you something that I got wrong on this so [60:00] I love the question that you asked, which is how's our thinking evolved on like, you know, whether these things, you know, like their capabilities in generality, which is I was responding to this Bostrom notion of recursive self-improvement, fast takeoff. You create one of these things, you step back and it takes over the world. Right. And so I kind of pooh poohed that because that's clearly not what's happening. And I think most a lot of people agree that that's the case. Right. But here's what I got wrong. What I got wrong is... I did not know that we could effectively just continue to pour money in this. Like, the scaling laws are holding. And I don't... I don't know what it means to just, let's say we do a $100 billion training run to have this thing that you're putting $100 billion in And then that money... comes from this meta-economic machinery that may be able to want to solve whatever. They may want to solve cancer, but they may also want to create a weapon. Like, who knows? And so this... concentration of this many resources in a useful way, I think, is very new. I don't think we understand the implications. I think you could reasonably argue that that's very dangerous if you kind of apply that $100 billion in the wrong way. So I think that's kind of where this conversation needs to evolve. two, so less the foom, you know, and more the what does it mean to be able to concentrate resources? Which also was... I mean, you're basically talking about exponential growth. And this is just exponential in dollars. And we all know none of us can model exponential very well. Yeah, but we've never been able to do that. Like complex engineering project, you were not like tackling one problem with a lot of money. You're just kind of building this machine. Well, you're right. You're 100% right. And I completely agree. But I remember just sitting and meeting after meeting, Intel saying we have five gigahertz, we have this many gigahertz, this many transistors. And literally, nobody knows what we're going to do with them all. the machinery i'm saying this yes if you're like i want to exhaustively explore every protein combination right we can just turn that into a money problem yeah yeah very strange which is a great way to say it that we can take previously um infinite problems and apply capital and it becomes finite just makes a capital problem and not an engineering yeah yeah which is just a very different loss of yeah yeah let's wrap on that because it's a great episode thank you guys for of the A16Z podcast. If you liked this episode, be sure to like, comment, subscribe, leave us a rating or review and share it with your friends and family. For more episodes, go to YouTube, Apple Podcasts, and Spotify. Follow us on X at A16Z and subscribe to our sub stack at a16z.substack.com. Thanks again for listening and I'll see you in the next episode. As a reminder, the content here is for informational purposes only. It should not Thank you. Bye.