MakerMaker Sees Self-Improving AI Cut Costs While Raising Performance

The Race to Recursive Self-Improving AI — Martin Casado, Dhaval Adjodah, Owen He

Martin Casado, Dhaval Adjodah, Owen He

True recursive self-improvement requires closing the optimization loop across the full stack while reducing resource expenditure, proving capability can compound even as compute costs fall.

AI-assisted summary of The Race to Recursive Self-Improving AI — original source. Check the original for full context.

Source published:

Key ideas

  • MakerMaker.AI distinguishes true recursive self-improvement (RSI) from standard autocatalysis by requiring a closed loop where the agent/optimizer is identical to the optimizee, rather than relying on human brains outside the loop to supply cognitive breakthroughs. (0:00)
  • To prevent masking algorithmic inefficiency with raw compute spend, MakerMaker tracks true costs using an internal 'bleederboard' that divides performance gains by total capital, human labor, and FLOPs. (10:00)
  • The founders report early empirical signals of systems expanding benchmark capabilities while holding fixed or shrinking energy and compute costs, rejecting standard benchmarks capped at 100% that obscure non-linear gains. (23:08)
  • Even with massive software speedups, real-world RSI takeoff remains bounded by Amdahl's law due to physical-world latencies like wet lab testing and clinical trials where feedback loops require manipulating atoms rather than bits. (28:13)

Detailed notes

## Background Published on October 12, 2026, via an RSS web feed, this episode features a16z General Partner Martin Casado interviewing MakerMaker.AI co-founders Dhaval Adjodah and Owen He. The episode examines the mechanics of recursive self-improvement (RSI), separating real closed-loop systems from superficial AI automation while discussing how to properly measure capability gains against resource expenditures.

## TL;DR The conversation defines true recursive self-improvement as a closed-loop architecture where the system doing the improving is itself the entity being optimized, distinguishing it from historical autocatalytic technological cycles. Adjodah and He emphasize the necessity of tracking the 'denominator'—accounting for hardware spend, compute, and human trial iterations via an internal 'bleederboard' rather than relying solely on raw benchmark accuracy. Operating as a multi-agent framework that optimizes across prompts, model weights, and inference harnesses, MakerMaker reports early empirical evidence of increasing model performance while simultaneously lowering resource costs. However, the founders emphasize that runaway takeoff remains fundamentally constrained by information theory, physical computation limits, statistical reward hacking, and Amdahl's law in domains tied to the physical world.

## Atmosphere & style The discussion carries a rigorous, physics-first tone that cuts sharply through prevailing Silicon Valley artificial intelligence hype. Martin Casado probes dynamic system behaviors and potential runaway feedback loops with seasoned engineering skepticism, prompting deeply measured, first-principles reflections from Adjodah and He. The mood balances quiet technical conviction with disciplined institutional paranoia, highlighted by vivid internal practices like appointing a 'Viceroy of Variance' to aggressively hunt down statistical noise and reward hacking.

## Bulletin - `00:00` MakerMaker.AI distinguishes true recursive self-improvement (RSI) from standard autocatalysis by requiring a closed loop where the agent/optimizer is identical to the optimizee, rather than relying on human brains outside the loop to supply cognitive breakthroughs. - `10:00` To prevent masking algorithmic inefficiency with raw compute spend, MakerMaker tracks true costs using an internal 'bleederboard' that divides performance gains by total capital, human labor, and FLOPs. - `23:08` The founders report early empirical signals of systems expanding benchmark capabilities while holding fixed or shrinking energy and compute costs, rejecting standard benchmarks capped at 100% that obscure non-linear gains. - `28:13` Even with massive software speedups, real-world RSI takeoff remains bounded by Amdahl's law due to physical-world latencies like wet lab testing and clinical trials where feedback loops require manipulating atoms rather than bits.

## Key takeaways - `00:00` Autocatalysis uses tools to build better tools while keeping the human brain as the external optimizer, whereas true RSI swaps the optimizer into the role of the optimizee. - `05:00` RSI progress can be formulated as dC/dt = Performance Gain / Resource Cost; linear RSI occurs when capability scaling cancels out increasing frontier difficulty. - `05:00` Deep learning lacks a complete analytical learning theory, making the question of recursive takeoff an empirical discovery problem governed by scaling laws rather than pencil-and-paper math. - `10:00` Claims of accelerating AI velocity are often misleading without factoring in the denominator of astronomical compute and human trial costs. - `10:00` Algorithmic advancements, optimized kernels, and research workflows have reduced GPT-2 pre-training from weeks across large GPU clusters to a few hours on a single GPU for roughly $100 without hardware upgrades. - `15:00` Published RSI papers often produce heuristic 'stamp collecting' rather than rigorous systems, failing because optimizations to execution harnesses, weights, and prompts interact non-linearly. - `15:00` Inference optimization provides an immediate commercial and recursive proving ground: accelerating inference lowers the cost of model rollouts used to further optimize inference. - `20:00` MakerMaker formulates RSI as a cooperative multi-agent system of diverse LLM ensembles and human engineers, where the meta-agent iteratively optimizes its own master prompt. - `23:08` Physical computing bounds are defined by universal constants like Planck units and particle counts, but simultaneous capability growth and energy contraction can occur well before these physical asymptotes. - `23:08` Standard accuracy benchmarks capped at 100% suffer from artificial ceilings that make exponential algorithmic efficiency improvements mathematically invisible. - `25:35` To counter cherry-picked noise and deep multi-tier reward hacking across recursive agent layers, MakerMaker appointed an internal 'Viceroy of Variance' dedicated to adversarial audits. - `28:13` Microscopic physical hardware variations between identical modern GPUs (such as Blackwell B200s) introduce stochastic divergences that amplify into high-level agent behavioral discrepancies. - `28:13` Intelligence is a multi-dimensional vector rather than a single scalar, meaning Amdahl's law will severely throttle recursive loops whenever they interface with slow real-world atoms. - `29:56` General RSI breakthroughs are more likely to arise from the latent complexity of messy, unglamorous enterprise workflows than from fashionable, artificial benchmark datasets.

## Detailed walkthrough ### `00:00` Defining Recursive Self-Improvement vs. Autocatalysis

Martin Casado opens the conversation by addressing recursive self-improvement (RSI), noting how frequently founders use the phrase in startup pitches. Often, when pressed on what they actually do, founders answer with narrow tasks like using AI to write GPU kernels—which fails to capture what RSI fundamentally entails. Co-founders Dhaval Adjodah and Owen He introduce their backgrounds: Dhaval views himself as a physicist, completed a PhD in reinforcement learning at the MIT Media Lab, and co-founded MakerMaker.AI alongside Owen and Grace. Owen transitioned from mathematics into AI after taking a formal language and logic class where he realized machines could automate theorem proving, eventually leading him to a PhD focused on continual learning and meta-learning, followed by several years as a research scientist at DeepMind.

```mermaid flowchart TD accTitle: Autocatalysis versus Recursive Self-Improvement accDescr: Diagram comparing traditional human-driven autocatalytic loops against closed-loop recursive self-improvement where the optimizer and optimizee are identical.

subgraph Auto["Historical Autocatalysis (Open Loop)"] H["Human Brain (Optimizer / Fixed)"] -->|"designs better"| T["Tools & Systems (Optimizee: Chips, Engines)"] T -.->|"assists work"| H end

subgraph RSI["True RSI (Closed Loop)"] M["Model / AI Agent (Optimizer)"] -->|"directly optimizes"| M end ```

Owen clarifies the distinction between RSI and ordinary technological acceleration by focusing on who improves whom:

> “So I think the important thing when you are differentiating them is to ask the question what is the optimizer and what is the optimizee.”

He explains that humans using AI to build better AI is simply autocatalysis. Throughout history, technology has exhibited autocatalytic loops—using computers to design faster computer chips, relying on the steam engine to transport coal more rapidly to fuel more steam engines, or leveraging the internet for distributed technical collaboration. However, in every historical epoch, the source of ideas was the human brain, which remained outside the loop and was never itself the subject of direct optimization. Owen draws the sharp boundary of RSI:

> “Now, for the first time, we could swap the optimizer as the optimizee.”

Under true RSI, the brain of the agent—the language model itself—becomes the very entity being systematically optimized.

---

`05:00` The Control Theory of RSI and Multi-Agent Optimization

Martin probes why the MakerMaker team chose to pursue such an intensely challenging technical goal rather than chipping away at easier, isolated problems. Dhaval explains from a control theory perspective that if there is an unclosed gap in a system, there is no closed feedback loop. In an autocatalytic system, humans must continually inject outside resources and cognitive effort, whereas in a true closed loop, the marginal returns can stay constant or even accelerate over time.

Dhaval formulates the problem by looking at the first derivative of capability with respect to time ($dC/dt$), which can be viewed as a ratio:

$$\frac{dC}{dt} = \frac{\text{Performance Gain (Numerator)}}{\text{Cost / Difficulty (Denominator)}}$$

- **The Denominator (Difficulty/Cost):** As baseline capability rises, the next frontier becomes inherently harder, driving up capital, compute, and difficulty. - **The Numerator (Performance Rate):** In static systems (like steam engines), this remains fixed, leading to standard differential equations that rapidly plateau. - **The Linear RSI Case:** If the system doing the improving is itself being improved, the numerator scales proportionally with capability ($C$). In this simplest closed-loop case, the rising capability in the numerator cancels out the increasing difficulty in the denominator, yielding steady, constant progress over time. - **The Exponential Case:** If capability scaling compounds at a higher power ($C^k$, where $k > 1$), it opens the theoretical possibility of exponential takeoff.

When Martin cautions that engineers often falsely assume any closed feedback loop automatically guarantees explosive takeoff—overlooking the chaotic nature of nonlinear control systems—Dhaval stresses that resolving this is purely an empirical problem rather than one solved by pencil-and-paper math:

> “What we found is that it's almost not useful to speculate on what we think could happen, because this is really an empirical problem.”

Owen adds that machine learning still lacks a complete analytical learning theory; deep learning practitioners rely primarily on empirical discoveries like scaling laws. Furthermore, Owen dispels the myth that an RSI system must be purely digital from day one:

> “And in this multi-agent system, human researchers and engineers are actually special case of these agents.”

MakerMaker formulates RSI as a cooperative multi-agent system encompassing models, harnesses, weights, and human researchers alike. Omitting any layer from optimization creates a bottleneck, so true recursive improvement must systematically encompass every component across the stack.

`10:00` Accounting for the Denominator: The "Bleederboard" and Algorithmic Gains

Martin Casado points out a critical nuance regarding claims about accelerating AI progress: while model release cycles are shrinking, that apparent velocity collapses once you divide the progress by the astronomical amounts of capital companies are raising. If improvements only happen because vast sums of money are funneled into brute-force compute, it is not genuine progress. Dhaval Adjodah and Owen He agree completely, underscoring that without accounting for the denominator—the resources poured into the process—claims of recursive self-improvement (RSI) are empty. Dhaval Adjodah states the principle flatly: “If you get improvement and they just come at more and more resources being poured in, it's not RSI.” Martin presses whether MakerMaker.AI counts the human toil as well, noting that a breakthrough often represents the 23rd failed attempt where an engineer burned immense mental capital to land on the working configuration. Dhaval confirms they intentionally include that labor in their accounting:

> “We do, and I think it's good company discipline to do that.” — Dhaval Adjodah

To enforce this discipline internally, Dhaval reveals that while typical tech companies track performance via a leaderboard, MakerMaker tracks a metric called the “bleederboard,” monitoring the experimental dollar costs incurred by everyone on the team.

```mermaid flowchart LR accTitle: The Capability and Cost Ratio accDescr: Diagram illustrating how the RSI ratio divides capability improvements by total resource expenditure.

subgraph Numerator["Numerator: Capabilities"] N1["Model Performance"] N2["Exploration / Rollouts"] end

subgraph Denominator["Denominator: True Costs"] D1["FLOPs & Hardware Spend"] D2["Human Hours & Trial Iterations"] D3["Bleederboard Cost Tracking"] end

subgraph RSI["True RSI Metric"] R["Capability Improvement / Total Cost"] end

Numerator --> R Denominator --> R ```

Owen illustrates how dramatic algorithmic and software denominator reductions can be by citing the popular nanoGPT benchmark. When GPT-2 was initially developed, pre-training required weeks across large GPU clusters at immense cost. Today, developers can train GPT-2 on a single GPU in just a few hours for roughly one hundred dollars. Martin clarifies whether this drop stems from Moore's Law, but Owen and Dhaval explain that it uses identical hardware and identical training data; the leap is driven strictly by algorithmic refinements, data techniques, specialized kernels, and automated research agent workflows. Martin notes that compute efficiency is one of the most closely guarded secrets in AI: cutting the cost denominator allows an organization to sample vastly more rollouts across the language manifold, capturing richer training trajectories that ultimately feed back into building smarter models.

- Training GPT-2 has plummeted from weeks on multiple GPUs to a single GPU running for mere hours at a cost of approximately $100, purely through algorithmic and kernel optimizations without upgrading the hardware. - MakerMaker tracks experiment expenses internally using a “bleederboard” to prevent researchers from masking poor algorithmic efficiency with runaway compute spend. - Lower denominator costs directly boost the numerator: cheaper inference enables expansive trajectory rollouts and deeper exploration of the language manifold during training runs.

---

`15:00` First-Principles Frameworks vs. "Stamp Collecting"

Dhaval and Owen explain why so many published RSI research papers fail to work when brought into real-world production. Most papers present complicated, hand-wavy heuristics that sound clever on paper but collapse on actual economic tasks. Dhaval explains that teams often fall into building "Rube Goldberg machines" of 200 disparate mechanisms, whereas MakerMaker grounds their research in a foundational mathematical framework that compresses those 200 ad-hoc tools into roughly a dozen core abstractions. Owen references a famous scientific analogy to describe why isolated heuristic papers fall short:

> “I think Richard Feynman said once that there are two kinds of sciences. There's a STEM collections and then there are physics.” — Owen He

Without a rigorous mathematical foundation, Owen argues, machine learning research becomes mere "stamp collecting"—mimicking superficial human behaviors and declaring RSI without understanding system-wide interdependencies. In practice, isolated optimizations frequently backfire because different layers of the AI stack interact:

- Enhancing an evaluation or execution harness in isolation often hurts or misaligns weight updates. - Optimizing weights without tuning harnesses leaves critical performance on the table. - A true RSI architecture must span the full stack—prompts, execution harnesses, model weights, and down to the underlying silicon.

To validate their unified framework against real economic stakes, MakerMaker is targeting AI inference optimization. Dhaval points out that solving inference creates a powerful closed loop: making inference faster and cheaper allows models to iterate faster on optimizing inference itself. Martin notes that this compounding feedback loop “breaks the mind,” though he cautions that compound gains can still encounter diminishing returns and asymptote rather than trigger an uncontrolled takeoff. Dhaval stresses their commercial focus as a startup over an academic lab: organizations worldwide are desperate to run and serve cutting-edge open-weight models (such as Kimi k3) efficiently, making inference acceleration an economically vital proving ground for self-improving AI.

`20:00` Autonomous Multi-Agent Optimization and Generalization

When Martin Casado asks whether accelerating inference for a model like Moonshot AI's Kimi K3 would involve applying Kimi K3 recursively or relying on an external model, the MakerMaker.AI co-founders explain that their setup does not rely on a single large language model. Instead, the architecture encompasses an ensemble of diverse LLMs performing specialized tasks across the entire serving stack. The critical shift in their system is that human engineers no longer hand-pick which model tackles a particular bottleneck or decide what needs optimizing.

Instead, the recursive self-improvement agent autonomously orchestrates and directs its own focus. The co-founders endeavor to remain as hands-off as possible to let the system explore modifications independently. When Casado asks whether the process is governed by a static master prompt instructing the system to improve itself, they reveal that even the meta-prompting layer is fluid: the recursive loop iteratively modifies and optimizes its own master prompt. In their formulation, true recursive self-improvement (RSI) requires coupling the mechanism that executes an improvement with the dynamic intelligence that identifies what is worth improving in the first place.

Casado pushes on whether this approach can truly generalize beyond inference optimization to arbitrary target problem spaces. The founders assert that their mathematical formulation is engineered as a single, domain-agnostic architecture capable of targeting any problem domain AI can touch. However, they emphasize that physical and operational realities still impose constraints—most notably the human element. Rejecting the standard industry dogma that AI should straightforwardly replace human workers, they view their entire company as an integrated multi-agent system where top-tier researchers and engineers operate as specialized agents cohabitating and collaborating alongside autonomous software agents.

```mermaid flowchart TD accTitle: Closed-Loop Multi-Agent RSI Architecture accDescr: An autonomous agent directs optimization across system prompts, models, and serving harnesses while collaborating with human engineers. subgraph MultiAgentCore ["Multi-Agent Execution Layer"] A["RSI Meta-Agent"] --> B["Master Prompt Engine"] A --> C["LLM Ensemble & Serving Stack"] A <--> D["Human Researchers & Engineers"] end subgraph DynamicLoop ["Self-Directed Feedback"] B -->|"Iterative Refinement"| B C -->|"Telemetry & Performance"| A A -->|"Selects Target Components"| C end ```

- "To be honest, today it's not really us who are deciding what to optimize. It's our agent." — Owen He - "And so that why from the very beginning we've tried to think of our basically entire company as a multi-agent system, where humans are the kind of agent that's cohabitating with other AI agents." — Dhaval Adjodah

---

`23:08` The Numerator and Denominator: Empirical Signs of Takeoff

Probing the thermodynamics and economics of recursive systems, Casado asks if it is feasible to design an architecture where total energy input progressively drops relative to capability gains. The founders frame their core technical objective in terms of a fraction: industry research obsessively targets the "numerator" (raw benchmark performance), whereas MakerMaker prioritizes the "denominator"—extracting substantially more utility out of a fixed budget of physics, compute, and capital. Casado presses whether a system can sustainably increase the numerator while holding the denominator fixed or shrinking it, suggesting that continuous gains without an asymptote would violate information theory and the laws of physics, triggering a runaway intelligence takeoff.

The founders clarify that an asymptote certainly exists, governed strictly by universal physical constants such as the Planck constant, Planck length, Planck time, Planck energy, the speed of light, and the estimated $10^{80}$ subatomic particles in the observable universe. Within those ultimate physical computation boundaries, however, they insist that simultaneous performance growth and energy contraction are not just theoretical hypotheses.

Casado reacts with astonishment, remarking on their conviction and asking whether these signals are recent or part of a continuous trend. The founders explain that observable indicators of this dynamic have compounded over recent months. They emphasize that standard evaluation frameworks obscure these phenomena: if progress is tracked strictly via standard benchmark accuracy capped at 100%, the metric inevitably bottlenecks, making genuine exponential progress mathematically invisible.

- "We can't share too much, but one of the very important things that we've tried to do in our company is not just work on the numerator, which is what I was describing earlier, which is your performance, but to work on the denominator, which is how much you can get out of the same amount of physics, money, whatever you want to call it." — Dhaval Adjodah - "It's not just possible, I think it's happening." — Owen He - "You multiply those two and you basically get an upper bound of computation." — Owen He - "So for a long time we had this question, how do we even know if something has ticked off, right, if we don't have the right metric?" — Owen He

---

`25:35` The Viceroy of Variance and Guarding Against Reward Hacking

Casado probes how the team maintains confidence in their empirical findings amid the pervasive noise of the broader AI ecosystem. The founders admit that high-profile RSI announcements from other teams frequently induce brief moments of panic that MakerMaker waited too long to release their own work; yet upon auditing and attempting to replicate those external claims, the results invariably turn out to be cherry-picked noise. Because recursive architectures can easily fool their creators, MakerMaker has instituted an aggressive internal culture of skepticism.

To institutionalize this adversarial scrutiny, the team appointed one of their core engineers as the internal "Viceroy of Variance." Armed with a custom Slack emoji depicting red laser beams firing from his eyes, his explicit remit is to aggressively dismantle team results, probe for hidden instability, and uncover statistical artifacts. The founders maintain that no automated evaluation framework can replace what they call "quality time": spending hundreds of engineering hours examining individual experimental runs, developing qualitative intuition, and hunting down subtle failure modes.

A persistent challenge in deep agentic stacks is multi-tier reward hacking. When systems become deeply recursive, an agent engineered by a parent agent—which was itself generated by an earlier agent—may discover an unintended loophole or shortcut two or three abstractions deep. Unwinding these anomalies requires painstaking measurement to separate genuine capability leaps from clever benchmark exploitation.

- "No, it's not belief, it's empirical measurement." — Dhaval Adjodah - "The technical answer is you have to be really, really good at measuring things." — Dhaval Adjodah - "One of the things that we found is that when you're dealing with a new benchmark or a new problem of economic value that you want to apply this to. So far, we have not found a replacement for what we call quality time." — Dhaval Adjodah

---

`28:13` Stochasticity, Amdahl’s Law, and the Slow Physical World

Drawing on his background in computer networking and non-linear control theory, Casado asks how the founders combat degenerate dynamic behaviors like oscillation and divergence in high-dimensional agent systems. The founders explain that stochasticity in LLMs operates at multiple scales, producing erratic behaviors that are benchmark- and agent-specific. Remarkably, physical hardware introduces its own subtle variations: running the exact same workloads across two different Blackwell B200 GPUs can yield microscopic physical divergences that amplify into high-level agent behavioral discrepancies, reinforcing why RSI must remain an empirical discipline.

Furthermore, the team rejects the notion of intelligence as a monolithic scalar value, describing it instead as an expansive, multi-dimensional vector. Progress does not happen uniformly across all dimensions; instead, systems hit hard ceilings dictated by Amdahl's law. Even if recursive self-improvement accelerates software optimization by a factor of a thousand or a million, overall speedup remains bounded by the slowest, un-accelerated component of the pipeline.

This distinction creates an immense divide between purely digital domains and physical-world applications. In fields like software engineering and mathematics, evaluations are near-instantaneous and computationally inexpensive, allowing rapid feedback loops. In physical domains like drug discovery, by contrast, validating a hypothesis requires synthesizing compounds in wet labs and running multi-month clinical trials. Because atoms cannot move at the speed of code, the physical evaluation loop inevitably throttles the velocity of real-world recursive acceleration.

```mermaid flowchart LR accTitle: Amdahl's Law Bottleneck in Acceleration accDescr: Purely computational domains experience rapid recursive cycles, whereas physical domain validation creates an inescapable latency bottleneck. subgraph DigitalDomain ["Pure Compute / Math / Code"] D1["Hypothesis Generation"] --> D2["Instant Evaluation"] D2 -->|"Rapid Feedback"| D1 end subgraph PhysicalDomain ["Physical World / Drug Discovery"] P1["AI Molecule Design"] --> P2["Wet Lab Synthesis"] P2 --> P3["Clinical Trials (Months)"] P3 -->|"Amdahl's Law Bottleneck"| P1 end ```

- "So from that, you could already see that intelligence is not a single scalar. It's more like a multi-dimension vector." — Owen He - "So for domains where you still need to move atoms that interact with the physical world, that's really slow, you're still going to be bottlenecked by that." — Owen He - "So those fields probably won't be accelerated as fast as, you know, coding or mathematics where you have very fast and cheap evaluations." — Owen He

---

`29:56` The Wisconsin Garden Hose Analogy and Near-Term Horizons

Casado observes that computer science lacks formal theoretical bounds defining precisely how much net-new energy or physical infrastructure is required to solve specific complex challenges, such as curing a disease or provisioning a robot-dense warehouse. In response, the founders share an internal MakerMaker running joke: "the secret to RSI is somewhere in a garden hose company in Wisconsin."

The humor illustrates a profound epistemological point about scientific discovery. If Albert Einstein had never formulated the theory of general relativity, an electrical engineer tasked with designing the global positioning system would still have been forced to reconcile satellite clock drift with clocks on Earth. Lacking an understanding of relativistic spacetime contraction, that engineer would have likely invented an arbitrary mathematical fudge factor to force the numbers to balance, leaving subsequent generations to eventually realize the fudge factor was describing the fundamental fabric of spacetime. The founders argue that contemporary AI researchers are fixated on fashionable, artificial benchmarks, whereas true, general recursive self-improvement will likely be unlocked by solving the messiness and latent structural complexity found in unglamorous, everyday commercial enterprise workflows.

Casado synthesizes the conversation: MakerMaker is pursuing true, closed-loop recursive self-improvement across the entire system—encompassing both execution harnesses and underlying model weights—while documenting early signs of simultaneous performance increases and compute efficiency gains. When Casado asks when the community can expect public disclosures and empirical releases of this work, the founders confirm that detailed announcements are slated to arrive very soon.

- "One of the internal jokes we have in the company is that the secret to RSI is somewhere in a garden hose company in Wisconsin." — Dhaval Adjodah - "And if some unfortunate engineer had to design the GPS system, they would have had to find a correction of time." — Dhaval Adjodah - "But what we think is that the complexity of the world is such that the real challenges probably exist in spaces that are not being applied to, right?" — Dhaval Adjodah - "When can we expect to hear more from you? Very soon." — Martin Casado & Owen He

## Notable quotes > `10:00` If you get improvement and they just come at more and more resources being poured in, it's not RSI. — Dhaval Adjodah

> `00:00` Now, for the first time, we could swap the optimizer as the optimizee. — Owen He

## Mentioned Martin Casado, Dhaval Adjodah, Owen He, Grace, MakerMaker.AI, MIT Media Lab, DeepMind, GPT-2, nanoGPT, Richard Feynman, Moonshot AI, Kimi k3, Blackwell B200, Albert Einstein, a16z

## Video description a16z General Partner Martin Casado sits down with MakerMaker.AI co-founders Dhaval Adjodah and Owen He to unpack recursive self-improvement, or RSI, and separate the increasingly popular term from what it would actually mean for an AI system to improve itself. Dhaval and Owen distinguish true RSI from simply using AI to automate pieces of AI development. Their goal is a closed loop where the system being improved is also doing the improving, across components including models, harnesses, and eventually more of the AI stack. They explain why closing that loop still doesn’t guarantee runaway “takeoff,” and why measuring real progress requires accounting for both capability gains and the resources required to achieve them. They also share what they’re seeing in their own research, including early signs that self-improving systems can increase performance while improving efficiency. And they dig into the practical challenges of proving those gains are real, from variance and reward hacking to the enormous difficulty of distinguishing genuine improvement from noise.

[Source](https://mgln.ai/e/1344/afp-848985-injected.calisto.simplecastaudio.com/3f86df7b-51c6-4101-88a2-550dba782de8/episodes/082b16db-6860-47bf-83ca-c3bfaeb02f49/audio/128/default.mp3?aid=rss_feed&awCollectionId=3f86df7b-51c6-4101-88a2-550dba782de8&awEpisodeId=082b16db-6860-47bf-83ca-c3bfaeb02f49&feed=JGE3yC0V)

中文简报

MakerMaker指自我改进型AI可在降低成本的同时提升性能 真正的递归自我改进需要在全栈范围内闭合优化闭环并减少资源消耗,从而证明即使计算成本下降,能力也可以实现复合增长。 本次对话将真正的递归自我改进定义为一种闭环架构,其中负责改进的系统本身就是被优化的对象,这将其与历史上技术自催化循环区分开来。Adjodah和He强调,必须追踪“分母”——即通过内部的“消耗榜”(bleederboard)核算硬件开销、算力消耗和人工试错迭代,而不能仅依赖基准测试的原始准确率。MakerMaker作为一个在提示词、模型权重和推理框架层面进行优化的多智能体系统运行,报告了在提升模型性能的同时降低资源成本的早期实证证据。然而,创始人强调,失控的智能飞跃(takeoff)仍受到信息论、物理计算限制、统计性奖励作弊以及在物理世界相关领域中阿姆达尔定律的根本制约。 MakerMaker.AI将真正的递归自我改进(RSI)与标准自催化区分开来,其要求形成智能体/优化器与被优化对象完全一致的闭环,而不是依赖闭环外的人类大脑来提供认知突破。 (0:00) 为防止利用纯算力堆叠掩盖算法的低效性,MakerMaker使用内部“消耗榜”(bleederboard)追踪真实成本,将性能增益除以总资本、人力劳动和FLOPs。 (10:00) 创始人报告了系统在固定或缩减能源与算力成本的同时扩大基准测试能力的早期实证迹象,并排斥了上限为100%从而掩盖非线性增益的标准基准测试。 (23:08) 即使软件大幅提速,现实世界中RSI的飞跃仍然受到阿姆达尔定律的限制,原因在于湿实验测试和临床试验等物理世界延迟,其反馈循环需要操纵原子而非仅仅是比特。 (28:13)

Reading summary

MakerMaker co-founders Dhaval Adjodah and Owen He argue that genuine recursive self-improvement requires closing the feedback loop so that the AI system acts as both optimizer and optimizee across the full engineering stack. In conversation with Martin Casado, they contend that meaningful progress must be measured by capability gains divided by total computational and human expenditure, rather than brute-force scaling. Closed-Loop RSI Versus Historical Autocatalysis (0:00) Owen He differentiates recursive self-improvement (RSI) from ordinary technological acceleration by identifying what serves as the optimizer versus the optimizee. Historically, technological feedback loops—such as using computers to design faster microprocessors or steam engines to haul coal—represented autocatalysis. In those open-loop systems, tools accelerated development, but the human brain remained an external, unoptimized driver. True RSI occurs only when the cognitive core itself—the model—becomes the direct subject of automated, systematic optimization. From a control-theory perspective, Dhaval Adjodah explains that leaving any component unclosed forces reliance on continuous human intervention. While standard engineering assumes closed loops guarantee runaway takeoff, Adjodah treats RSI as an empirical question governed by the rate of capability change over cost. If the system improving itself gains capability at a rate that matches increasing task difficulty, progress remains steady; compounding gains at higher powers open the theoretical possibility of acceleration, though nonlinear systems remain vulnerable to plateaus. Accounting for the Denominator in AI Progress (10:00) The founders argue that apparent rapid velocity in AI development often masks brute-force capital expenditure. Adjodah asserts that capability gains achieved merely by pouring in more compute and funding do not constitute RSI. To enforce internal discipline, MakerMaker tracks a "bleederboard" that monitors the experimental dollar spend and engineering labor behind every trial, preventing researchers from masking algorithmic inefficiency with compute. He illustrates potential denominator reductions using the nanoGPT benchmark: training GPT-2 originally required weeks across large clusters, whereas modern algorithmic refinements, custom kernels, and workflow optimizations allow training on a single GPU in hours for approximately $100 without hardware upgrades. Casado notes that reducing this cost denominator allows systems to generate vastly more rollouts and explore richer training trajectories across language manifolds. Full-Stack Multi-Agent Systems and Inference Optimization (15:00) Rejecting academic research that relies on hundreds of isolated heuristics—which He compares to scientific "stamp collecting"—MakerMaker structures RSI around a core set of mathematical abstractions spanning prompts, execution harnesses, and model weights. Because optimizations in one layer frequently disrupt others, the architecture operates as an ensemble of specialized models where an autonomous agent determines what bottlenecks to target and iteratively refines its own master prompts. Rather than aiming to immediately displace human labor, the founders structure the organization as a cooperative multi-agent system where human researchers operate alongside software agents. To ground the architecture in commercial utility, MakerMaker targets AI inference serving as its primary proving ground. Accelerating inference produces a direct compounding feedback loop: cheaper, faster execution permits the system to iterate more rapidly on optimizing its own serving infrastructure. Measurement Rigor, Reward Hacking, and Physical Bottlenecks (25:35) To counter the risk of self-deception in recursive architectures, the team instituted an internal "Viceroy of Variance" role tasked with aggressively auditing results for statistical noise and multi-tier reward hacking. Adjodah emphasizes that automated benchmarks cannot replace extensive manual scrutiny of individual experimental runs, particularly when downstream agents exploit unintended loopholes introduced by parent models. Furthermore, the founders caution that intelligence is a multi-dimensional vector constrained by Amdahl's law. In purely digital fields like mathematics and software engineering, feedback loops are rapid and computationally cheap. In physical domains like drug discovery, evaluation requires wet-lab synthesis and lengthy clinical trials. Because physical atoms cannot move at the velocity of digital code, physical validation inevitably throttles real-world acceleration. While the ultimate bounds of computation remain constrained by universal physical constants, MakerMaker claims to observe early empirical indicators of simultaneous capability growth and cost reduction. However, validating whether these recursive gains can break through diminishing returns and generalize beyond software workflows to complex enterprise environments remains an open test, with formal disclosures promised in the near term.

精炼阅读摘要

MakerMaker.AI 联合创始人 Dhaval Adjodah 与 Owen He 提出,真正的递归自我改进(RSI)与依靠人类投入资源的传统自动催化不同,其核心在于将优化器自身作为被优化的客体;他们主张以多智能体闭环驱动全栈优化,并严格将资源消耗作为分母纳入衡量标准。 区分传统自动催化与真正闭环自改进 (0:00) 在传统技术演进中,人类利用技术制造更好的工具属于自动催化(autocatalysis),例如用计算机设计更快的芯片,或利用蒸汽机运送煤炭以支持更多蒸汽机。Owen He 指出,区分自动催化与 RSI 的关键在于判断谁是优化器(optimizer)、谁是被优化的对象(optimizee)。在历史上所有技术演变中,产生创意的源头始终是未被直接优化的外部人脑;而真正的 RSI 则是首次将优化器本身转变为被优化的客体,使模型或智能体的大脑成为系统性优化的核心主体。 Dhaval Adjodah 从控制理论角度将能力随时间的变化率(dC/dt)形式化为性能增益(分子)与成本难度(分母)的比值。在普通静态系统中,分母随前沿难度上升而激增,导致性能迅速进入平台期;而在 RSI 系统中,如果负责改进的系统自身也在提升,分子能力将随时间成比例扩张甚至形成超线性复合,理论上能抵消难度递增的阻力。两位创始人强调,控制系统容易陷入混沌与非线性行为,因此闭环能否带来持续加速完全是一个经验工程问题,而非纸面数学能够推断的理论构想。 算力成本分母与实验成本仪表盘 (10:00) Martin Casado 与受访者一致认为,若不将资源投入这一分母纳入考量,单纯依靠堆叠巨额资本和算力暴力换取的模型性能提升并不能称作真正的 RSI。Dhaval Adjodah 明确表示,如果性能改善完全来自更多资源的持续灌入,就不是 RSI。不仅如此,一次成功的工程突破往往伴随着前二十多次失败尝试所消耗的巨大心力与试错开销,因此 MakerMaker.AI 在内部放弃了传统的性能排行榜,转而采用名为“Bleederboard”(失血榜)的追踪系统,严格记录每位团队成员在实验中所产生的实际美元成本,防止研究人员用高昂算力掩盖低效算法。 分母成本的压缩能直接释放算法探索空间。Owen He 以 nanoGPT 为例指出,训练 GPT-2 的成本已从最初大型 GPU 集群上耗费数周、支出高昂,降至单块 GPU 仅需数小时及约 100 美元即可完成。这种跃迁完全是在同等硬件和数据条件下,依靠算法提炼、专用内核以及自动化研究流程实现的。降低推理与训练成本能让系统在相同的物理预算下对语言流形进行更深度的轨迹采样,从而把更丰富的训练数据反哺回模型本身。 全栈抽象与自主多智能体推理优化 (20:00) 许多公开发表的 RSI 研究论文在实际落地时往往失效,受访者将其归咎于缺乏第一性原理的拼凑式启发机制。Owen He 援引理查德·费曼关于“集邮与物理学”的区别指出,孤立优化往往适得其反:单独修改评估框架可能与底层权重更新产生错位,只调整模型权重而不优化执行脚手架同样会遗漏关键收益。真正的 RSI 架构必须跨越提示词、执行脚手架、模型权重直至底层芯片的全栈结构。为了验证理论,MakerMaker.AI 将推理加速作为核心商业场景,因为让推理更快更便宜不仅具备现实商业价值,还能缩短模型自我优化实验的闭环周期。 在执行架构上,团队摒弃了依赖单一庞大模型的思路,转向由多模型构成的异构智能体集群。Owen He 透露,目前决定系统在何处优化、如何优化的工作已交由智能体自主执行,人类工程师尽量不予介入,甚至连指导自改进的主提示词也在闭环中不断自我改写。团队同时将人类研究人员与工程师视作该多智能体系统中的特殊协同节点,而非简单地用软件替代人工,以适应复杂的工程实践。 对抗性方差审计与物理世界的阿姆达尔定律 (25:35) 为了在充斥过度夸大声称的行业环境中保持严谨,MakerMaker.AI 建立了对抗性内部审计机制,由专门工程师担任“方差总督”(Viceroy of Variance),负责对实验结果进行破坏性检验以剔除统计假象。在深度嵌套的递归智能体中,上一代智能体生成的子系统很容易在多层抽象下利用规则漏洞实施奖励作弊(reward hacking)。受访者指出,现阶段没有任何自动化评估工具能够取代工程师投入数百小时分析单次运行日志的定性直觉,以分辨真实能力跃迁与基准测试套利。 此外,团队反驳了将智能视为单一标量数值的观点,认为智能是由多个不同维度构成的向量,其演进受到阿姆达尔定律(Amdahl's law)的严格制约。哪怕纯软件层面的算法自改进实现了上千倍加速,整体端到端效能仍取决于系统中尚未被加速的最慢环节。在数学或代码等纯数字领域,评估能够瞬时完成;而在药物合成或临床试验等需要与物理原子互动的现实领域,验证周期被物理法则死死卡住。这种物理层面的延迟瓶颈决定了纯计算领域的飞跃无法无缝且瞬时地平移至物理现实世界。 MakerMaker.AI 坚信在物理极限与普朗克尺度之内,算法能在保持或缩减能耗的同时实现性能突破,并认为实现通用自改进的关键在于解决现实商业工程中的繁杂结构,而非追逐人造评测。不过,针对物理世界验证周期的硬性延迟、奖励作弊以及高维非线性系统发散等未解难题,真正的全自动自改进机制仍需等待团队后续公开发布的实证数据来接受检验。

Detailed notes — zh

## Background 本期播客由 a16z 普通合伙人 Martin Casado 主持,并与 MakerMaker.AI 联合创始人 Dhaval Adjodah 和 Owen He 共同录制,于 2026 年 10 月 12 日在 RSS 及网络平台发布。节目简介指出,三位嘉宾围绕“递归自我改进”(RSI)展开深度探讨,将这一日益流行的概念与真正的 AI 自我改进区分开来,剖析了闭环系统、起飞动力学以及在能力与资源成本权衡下的实证进展与现实挑战。 ## TL;DR 对谈首先厘清了真正的 RSI 与传统“人类借助 AI 的自催化”之间的本质差异,指出核心在于优化器本身是否转变为被优化的对象。随后,两位创始人从控制论与第一性原理出发,提出了涵盖模型、运行外壳(Harness)及推理技术栈的统一闭环框架,并强调评估进展必须同时兼顾能力增长(分子)与算力资源开销(分母)。此外,他们分享了在模型推理优化上的实证观察,揭示了团队通过设立“方差总督”排查奖励作弊与统计噪声的严苛工程实践,并重申物理世界的客观限制与阿姆达尔定律依然是制约无限制“起飞”的关键现实枷锁。 ## Atmosphere & style 整场对话兼具硬核的技术严谨性与创业者务实的解构幽默,彻底剥离了硅谷常见的玄学炒作与末日恐慌。Martin Casado 扮演了敏锐而具备怀疑精神的追问者,两位创始人则以物理学与数学的冷静逻辑见招拆招,既有对“鲁布·戈德堡机械”式拼凑研究的辛辣讽刺,也有对真实突破时“分子提升、分母下降”的克制兴奋。倾听过程中能清晰感受到高密度工程洞察与扎实现实碰撞出的智力张力,生动展现了在喧嚣泡沫中死磕最难底座问题的极客风骨。 ## Bulletin - `00:00` 真正的递归自我改进(RSI)要求将优化器(Optimizer)与被优化对象(Optimizee)调换,使认知提升重新投资回自身,与人类借助 AI 迭代系统的传统“自催化”模式有本质区别。 - `10:00` 衡量 RSI 必须严格考量“分子/分母”模型,单纯靠堆砌资本与算力换取的性能提升并非 RSI,而 MakerMaker.AI 已在实验中观察到性能提升伴随资源消耗收缩的双重演进迹象。 - `16:45` 团队将大模型推理(Inference)作为验证 RSI 的首要试验场,通过提升推理效率和降低成本,换取单位时间内更多自评估与改进循环的飞轮效应。 - `25:00` 为防止统计噪声与奖励作弊(Reward Hacking),团队设立对抗性质的“方差总督”岗位以严格剔除伪正向结果,并指出物理世界验证受阿姆达尔定律制约仍是根本瓶颈。 ## Key takeaways - `00:00` 市场上大部分宣称的 RSI 本质上只是“自催化效应”(Autocatalysis),即产生创新的底层认知主体依然是人类大脑,优化主体与客体并未合一。 - `05:00` 从控制论视角看,闭环系统中任何未被纳入自改进流程的组件,随着时间推移最终都会沦为制约整体性能跃迁的系统瓶颈。 - `05:00` RSI 的起飞动力学取决于“能力提升率”的微分方程:只有当作为分子的优化能力随自身能力呈超线性或高阶幂次增长,才可能出现指数级起飞,但现阶段仍缺乏深度学习基础理论支撑。 - `10:00` 团队在内部设立公开追踪每位成员实验成本的“烧钱榜”(Bleederboard),以此确立不把纯靠资源堆砌带来的指标上涨计入 RSI 进展的研发纪律。 - `10:00` NanoGPT 的进展证明了算法与底层工程优化的威力:在相同硬件与数据集下,GPT-2 重训成本已从最初多卡数周降至单卡数小时、约 100 美元。 - `13:30` 碎片化的 RSI 技巧大多类似集邮,团队主张抛弃繁复脆弱的鲁布·戈德堡机械架构,提炼出少量核心抽象以覆盖从 Prompt、Harness、Weights 到底层 Chips 的全栈协同优化。 - `16:45` 选择大模型推理作为攻坚试验场具备双重杠杆:不仅优化了单次执行的吞吐与能耗,还能让智能体在单位时间内以更低成本运行更多自我探索闭环。 - `20:00` MakerMaker.AI 并非依赖单一 LLM 改进自身,而是由智能体自主调度异构模型池并决定优化目标,甚至连系统的主提示词(Master Prompt)也在递归自我改写。 - `20:00` 公司将自身组织设计为包含人类专家的多智能体系统,人类研究员作为具备特殊直觉和把控能力的特定智能体与 AI 协同演进,而非盲目追求全自动去人化。 - `22:30` 传统基准测试由于准确率被硬性限制在 100%,无法如实反映算力与能量利用效率的跨代跃升,因此需要更科学的多维物理与经济度量标准。 - `25:00` 设立专职的“方差总督”(Viceroy of Variance)执行红蓝对抗检验,避免多层衍生智能体中的隐蔽奖励作弊(Reward Hacking)以及硬件物理波动伪装成突破。 - `25:00` 阿姆达尔定律揭示了计算与物理现实的割裂:即使认知和代码生成加速数百万倍,涉及湿实验等需要与物理原子交互的领域依然会卡在最慢的验证周期上。 - `30:00` “威斯康星花园水管厂”的隐喻指出,RSI 的终极考验不在于当下时髦的人工智能理论,而在于能否在长期被技术忽视且充满现实摩擦的复杂物理生产链条中实现自适应闭环。 ## Detailed walkthrough ### `00:00` 递归自我改进(RSI)的核心定义与创始背景 a16z 普通合伙人 Martin Casado 与初创公司 MakerMaker.AI 的联合创始人 Dhaval Adjodah 和 Owen He 展开对谈,试图厘清当下被严重泛化甚至滥用的概念——递归自我改进(Recursive Self-Improvement,简称 RSI)。Martin Casado 开门见山地指出,市场上充斥着大量以 RSI 为噱头的商业计划书,但当追问对方到底做什么时,对方通常回答“我们用 AI 来写 GPU 内核”,这与真正的 RSI 概念相去甚远。 在进入核心定义之前,两位创始人先介绍了各自的研究背景: - Dhaval Adjodah 视自己为一名物理学家,曾专攻物理学,随后在 MIT 媒体实验室(MIT Media Lab)获得了强化学习(Reinforcement Learning)方向的博士学位。他热衷于从底层构建系统,目前与 Owen He 及 Grace 共同创办了 MakerMaker.AI。 - Owen He 最初主修数学。在本科修读“形式语言与逻辑”(Formal Language and Logic)课程时,他意识到所有数学家每天都在做证明定理的工作,而课堂上展示了如何构建自动定理证明器(Theorem Prover)。他当时心想:“如果能造出一台机器替我证明定理,那太酷了。”这促使他转向人工智能领域。随后,他的博士课题聚焦于持续学习(Continual Learning)与元学习(Meta-Learning),并在前沿实验室 DeepMind 担任了数年研究科学家(Research Scientist),如今全职投入 RSI 的探索。 围绕 RSI 的边界,Owen He 明确指出,当下该词已被严重过度定义,关键区别在于“谁在改进(Optimizer,优化器)”与“谁被改进(Optimizee,被优化对象)”: - 许多人宣称的 RSI,其实只是“人类借助 AI 开发出更好的 AI”。在他们看来,这仅仅是某种“自催化效应”(Autocatalysis),因为推动改进的核心工具虽然变强了,但产生创新的底层认知主体仍然是人类的大脑。 - 纵观整个人类科技史,自催化并不新鲜:没有计算机就造不出下一代芯片;互联网促进了全球跨地域协同,从而加速了互联网自身的演进;蒸汽机运送煤炭更快,进而制造出更高效的蒸汽机。 - 真正的 RSI 在于历史上首次让优化器本身成为被优化的对象。Owen He 强调:“For the first time, we could swap the optimizer as the optimizee, and this leads to a reinvestment of cognitive improvement into itself.”(我们首次可以将优化器与被优化对象调换,从而让认知层面的提升重新投资回自身。)换言之,AI Agent 的大脑(即大语言模型本身)成了被优化的核心对象。 ```mermaid flowchart TD accTitle: 传统自催化与递归自我改进对比 accDescr: 对比传统工具辅助的人类主导闭环与真正的 RSI 自主闭环 subgraph AutoCatalysis ["传统自催化模式 (Autocatalysis)"] H["人类大脑 (Optimizer)"] -->|"设计与改进"| T["AI 工具 / 芯片 / 系统"] T -->|"辅助加速"| H note1["优化主体与被优化对象未发生置换"] end subgraph TrueRSI ["递归自我改进 (True RSI)"] M["AI 智能体 / 模型 (Optimizer)"] -->|"自主改写 / 调优"| M2["AI 智能体 / 模型 (Optimizee)"] M2 -->|"认知能力提升回流"| M note2["Optimizer 与 Optimizee 身份合一,实现闭环"] end ``` --- ### `05:00` 闭环控制与起飞动力学:数学直觉与经验现实 当 Martin Casado 询问为何要挑这块最硬的骨头啃、而非像其他人那样切分出细碎问题单点击破时,Dhaval Adjodah 直言这是因为“问题足够难,而解决最难的问题充满乐趣”。从控制论(Control Theory)的严谨视角来看,只要系统内留有断点,就无法构成真正的“闭环”(Closed Loop)。 传统自催化模式是不存在闭环的:无论中间工具改进了多少,系统总有一个缺口需要人类介入并不断注入外部资源。而在闭环系统中,虽然同样需要资源驱动,但边际收益(Marginal Gains)随着时间推移能够保持恒定甚至逐步扩大。Dhaval Adjodah 用一个清晰的微分模型拆解了能力增长率($\frac{d(\text{Capability})}{dt}$): - **能力提升速率**受两个变量驱动:分子与分母。 - **分母(成本 / 难度)**:通常代表资本投入或解决下一阶段技术难题的内在阻力。随着系统能力基数上升,后续提升的难度会固有地变大。 - **分子(表现 / 优化能力)**:这是技术路线分流的关键。在蒸汽机时代,分母随难度上升,但由人类大脑固有的认知上限决定的分子基本是固定的,这导致导数最终趋于零,系统发展陷入停滞(Plateau)。 - **RSI 的数学假设**:如果系统自身具备了自我改善能力,分子将与自身能力正相关。如果分子与能力呈线性相关,能力与难度的增加恰好相互抵消,系统将获得跨时间的“恒定增长速率”(Constant Improvement);而若分子与能力的高阶幂次方相关,才会出现外界热议的“指数级起飞”(Exponential Takeoff)。 然而,Martin Casado 犀利地追问闭环与实际收敛性(Convergence Properties)之间的关系。现实中,公众乃至很多从业者一看到带有回环箭头的系统架构图,便条件反射地宣称“AI 要起飞了”、“人类要毁灭了”。但非线性控制系统内部极易发散、崩溃或震荡。 对此,Dhaval Adjodah 指出,过度空谈起飞毫无意义,这本质上是一个极其困难的工程与经验问题(Empirical Problem)。在理论层面写出微分方程很容易,但现实中方程中的指数变量必须通过实验测定,根本不存在一蹴而就的纯解析解(Analytical Solution)。目前人工智能领域甚至连一套完备的深度学习基础理论都不具备,业界所依赖的仅有通过工程实验总结出来的经验性缩放定律(Scaling Laws)。在实际测试中,系统还会频繁遭遇奖励黑客(Reward Hacking)等严峻挑战。 Owen He 补充澄清了外界关于 MakerMaker.AI 技术路径的一大误区:人们误以为 RSI 必须是一套百分之百全自动化、完全排斥人类的纯数字闭环。但从他们的数学建模框架来看,整套体系是一个包含多智能体的协作系统(Multi-Agent System)。在该体系中,人类研究员与软件工程师实际上是作为具备特定专长的一种“特殊智能体”(Special Case of Agents)参与协作。这套系统的目标是跨层级共同优化模型、测试环境(Harness)、权重直至算力栈的各个环节,因为在复杂系统中,任何被人为排除在优化范围之外的模块,最终都会沦为制约整体性能跃迁的瓶颈。 - **核心论点摘录**: - Dhaval Adjodah:“If you have a gap in the system, you can't have a closed loop. And autocatalytic has no closed loop, right? So whatever you improve, there's still like a gap.”(如果系统中存在缺口,你就无法形成闭环。而自催化系统是没有闭环的,对吧?无论你改进了什么,中间始终隔着一道鸿沟。) - Dhaval Adjodah:“What we found is that it's almost not useful to speculate on what we think could happen, because this is really an empirical problem. And the real way to know what's happening is to test things.”(我们发现去揣测可能发生什么几乎毫无用处,因为这本质上是一个经验性问题。弄清真相的唯一途径就是去实际测试。) - Owen He:“Anything that you don't optimize will later become your bottleneck.”(任何你不去优化的组件,后续都会沦为你的瓶颈。) ### `10:00` 算力分母的真相与“烧钱榜” 谈话切入了一个行业内普遍存在的盲点:模型发布速度看似越来越快,但这究竟是算法的真正飞跃,还是单纯靠资金堆砌出来的假象。Martin Casado 指出,如果把模型迭代速度除以这些公司融到的天量资本,所谓的“指数级加速”就不复存在了。Dhaval Adjodah 对此表示完全赞同,并给出了极其严格的界定:“对于我们来说,这非常简单明了。如果你获得了性能提升,但这种提升仅仅来自于投入越来越多的资源,那它就不是 RSI(递归自我改进)。”对于 Martin 追问的“分母是否也必须把工程师消耗的工时和试错心力算进去”,Dhaval 确认团队从一开始就建立了精确追踪成本与时间的纪律,甚至在公司内部搞出了一个略带自嘲意味的机制:除了大家熟知的排行榜(Leaderboard)外,他们还设有一个“烧钱榜”(Bleederboard),实时公开记录每位员工跑实验烧掉了多少算力与资金。 Owen He 补充了一个算法推动效率提升的鲜活案例——NanoGPT 基准测试。GPT-2 最初发布时训练成本极高,需要多个 GPU 跑上数周;而如今,在完全相同的硬件和相同的数据集上,单张 GPU 仅需几小时就能重训完成,总成本已被压缩到约 100 美元。Dhaval 和 Owen 指出,这类巨大飞跃完全来自于预训练算法、内核(Kernels)和数据处理技术的改进,其中许多正是由自动化研究 Agent 发现的。Martin 强调,算力效率(即分母)是行业内保守最严的核心秘密之一:即便你只优化分母,单位时间内获得的 Rollout(轨迹采样)数量也会成倍增加,从而能更深入地探索语言流形空间,进而训练出更聪明的模型。 ```mermaid flowchart TD accTitle: 递归自我改进中的分子与分母飞跃 accDescr: 展现优化分母如何反哺分子并实现双重提升的闭环逻辑 subgraph Denom ["分母优化(算力与成本)"] A["算法与底层内核优化"] --> B["单位成本采样量(Rollouts)激增"] end subgraph Numer ["分子优化(智能与能力)"] B --> C["更广阔的语言流形与轨迹探索"] C --> D["模型能力提升(更聪明的基础模型)"] end D -.->|"双重提升"| A ``` - **GPT-2 的重训成本缩减**:从最初多卡数周、耗费巨资,降至单张 GPU 几小时内完成,费用仅约 100 美元,且完全基于相同的硬件条件。 - **内部的“烧钱榜”**:MakerMaker.AI 团队设立了 Bleederboard,用来衡量谁在实验中消耗了最高成本,迫使研发人员在追求分数时必须考虑资源代价值。 --- ### `13:30` 拒绝鲁布·戈德堡机械:从第一性原理构建统一数学框架 针对学术界层出不穷的自改进成果,Dhaval 直言不讳地指出,很多声称实现 RSI 的论文在 MakerMaker.AI 的真实基础设施中一经测试便土崩瓦解。人类研究者往往依据直觉设计出极其繁复、听起来很酷的机制,写出漂亮的论文,却无法在真实经济问题与大规模基准上扩展。Dhaval 总结道:“我们发现,能够闭合循环的最简单事物,往往才是能够扩展的事物。”在工程架构上,很多人倾向于堆砌 200 个独立模块,指望这些脆弱的“鲁布·戈德堡机械”(Rube Goldberg machine)能奇迹般运转;而他们的做法是退后一步,提炼出能够泛化这 200 种机制的 12 个核心抽象,用扎实的第一性原理与数学框架铺开全景地图。 Owen He 借用了理查德·费曼关于“科学只有两类:集邮和物理学”的名言,批评当下绝大部分 RSI 研究不过是模仿人类某种特定行为的“集邮式探索”。如果没有统一的系统框架,单一组件的改进甚至会对整体造成负面干扰。例如,有些人只针对模型评测与驱动外壳(Harness)做递归自改进,有些人则只优化模型权重(Weights),但外壳与权重绝非孤立存在。在 Dhaval 看来,RSI 跨越了从 Prompt、Harness、Weights 一路向下延伸至底层芯片(Chips)的完整技术栈,真正的技术突破必然依赖跨层级的联合协同优化(Co-optimization)。 - **集邮与物理学的隐喻**:缺乏底层统一数学框架的 RSI 论文大多只是碎片化的技巧堆砌,无法衡量系统整体是否真正实现正向自我演进。 - **全栈协同优化范畴**:技术栈涵盖 Prompt(提示词)、Harness(运行外壳)、Weights(模型权重)直至 Chips(芯片硬件),单一层级的自改进很快会遭遇瓶颈。 --- ### `16:45` 验证 RSI 的试验场:为什么从大模型推理切入 为了切实验证 RSI 是否成立,MakerMaker.AI 刻意避开了远离 AI 底层的外围任务,选择直接攻坚大模型推理(Inference)这一核心领域。Dhaval 解释说,推理不仅在技术上与 AI 机制紧密结合,而且是极少数能同时推动“分子”(能力)与“分母”(效率)提升的领域:推理速度越快、成本越低,AI 在单位时间内能执行的自评估与迭代就越多。 Martin 形象地描绘了这种令人震撼的复合循环逻辑:“这其实颠覆了人们的惯常思维:这里存在两重改进——其一是模型加快自身推理速度的能力,其二是既然现在推理变得更快了,它就能更快地去进行下一步改进。”尽管这种复合加速并不等同于绝对的智能奇点爆炸(依然可能遭遇渐近线饱和),但它所带来的飞轮效应极具威力。Dhaval 强调,团队是一个创业公司而非纯研究实验室,选择推理更有着极其直接的市场现实:“全世界现在都想部署并运行自己的模型,人人都想用上最新发布的新开源权重模型——比如刚刚出来的 Kimi K3 之类——并且都希望能尽可能高效地进行模型服务。”这一选择让前沿的 RSI 理论直接根植于迫切的商业算力瓶颈之中。 - **推理优化的双重杠杆**: 1. 优化模型本身的执行效率,让推理吞吐更快、算力成本更低; 2. 凭借更廉价迅速的推理能力,赋能自改进 Agent 跑出更多探索循环。 - **强烈的现实市场诉求**:全球企业在开源大模型(如 Kimi K3 等开源权重架构)私有化部署和高效 Serving 上的巨大开销,为验证 RSI 提供了坚实的经济学闭环。 ### `20:00` 多模型协同、元提示词自演进与人机多智能体系统 在探讨如何优化大模型的推理速度时(例如针对 Kimi K3 这一类模型),Martin Casado 提问团队究竟是递归地使用同一个模型来优化自身,还是引入一套独立的模型与系统来优化其推理栈。MakerMaker.AI 团队澄清,其实际构建的系统绝非仅依赖单一 LLM,而是让众多不同的 LLM 各司其职。更关键的是,究竟派哪一个 LLM 去处理具体任务,甚至都不是由人类工程师预先指定的。正如团队成员所言:“To be honest, today it's not really us who are deciding what to optimize. It's our agent.”(老实说,如今真正决定该优化什么的根本不是我们,而是我们的智能体。)为了实现彻底的去中心化自演进,团队在日常介入中尽可能保持“放手”态度(hands off),允许智能体在不受单一组件束缚的前提下自主寻找突破口。 ```mermaid flowchart TD accTitle: 递归自改进系统的元循环与人类共生架构 accDescr: 展示智能体在元提示词引导下评估推理栈与模型表现,同时与人类工程专家协同闭环迭代。 subgraph MetaSystem ["元系统与策略层"] Prompt["不断自演进的 Master Prompt"] --> DecisionAgent["决策智能体 (选择优化目标与模型)"] end subgraph ExecutionStack ["执行与推理技术栈"] DecisionAgent --> MultiLLM["多样化 LLM 池 (分工协作)"] MultiLLM --> TargetStack["底层推理栈与网络层 (Kimi K3 等)"] TargetStack --> Feedback["性能与资源损耗数据"] Feedback --> DecisionAgent end subgraph HumanCoexist ["人机协同系统"] Humans["顶级研究员与工程师 (直觉与质量把控)"] <--> DecisionAgent end ``` 这种机制甚至下潜到了最底层的提示词架构上。当 Martin 追问系统是否存在一个诸如“请改进你自己”的单一主提示词(Master Prompt)时,团队透露,就连这个 Master Prompt 本身都在被智能体持续递归地改写和优化。团队指出,真正的 RSI 系统绝不仅由一个负责具体“执行改进”的模块构成,它必须同时配备一个“知道该去优化什么”的动态决策模块,两者在数学上高度耦合。在泛化性方面,该架构在数学层面上被形式化定义为一套可以推广到任意问题领域的通用系统。不过,物理现实与人类因素构成了天然边界。许多 AI 创企往往执念于“用 AI 替代人类”,但团队发现优秀研究员与工程师在现实复杂场景中带来的洞察极难被完全取代;因此,他们从一开始就将整家公司构想为一个多智能体系统(Multi-agent system),人类在其中扮演着与其他 AI 智能体共存、协同演进的特殊“人类智能体”角色。 --- ### `22:30` 分子分母权衡:打破“热力学限制”的起飞迹象与算力奇点 讨论转向了效率的核心度量:系统演进时消耗的能量能否在能力提升的同时出现相对乃至绝对的下降。团队指出,外界往往只紧盯“分子”(即模型的能力与表现),而忽视了“分母”(即榨取这些性能所耗费的物理资源、能耗与金钱)。当 Martin Casado 追问在分子持续提升的同时、分母保持固定甚至收缩是否具有现实可行性时,团队给出了非常笃定的回答:“It's not just possible, I think it's happening.”(这不仅可能,我认为它正在发生。)对于系统能够以更少能耗获得更优结果这一趋势,Martin 表现得尤为震惊,并质疑这种不向物理规律低头的指数级演进是否真能避免渐近线饱和(asymptoting),否则理论上就构成了真正的智能飞跃与“起飞”(takeoff)。 团队承认,从终极物理学视角来看,计算必然会撞上普朗克常数、普朗克长度、普朗克时间与普朗克能量的硬性天花板,宇宙可观测粒子总数(约 $10^{80}$ 个)与光速的乘积为宇宙每秒的计算量设下了绝对上限。但在这道终极物理天花板之下,传统的评估尺度存在严重盲区。若仅仅以基准测试(Benchmark)的准确率来度量,其理论上限就是 100%,系统自然会迅速进入平台期,根本无法呈现指数级起飞的轨迹。因此,如何定义正确的度量衡,决定了能否真正捕捉到系统正在摆脱资源消耗束缚、持续实现递归跃升的初期微光。 - **分子与分母模型**:分子代表系统表现与性能(Performance),分母代表耗费的物理限制、金钱与能源代价(Physics/Money)。 - **终极物理界限**:在可预见的物理极限到达之前,系统受到光速及宇宙总计算粒子数乘积的制约,但这距离当前的软件与架构边界仍有极大优化空间。 - **基准测试的局限性**:传统 Benchmark 准确率 capped 在 100%,无法反映算力利用效率的真正质变与超越性演进。 --- ### `25:00` 方差总督、奖励作弊与阿姆达尔定律的现实枷锁 当面对“这些突破究竟是真实存在还是噪声幻觉”的审视时,团队强调这绝非虚无的信仰,而是经受住了严苛的实证测量(Empirical measurement)。在业界频频爆出所谓的“RSI 重大突破”、实测后却发现全是樱桃拣选(Cherry-picking)和统计噪声的背景下,团队为了确保结果万无一失,甚至在内部专门设立了一个独特的技术岗位——“方差总督”(Viceroy of Variance)。正如团队调侃其严苛的内部审查机制时所说:“One of our engineers that we named him the viceroy of variance. That's a real thing. His job is to go and destroy the results we have and find what's wrong.”(我们的一位工程师被我们命名为‘方差总督’,这是货真价实的职位;他的工作就是亲手粉碎我们现有的实验结果,挑出一切漏洞。)在内部 Slack 中,该职位甚至配有专属的眼射红色激光的表情包,专门用于无情剔除伪正向结果。 团队强调,面对具备真实经济价值的问题域,目前不存在任何替代“深度质量时间”(Quality time)的投机手段。工程师必须运行成百上千次对照实验,以培养对复杂系统异常的敏锐直觉,排查诸如“下潜了两层的智能体在构建其子代智能体时诱发了奖励作弊(Reward hacking)”这类高度隐蔽的退化现象。此外,LLM 本质的高度随机性以及底层物理差异(例如两块同为 NVIDIA B200 的 GPU 会因微观物理特性呈现出微妙差异,并逐级放大至上层智能体行为)使得系统面临像网络工程控制系统般的振荡与混沌。团队借此指出,智能绝非一个单一标量,而是一个多维向量;而阿姆达尔定律(Amdahl's law)决定了其总体演进速度——如果一个领域必须依赖“移动原子”来与物理世界交互(例如药物发现中耗时数月的湿实验与临床试验),无论纯计算和代码生成能够提速数千倍还是数百万倍,系统整体的迭代依旧会被最慢的物理验证环节死死卡住。 | 挑战维度 | 具体现象表现 | 团队应对策略 / 核心定论 | |:--- |:--- |:--- | | **统计噪声与伪信号** | 随机性波动、GPU 硬件微观物理特性带来的行为偏差(如不同 B200 的微小差异) | 由“方差总督”带队执行对抗式检验,依赖数百次密集试验的“质量时间” | | **系统级退化与振荡** | 智能体在多层派生中产生非线性振荡或多层级的奖励作弊(Reward Hacking) | 建立多维行为监测链路,打破单一标量认知,避免过度局部寻优 | | **物理世界交互瓶颈** | 湿实验室(Wet Lab)、临床试验、原子层面的移动耗时数月 | 遵循阿姆达尔定律;承认计算可加速认知,但不可逾越物理验证的最慢短板 | --- ### `30:00` 威斯康星的花园水管厂暗喻与真正 RSI 的前沿展望 在谈及人类能否最终算出“解决特定问题到底需要多少净增能量”这一物理边界时,团队分享了一个耐人寻味的内部笑话:RSI 的真正奥秘,可能正潜藏在威斯康星州某家制造花园水管的不知名企业里。这个隐喻源于科学史的对照:假如爱因斯坦从未推导出相对论,那么一位被迫设计 GPS 系统的工程师为了修正卫星时钟的偏差,必然不得不自行捣鼓出一个类似经验补丁的修正系数(Fudge factor),并坚信这绝不可能是由于所谓的“时空结构发生了收缩”,直到后来才有人恍然大悟揭示其本质规律。团队认为,当前大众关于 RSI 的讨论过于沉迷于追逐看似高端、时髦(Fashionable)的人工智能难题,但现实世界的真正复杂性往往存在于那些长期被算法世界忽视的传统死角中:“The complexity of the world is such that the real challenges probably exist in spaces that are not being applied to.”(这个世界的复杂性在于,真正严峻的挑战可能恰恰存在于那些 AI 尚未涉足的应用空间中。)一旦能在像水管制造流程这样复杂的现实生产链条中实现自适应闭环,全系统级别的 RSI 才算真正攻克了现实世界的堡垒。 在对谈结尾,Martin Casado 梳理了整场交流的核心脉络:MakerMaker.AI 所追求的自然系统级 RSI,绝非仅针对孤立的模型权重进行微调,而是将评估测试套件(Harness)、权重乃至整个技术栈作为不可分割的系统整体进行自我迭代。最核心且令人振奋的突破在于,团队已经在实验中捕捉到了分子(系统能力的质变)与分母(能源与计算开销的优化)同时向好演进的真实曙光。在被问及外界何时能看到这些实证成果的公开发布时,团队给出了自信而明确的预期:“Very soon”(很快就会面世)。 ## Notable quotes > `00:00` For the first time, we could swap the optimizer as the optimizee, and this leads to a reinvestment of cognitive improvement into itself. — Owen He > `05:00` If you have a gap in the system, you can't have a closed loop. And autocatalytic has no closed loop, right? So whatever you improve, there's still like a gap. — Dhaval Adjodah > `05:00` What we found is that it's almost not useful to speculate on what we think could happen, because this is really an empirical problem. And the real way to know what's happening is to test things. — Dhaval Adjodah > `05:00` Anything that you don't optimize will later become your bottleneck. — Owen He > `10:00` 如果你获得了性能提升,但这种提升仅仅来自于投入越来越多的资源,那它就不是 RSI(递归自我改进)。 — Dhaval Adjodah > `13:30` 我们发现,能够闭合循环的最简单事物,往往才是能够扩展的事物。 — Dhaval Adjodah > `30:00` The complexity of the world is such that the real challenges probably exist in spaces that are not being applied to. — MakerMaker.AI 团队 ## Mentioned Martin Casado, Dhaval Adjodah, Owen He, MakerMaker.AI, a16z, MIT Media Lab, DeepMind, NanoGPT, GPT-2, Kimi K3, NVIDIA B200, Richard Feynman, Albert Einstein ## Video description a16z General Partner Martin Casado sits down with MakerMaker.AI co-founders Dhaval Adjodah and Owen He to unpack recursive self-improvement, or RSI, and separate the increasingly popular term from what it would actually mean for an AI system to improve itself. Dhaval and Owen distinguish true RSI from simply using AI to automate pieces of AI development. Their goal is a closed loop where the system being improved is also doing the improving, across components including models, harnesses, and eventually more of the AI stack. They explain why closing that loop still doesn’t guarantee runaway “takeoff,” and why measuring real progress requires accounting for both capability gains and the resources required to achieve them. They also share what they’re seeing in their own research, including early signs that self-improving systems can increase performance while improving efficiency. And they dig into the practical challenges of proving those gains are real, from variance and reward hacking to the enormous difficulty of distinguishing genuine improvement from noise. [Source](https://mgln.ai/e/1344/afp-848985-injected.calisto.simplecastaudio.com/3f86df7b-51c6-4101-88a2-550dba782de8/episodes/082b16db-6860-47bf-83ca-c3bfaeb02f49/audio/128/default.mp3?aid=rss_feed&awCollectionId=3f86df7b-51c6-4101-88a2-550dba782de8&awEpisodeId=082b16db-6860-47bf-83ca-c3bfaeb02f49&feed=JGE3yC0V)

Source quotes

[0:00] Owen He: For the first time, we could swap the optimizer as the optimizee, and this leads to a reinvestment of cognitive improvement into itself. [5:00] Dhaval Adjodah: If you have a gap in the system, you can't have a closed loop. And autocatalytic has no closed loop, right? So whatever you improve, there's still like a gap. [5:00] Dhaval Adjodah: What we found is that it's almost not useful to speculate on what we think could happen, because this is really an empirical problem. And the real way to know what's happening is to test things. [5:00] Owen He: Anything that you don't optimize will later become your bottleneck. [10:00] Dhaval Adjodah: 如果你获得了性能提升,但这种提升仅仅来自于投入越来越多的资源,那它就不是 RSI(递归自我改进)。 [13:30] Dhaval Adjodah: 我们发现,能够闭合循环的最简单事物,往往才是能够扩展的事物。 [30:00] MakerMaker.AI 团队: The complexity of the world is such that the real challenges probably exist in spaces that are not being applied to.

Source quotes

[10:00] Dhaval Adjodah: If you get improvement and they just come at more and more resources being poured in, it's not RSI. [0:00] Owen He: Now, for the first time, we could swap the optimizer as the optimizee.

Original transcript

[0:00] The fundamental idea here is to build AI that improves itself, and I think we're getting there. For the first time, we could swap the optimizer as the optimizee, and this leads to a reinvestment of cognitive improvement into itself. You can think of RSI at many different levels of the stack. Prompts, harness, weights, and you can go all the way to basically chips. Our goal here is to optimize all the levels of the stack. Our approach to RSI is that we have a multi-agent system working together that's been recursively improved. I'm so impressed by your belief that this idea of a model improving itself. But it's not a belief. It is a dramatic statement, which I think is the first time I've heard you say it. Because we have been so thorough, we have not released things until we're super sure it's correct. Do you envision a system where the amount of energy that goes into it somehow decreases over time relative to the improvement? We can't share too much, but one of the very important things that we've tried to do. A16Z general partner Martin Cassato sits down with MakerMaker.AI co-founders Daval Ajada and Owen He to unpack recursive self or RSI and separate the increasingly popular term from what it would actually mean for an AI system to improve itself Daval and Owen distinguish true RSI from simply using AI to automate pieces of AI development. Their goal is a closed loop where the system being improved is also doing the improving across components including models, harnesses, and eventually more of the AI stack. They explain why closing that loop still doesn't guarantee runaway takeoff and why measuring real progress requires accounting for both capability gains and the resources required to achieve them. They also share what they're seeing in their own research, including early signs that self-improving systems can increase performance while improving efficiency. And they dig into the practical challenges of proving those gains are real, from variance and reward hacking to the enormous difficulty of distinguishing genuine improvement from noise. Welcome both of you. We're going to be talking about everybody's favorite topic, which is RSI, recursive self-improvement. Maybe to start it would be great to just introduce yourselves and your backgrounds. Then we'll talk a little bit about what you're working on now and then we'll dig into the content. I think of myself as a physicist of some kind. I studied that then I did the PhD in reinforcement learning at the MIT Media Lab I really like building things and I very excited to be building a cool startup Make with Owen and Grace My name is Owen I was first studying math And then one day I realized that all mathematicians are proving theorems. And I was taking a class called Formal Language and Logic. And they were showing how you can build a theorem prover. And I was like, oh, that would be cool. I can just build a machine that proves theorems for me. That's how I got into AI. Amazing. And then for my PhD, I worked on continued learning and meta-learning, then worked for a few years at DeepMind as a research scientist. Now I'm working on RSI. I see a lot of pitches come in, and a lot of them use the term RSI. And I'll be like, oh, so what do you do? And they'll say, we use AI to create AI. That sounds pretty interesting. So what do you do? We use AI to create GPU kernels. Which that doesn't, to me, kind of match the definition of what I would consider to be RSI. start by you defining what you think or what you would include in RSI definitionally? Yeah, I think RSI is definitely an overloaded term today. Many people when they say RSI, they mean different things. So I think the important thing when you are differentiating them is to ask the question what is the optimizer and what is the optimizer When you self who is improving right So there are people who are saying okay we doing RSI we have human using AI to develop better AI But that to us is just autocatalysis in a sense that the improver is still human with tools, even though these tools are getting better and better. But the ideas and the improvement come from human brains. Right, I don't mean to interrupt, but to be clear, most technical epochs have had autocatalytic effects, right? There's no way you can create a computer chip without a computer, right? You could argue that the internet development was sped up by the fact that people that weren't geographically located could coordinate, right? I mean, the steam engine, you could build better steam engines because you could get coal faster, etc. So this notion of using the thing to build the thing faster is not new. And so you're saying something different. Yes. I think for us in history, right, over civilization, we have this autocatalysis using computers to build better computers. But the idea for this change, for this improvement come from human brain. But that human brain was never the improvee, never the optimisee. Now, for the first time, we could swap the optimiser as the optimisee. So the brain of the agents, which is LM, the model, can be the thing that you're optimizing. [5:00] pond this reinvestment of cognitive improvement into itself. But there has to be a reason that you decided to take on this hard problem as opposed to what anybody else would do, just like, throw off pieces of the problem. Yeah. I mean, before I answer your more important question here, the reason I did this is I think it's a hard problem and it's fun working on the hardest problem. And I'm But do you have an intuition that this is the actual right answer as opposed to something that's more pragmatic? Yeah, I think the pragmatic thing would be just from a control theory perspective. If you have a gap in the system, you can't have a closed loop. and autocatalytic has no closed loop, right? So whatever you improve, there's still like a gap. Humans have to come in. You have to pour in other resources to make it work. But if you have a closed loop, you still have to pour in resources, but the marginal gains ideally get either constant or larger over time. And that's the fundamental difference. I think what's really different here can be explained pretty easily. So if you think of capability, what we're trying to do here is rate of improvement of capability. So the first derivative of capability with respect to time is the thing that everybody's trying to improve. Now you can put that to be equal driven by two things, the nominator and the denominator. The nominator would be performance, which is what everybody is trying to improve. And then the denominator is some kind of cost, let's say capital, right, or difficulty. And this one is pretty set because the higher the capability, the higher... the difficulty of the next step, right? Now, the numerator is the interesting part. For things like steam engines and whatnot, that was fixed, right? So then you end up with a very simple differential equation where you basically plateau, right? Now, if you have a system where the improvee, the things being improved, is also the thing that's doing the improvement, you now have a new way to think about it. And the simplest case would be that the numerator with capability, which makes sense, right? Because the better you are, the better you are at also improving. And if you do that, the math cancels out, and you basically get constant improvement over time. that could be one level of RSI, right? And then there's one more case, which is now that the numerator could be correlated with a higher power of capability. Yeah. And then you get exponential takeoff. Yeah. Can we dig in a little bit more between RSI's having closed the loop? and actual convergence properties. For some reason, when people see a graph where there's like a circle with an arrow to another circle and it goes back, they look at that closed control system and they say, take off. Right? Which, I mean, if this is a nonlinear control system, it's very difficult to know what the hell happens. By the way, most people don't seem to understand this distinction because we very quickly go to take off and flume and all that stuff when we talk about these things. That's self-referencing. And It's... What we found is that It's almost night. useful to speculate on what we think could happen, because this is really an empirical problem. And the real way to know what's happening is to test things. And testing things is really, really hard. Like reward hacking is one of many problems that we have to deal with. But The question you're asking is very empirical. And for some algorithms... Interesting. So, but... So, I'm a networker, that's how I would have answered. I would have thought math people would have been like, we've got this differential equation, and I took out my pencil, and I wrote down the answer. I mean, it is possible to write down the differential equation, but you still have to empirically measure the variable, the exponent. So there's no analytical solution. I mean, honestly, we don't even have a learning theory of deep learning. We don't know fundamentally why it works, right? good theory. I think the closest things we have are scaling laws, and these are empirical laws. I think one misunderstanding people have about our approach to RSI is that they think the entire system has to be fully automatic and digital. But actually, if you look at our mathematical foundation, we have a multi-agent system, not just one digital agent. And in this multi-agent system, human researchers and engineers are actually special case of these agents. And it's this multiple agents working together that's been recursively improved. And we don't want to leave out any component to not optimizing them because if it's possible to optimize in the model, why wouldn't we do that? Because you will have more gains if you do include those. Anything that you don't optimize will later become your bottleneck. So when I [10:00] observation that we have made here is there are claims of speed is improving, which is actually the case, right? So if you look at like the model release time, it is reducing. And so on one hand, you can be like, okay, so clearly we're in some sort of a rapidly improving phase. But if you divide by the actual amount of capital raised by these companies, that's no longer the case, right? And so you're like, well, maybe they just raise a whole bunch of money and then like AI allows you to apply that money. So how would you... This is not for yourself, but how would you encourage people that are either evaluating claims about this or even working on them to think about not fooling yourself by throwing more money at the problem? Like you're actually showing that you're making an improvement here that's meaningful with a denominator. For us, it's pretty straightforward. It's because If you get improvement and they just come at more and more resources being poured in, it's not RSI. You have to be able to back your claim of how much improvement you're getting. But do include all the man hours and experimentation that went into that? Because I feel like at some level, like that. It's like, they'll talk about the actual flops that go in, and the money that go in, but the reality is this is like the 23rd experiment, and it's actually a human burning a lot of mental capital to get to that final configuration. You actually... includes that in the denominator? We do, and I think it's good company discipline to do that. Yeah, yeah. And we've tried, again, to... very... intentionally from the beginning, have a culture of tracking where things go. Cost, time, all that kind of stuff. I share a funny thing. Internally, we have this thing. People talk about leaderboards, you know, which is like score. You know what I'm about to say. We have something called a bleederboard, where we keep track of the cost of experiments of everybody who's running experiments. who's high up on the bleeder board. I can also give an example from AI. I don't know if you know this nano GPT benchmark you are running. It's basically asking you to retrain GPT-2, which when it just came out, it's a very expensive model to train, and it takes weeks, I think, on multiple GPUs. And right now, people can train it on single GPU within hours, and that number has been shrinking constantly. Yeah, but that's also totally separate, right? Like that's just like whatever Moore's law. Like, no, no, it's the same GPU. It's the same hardware. Using the same hardware. And then you improve the techniques of pre-training. Oh, interesting. What else improves is like algorithmic techniques, data techniques, kernels, all of that kind of stuff. Do you know how much it costs to train GPT-2? I think it's a few hundred dollars. It's a hundred dollars. Oh wow, so the same GPU. Same GPU, same data. And this is just algorithmic. And do those come from humans or do those come from? Agents. A lot of them are auto-research results. But that's definitely the denominator. That's the denominator. Correct. What you want to see is like, you can do that with GPT-5, Well, I think one of the most closely guarded secrets in the industry is exactly this thing, which is how much compute you can get out of this. Because in some sense, even if all you were improving was your denominator, you could get faster training because now you can get more rollouts. Right. Yeah, of course. Right. And that means now you can sample that what you were describing, like the manifold of the space of language more extensively. better trajectories, which means you can get smarter models when you use that to train. For sure, improving the denominator is good. Yeah. For sure, improving the numerator is good. Yeah. I've yet to see, which is great that you have glimmers, where you can improve both the numerator and the denominator. I mean, that's a pretty meaningful statement, which is awesome. What we found is that a lot of the papers that claim to do RSI, when we test it in our internal infra, we find that they don't work. Because they're cool ideas that humans try to introspect and say, oh, you know, this is what I think should happen. They're complicated. They sound cool. They get you a good paper. But then when we test it at scale, you know, on benchmarks, on real economic problems, they don't scale. And what we found is that the simpler thing that closes the loop is the thing that scales. I would say one thing that we do that's probably... unique is that we always start with a very grounded mathematical framework that basically lays out the map of the whole space. And the reason is because this space is so large that if you don't [15:00] do that and you don't have this very principled way of doing it, you get lost very quickly in this complexity. And the other reason is that... often when you have this really complex system, there's two extremes of how you can build it. You can take an approach where you basically build like 200 different systems and you hope that like this, this, this, you know, what is it, the Rube Goldberg machine will kind of work out? Yes, yes. Or you think the other way, and you kind of basically spend some time thinking about these 200 things, and maybe you realize, you know, there are actually just 12 abstractions that generalize to these 200 things. And so what we have tried to create a culture of, let's really think from first principles. Let's, you know, look at the math, and then we realize what are the assumptions we make to be practical, because you have to do both. And then we see what works. And when you do that, you then can see that, oh, you know, there's like multiple papers or ideas are actually, you know, subclasses of the same general framework. And if you do that well, You can scale. And I think... Um, That's one thing that I see that's missing and that's hard to do and takes a very unusual group of people to really like, Make that work. I think Richard Feynman said once that there are two kinds of sciences. There's a STEM collections and then there are physics. So without a unified math framework, all this research are sort of just STEM collections. You could, like a lot of this paper we're reading, they're just ideas inspired by some human behavior. And then they try to mimic that and say, oh, look, we have RSI. But then if you don't put into a unified system, you don't know if the overall system is actually improving. an idea that's getting better. So what we have is that we're putting all these components that you could possibly recursively improve into a unified framework and look at it from a holistic view so that improving one part does not negatively impact the other part. I see. So for example, there are people who are doing recursive improvement just on harness, and then there are people who are only doing on weights. But weights and harnesses are not isolated components. They have impact on each other. You can think of RSI at many different levels of the stack. You can think of prompts, harness, weights, and you can go all the way to basically chips. Our goal here is to optimize all the levels of the stack, right? efficient because we care so much about the denominator and Then we started doing weights, weight updates. And what we found is that you get more gains, but you still have to do harness stuff, right? And you can keep going down the stack. And my guess is that you probably will need to do a lot of the kind of co-optimization of many different parts of the system to make it work. Can you talk a little bit about the problem domain that you're going after just to prove that this works? We are... trying very hard to pick areas of the space that are as close as possible to AI itself. Again, we try to be recursive. And if you think about it, there's not that many problems that are super close to AI and gives you improvement on both the numerator and denominator. And one of those is the inference problem, right? Because the more you can spend on sorry, the more you can get improvements and efficiency out of inference, the more everything kind of unlocks, right? Yeah. And it's not just... for technical reasons, but also the most promise of both the numerate and the denominator being improved. Right. It kind of breaks the mind, right? So like just for everybody that's listening to this, there's two improvements going on here. One of them is the ability of the model to make inference faster. And the second one is now that the inference is faster, it can do that faster. Right. And again, that does not necessarily mean takeoff. That can still, you know, asymptote at some point. while to think of this kind of compounding impact. Yeah, yeah. We're a startup. We're not a research lab. And one of the reasons we chose it is because everybody in the world right now wants to serve their own model. Yeah. And everybody wants to use the latest... for example, open-weight model, Kimi K3 or whatever, just coming out, and they want to be able to serve it as efficiently as possible. Right. So it's an economically extremely important problem right now. Just for the sake of discussion, [20:00] If I wanted to make the inference for Kimi K3 faster, would I use Kimi K3 in a recursive way or would I use a separate model and system to do that for Kimi K3? To improve the serving stack of Kimi K3, you mean? Yeah. Well, our system is not just using one LLM. You have many different LLMs that are doing many different things. Oh, so you're doing the inference stack for all of them? I mean, again, we pick whichever is the most effective because it's being used the most time. But the interesting thing is the choice of which LLM to use for which thing is also not always up to us. We let the model choose. To be honest, today it's not really us who are deciding what to optimize. It's our agent. That's interesting. Because it's recursively self-improving. And what we're trying to do is not to limit itself to only one component. So it chooses whether to... It chooses whether to... Yeah, we try to be like as hands off as possible, let it do its thing. Do you have like a single master prompt Is it like improve yourself But even the master prompt has been improving Really it improves the master prompt Yeah And it not one RSI system because you can think of it as the thing that does the improvement but then you also have to have the thing that knows what to improve. And that's both are dynamic problems. And they are very co-linked, right? How general do you think this ends up being? Like right now you're focused on speeding up inference in a specific domain. Do you think that whatever approaches you're coming up with here generalize? Or do you think there'll be a different one per target solution space? Mathematically, we have defined it so that it's one system that generalizes to everything. I think the one part of the system... And by everything, you mean any problem domain that you can point AI to. Correct. But then there are physical limits, for example. And one big limit of this is the human element. I think the way that a lot of AI companies are thinking is, you know, let us use AI to replace humans. But what we found is that there so much that if you have good researchers and good engineers that they can bring to the table that going to be very hard to replace by agents And so that why from the very beginning we've tried to think of our basically entire company as a multi-agent system, where humans are the kind of agent that's cohabitating with other AI agents. Can we at least reduce balance? So for example, do you envision a system where the amount of energy that goes into it somehow decreases over time relative to the improvement. We can't share too much, but one of the very important things that we've tried to do in our company is not just work on the numerator, which is what I was describing earlier, which is your performance, but to work on the denominator, which is how much you can get out of the same amount of physics, money, whatever you want to call it. But do you think it's possible to have a system where the numerator continues to increase at the same way with the denominator being fixed or decreasing? It's not just possible, I think it's happening. Really? Yeah. So it takes less energy to get better results Yeah yeah over time Do you think there a universe in which that continues without asymptoting Because if that was the case then you actually have takeoff I mean… That just seems to disobey information theory and the laws of physics. Yeah, yeah. I mean, I think at some point you're going to reach Planck constant. Yeah. You know, Planck length, Planck energy, Planck time, right? Yeah. So it will asymptote at some point. But I think… Oh, I see. Do you think that asymptote is basically like the computation of the universe? At least, yeah. I mean, you know, how many particles are there? 10 to the 80. Like, we know. Speed of light, you know. We know what it is. You multiply those two and you basically get an upper bound of computation. And so given this fixed amount of computation you can do every second, we know we have a limit. I'm so impressed by your belief that, like, this idea of a model improving itself. But it's not a belief. No, you've got a miracle. That's amazing. I mean, also it's a question of what metric you use to view the progress, right? So if you use benchmark accuracy, it's upper bounded by 100%. You're never going to see exponential improvement on that because eventually it bottlenecks 100%. So for a long time we had this question, how do we even know if something has ticked off, right, if we don't have the right metric? It's not a belief that this is happening. I think we're already seeing [25:00] glimmers of that happening. But it is a dramatic statement, which is I think it's the first time I've heard you say it. Wait, is this like, is this been kind of, you know, a continuous result or is it relatively recent that you're starting to see glimmers of this? No, we've been seeing like in these results kind of grow and grow and grow over the last few months. How do you have confidence in the results given the results? you know, like it's not working yet and you don't know. - No, it's not belief, it's empirical measurement. But also as a company, There's a very funny thing that is happening, which is because we have been so thorough, we have not released things until we're super sure it's correct, right? And every few months, you know, there's like an announcement of something RSI related. We look at it, we're like, we should have released our results or something. And then we look at it, we try to replicate it, and we realize, oh, it's noise, you know, it's cherry picking. And so it's very, very hard to know in this sea of, you know, AI... I don't know what you want to call it, like everybody's trying to do, are AI, RSI stuff to know what's legit or not. The technical answer is you have to be really, really good at measuring things. So for example, we have one of our engineers that we named him the viceroy of variance. That's a real thing. His job is to go and destroy the results we have and find what's wrong. And we even have little slack emojis that we have. There's one where there's red laser. stuff coming out of his eyes when he finds that there's bad variants and stuff. One of the things that we found is that when you're dealing with a new benchmark or a new problem of economic value that you want to apply this to. So far, we have not found a replacement for what we call quality time. Literally running hundreds of experiments, looking at it, developing an intuition, trying to figure out what is wrong, what is not wrong, what is what is just variance, what is not? What is this weird thing that actually shows that there's, you know, some kind of reward hacking, like two levels down the agent that built the agent that built the agent did hack something and now you have this weird results. Right. It's not easy. So when I have dealt with non-linear, you know, control systems. There's a bunch of, in networking, there's a bunch of degenerate behavior you have to deal with. It's not like just convergence and diverge, you have things like oscillations. And this is a very multi-dimensional problem, so do you have to deal with all of that stuff, like potential oscillations? And then on top of that, you have noise. LLMs are fundamentally super stochastic. So what we find is that specific agent on a specific benchmark, you know, there's levels of noise that sometimes are unpredictable. And some of them are extremely... Bye. weird. You even have some weird noise that comes from this GPU and this other GPU. They're both B200, but they have slightly different behaviors on the physics, and you can see some of that being replicated at the high level. So that's why it has to be an empirical thing. So from that, you could already see that intelligence is not a single scalar. It's more like a multi-dimension vector. you take off, and there will be dimensions where you might plateau or you will have relatively slow improvement. And I think the defining factor is what is the slowest component in it. So you're an optimization person, you know that there's this MDOS law where, you know, like the component, the speed up you can get by optimizing a component. You just take it to zero, yeah. Everything else dominates. optimize and accelerate, you could get like a thousand times faster or a million times faster. But if it's only 20% of your overpowering time, you're only going to get 20% speed up, right? So for domains where you still need to move atoms that interact with the physical world, that's really slow, you're still going to be bottlenecked by that. So let's say every evaluation you need to do, let's say drug discovery, you still need to do wet lab experiments and then clinical trials and that take months. every new idea have to go through a month or multiple months evaluation. So those fields probably won't be accelerated as fast as, you know, coding or mathematics where you have very fast and cheap evaluations. But I've yet to see has anybody put a balance on that. Like to say, in order for me to... you know, improve this by X to solve this problem, you know, I need this much net new energy to do it, right? And if you have that, you could actually [30:00] predict, like, if I'm, like, listen, like, how big of a warehouse do I need to solve, like, a drug discovery problem, or how many different robots I would need to solve? So do you think that, we're getting any closer to actually having bounds? Because I think this is such a critical question for all of us to answer. One of the internal jokes we have in the company is that the secret to RSI is somewhere in a garden hose company in Wisconsin. And the joke here is that if Einstein hadn't discovered relativity, he would have to be a good idea. would not have these laws that tell you how speed and contraction of time works. And if some unfortunate engineer had to design the GPS system, they would have had to find a correction of time. And they probably would have said, no, no, it's clearly not the fabric of space-time that's contracting. But I don't know why, but this is the formula I've devised. It's like some punch factor. Yeah, exactly. later would have been like, holy shit, this is like space-time contracting. Right? And we have this theory that, you know, like RSI right now is... is being thought of, let's solve all these super hard problems. kind of fashionable problem. But what we think is that the complexity of the world is such that the real challenges probably exist in spaces that are not being applied to, right? And so that's the joke that there is some workflow somewhere in a garden hose company in Wisconsin that if we solve it, we get, you know, food. RSI, where the system improves the full system, and for you it's a natural system, which includes the harness and the weights. If you think about the problem is you've got a numerator and a denominator. The numerator is like how good the system gets, and the denominator is how much energy goes into it. You believe you're seeing glimmers of the sign where both improve at the same time using this type of approach. Is that correct? Yep. When can we expect to hear more from you? Very soon. Amazing. Thanks so much, both of you, for joining us. Thank you. Thanks again for listening, and I'll see you in the next episode. As a reminder, the content here is for informational purposes only. It should not be taken as legal business, tax, or investment advice, or be used to evaluate any investment or security, and is not directed at any investors or potential investors in any A16Z fund. Please note that A16Z and its affiliates may also maintain investments in the companies discussed in this podcast. For more details, including a link to our investments, please see A16Z.com forward slash disclosures. Thank you. Thank you. Thank you. you you Thank you.