Atreides' Baker Sees AI Stock Sell-Off Masking Compute Price Surge
Colossus | Investing & Business Podcasts
Public AI stock declines reflect a market misinterpretation of open-source model adoption, while underlying compute spot rates, DRAM prices, and token demand are accelerating.
## Background
Published by Colossus | Investing & Business Podcasts on RSS / web on August 4, 2026, this episode of 'Invest Like the Best' features host Patrick O'Shaughnessy interviewing Gavin Baker, founding partner and CIO of Atreides Management. The episode focuses on the stark disconnect between recent public market AI stock declines and the accelerating operational fundamentals and GPU demand on the ground in Silicon Valley.
## TL;DR
Gavin Baker breaks down the dynamic behind the July sell-off in AI equities, arguing that public markets are misreading temporary credit and open-source narrative fears while underestimating accelerating physical GPU utilization, spot rental pricing, and long-term supply agreements. He explores the economics of model routing, token-to-compensation spending shifts, and how Claude algorithms drive market sentiment loops like a modern 'Walter Cronkite.' Baker also addresses software defensibility, regulatory risks surrounding data centers, and the emerging frontier of SpaceX's massive compute expansion and orbital infrastructure.
## Atmosphere & style
The conversation carries an energetic, intellectually rigorous, and insider-driven tone set at Benchmark's famous office table. The dynamic between O'Shaughnessy and Baker is candid and conversational, blending sharp quantitative analysis with witty market anecdotes. Despite the recent public market panic, the overall mood is deeply constructive and grounded in high-conviction, operational reality.
## Key takeaways
- `02:35` July experienced a brutal sell-off in public AI stocks (down 40% to 60%), yet physical on-the-ground metrics in Silicon Valley—such as GPU availability, rental spot prices, and token volume—actually accelerated.
- `04:08` Public markets miss the full picture of AI infrastructure ROI because major usage and cash flows are concentrated in private entities like OpenAI, Anthropic, and open-source inference clouds.
- `05:06` Older, legacy contracted GPU compute is trading at a discount compared to surging spot rates, meaning contract renewals will naturally force prices upward and boost hyperscaler margins.
- `06:53` Market fears over open-source token expansion are misplaced: generating open-source tokens requires identical FLOPs and compute hardware, shifting profit margins directly down to the physical infrastructure layer.
- `10:51` Widening tech credit spreads reflect panic rather than reality; realistic monetization of Blackwell and Rubin GPUs will generate ~$2 trillion in operating cash flows, largely eliminating reliance on debt financing.
- `20:00` Claude and AI summarization tools have become the algorithmic 'Walter Cronkite of the stock market,' unifying investor interpretations of news and driving hyper-accelerated volatility and compressed supply cycles.
- `26:48` Enterprise AI stacks are adopting intelligent routers to direct query traffic to fine-tuned open-source models, cutting token costs while preserving underlying raw GPU compute demand.
- `30:51` Top-tier AI startups are reallocating 20% to 50% of their compensation budgets toward token consumption, pointing to a massive addressable market driven by direct labor substitution in knowledge work.
- `33:37` Long-term supply agreements (LTAs) for memory and compute function as critical strategic assets; breaking an LTA risks losing future capacity allocation to hyper-competitive market rivals.
- `36:41` Nvidia is employing credit wrappers and revenue-sharing mechanisms to finance customer GPU clusters, maximizing revenue per gigawatt and locking in structural cost advantages against rival custom silicon.
- `46:10` Open-source weights combined with inference optimization tools (e.g., Fireworks AI) strengthen software startups by enabling custom RL models, turning simple 'wrappers' into defensible products with strong margins.
- `50:35` Regulatory pushback and negative public political narratives pose the greatest threat to the AI industry, largely driven by tech's failure to communicate the economic and employment benefits of data centers.
- `57:15` Disaggregating inference workloads into pre-fill and decode layers allows hardware teams to combine SRAM accelerators with mature node chips, helping bypass current high-bandwidth memory (HBM) supply bottlenecks.
- `58:02` Outside of traditional hyperscalers, SpaceX has emerged as one of the fastest and lowest-cost builders of massive physical compute infrastructure, aggressively supporting xAI's scaling requirements.
## Detailed walkthrough
### `00:00` First Question: July Was 2022 in a Month
The episode kicks off with Patrick O'Shaughnessy pointing out that the time between his podcast recordings with Gavin Baker is shrinking rapidly, mimicking the accelerating cadence of AI model releases. Baker jokingly acknowledges that earlier listeners accused their previous conversations of coinciding with local market peaks—a critique no one could make this time. He describes July as "2022 in a month," pointing out that public AI stocks plummeted 40% to 60% in a straight line. Despite this brutal sell-off, Baker emphasizes that on-the-ground fundamentals in Silicon Valley have actually accelerated across every single quantitative metric: GPU availability, GPU rental pricing, DRAM spot prices, and overall token growth.
Baker explains that the public markets are suffering from a massive blind spot because they lack visibility into private powerhouses like OpenAI, Anthropic, and open-source inference clouds (such as Fireworks, Base Ten, Modal, and Together). Anthropic is growing exceptionally fast and almost certainly generating substantial free cash flow, while open-source demand has exploded following major releases like GLM 5.2 and Kimi K3. Wall Street is staring at charts showing semiconductor cash flows surging while hyperscaler free cash flow dips, completely missing the private layer of the ecosystem.
* Public AI names dropped 40% to 60% within a single month.
* Key underlying operational metrics—GPU rentals, DRAM spot prices, and token volume—are all accelerating rather than slowing down.
* Private companies like OpenAI, Anthropic, Fireworks, Base Ten, Modal, and Together mask the true cash flow and usage dynamics of the market.
`05:06` Old GPUs Repricing Higher
Baker highlights a critical market structural shift that almost no analyst anticipated in 2024 or 2025: the price of older, installed GPUs is actually increasing rather than declining. The prevailing consensus was that long-term contracts would cushion a gradual decline in GPU rental rates. Instead, the legacy contracted compute base is currently trading at a massive discount compared to the spot market. As these multi-year contracts expire, compute is being repriced significantly higher. Even if spot rates eventually soften, the rolling over of old contracts into higher market rates will drive revenue and cash flow acceleration, addressing Wall Street's underlying return on investment (ROI) anxieties.
This trend is already beginning to show up in hyperscaler reporting. Looking at operating cash flow—rather than free cash flow—for Microsoft, Meta, and Amazon, growth accelerated from 28% to 32%. When adjusting for unusual one-off charges, such as massive regulatory fines from the EU, operating cash flow growth actually accelerated from 28% to 35%. Crucially, this acceleration occurred before hyperscalers began lighting up Nvidia's next-generation Rubin architecture, which will command a massive pricing premium.
* Legacy contracted compute is trading at a significant discount relative to current spot market rates.
* Adjusting for legal one-timers, hyperscaler operating cash flow growth accelerated from 28% to 35% quarter-over-quarter.
* Contract roll-overs will naturally force an upward repricing of existing compute capacity, boosting overall margins.
`06:53` Walking Through the Month
Walking through the sequence of events that triggered July's panic, Baker analyzes how market misinterpretations drove the sell-off. The trouble started when rumors surfaced that Meta was planning to rent out excess compute capacity, which analysts immediately interpreted as a sign of overcapacity and impending CapEx cuts. Baker refutes this interpretation, noting that Meta saw SpaceX monetize its trading-optimized clusters at massive premiums and attempted a similar tactical maneuver. Telemetry on Meta’s actual infrastructure plans confirmed their CapEx stance was as aggressive as ever. Shortly thereafter, Meta released Muse 1.1, its best model in two years, confirming they have no intention of taking their foot off the gas.
> "Jensen is the world's largest supporter of open source... But does it really stand to reason that Jensen would be the world's biggest supporter of open source if it was bad for his business?"
Following Meta's move, the Chinese model Kimi was released, sparking a massive open-source "freak-out." At the same time, indices tracking silicon data tokens dipped due to a mix shift toward cheaper open-source models rather than expensive frontier tokens. Baker explains that Wall Street misread this as negative demand, failing to realize that "a token is a token"—generating an open-source token requires the exact same raw compute, FLOPs, memory, and wattage as a proprietary one. Open-source adoption simply shifts margin away from frontier model developers directly into the hands of underlying AI infrastructure providers, driving total compute demand higher via price elasticity.
* Meta's attempt to rent out compute was a margin-seeking play inspired by SpaceX, not a sign of softening internal demand.
* Meta's release of Muse 1.1 demonstrated strong model performance improvement, confirming ongoing infrastructure investment.
* Open-source token growth shifts profit margins from frontier software layers down to the physical compute and infrastructure layer.
`10:51` Real Yields, Spreads & CDS
The narrative then shifted to macro credit concerns as real yields climbed, credit spreads widened, and Credit Default Swaps (CDS) expanded across the tech sector. Meta recently priced a bond at higher-than-expected yields, and Nvidia’s CDS blew out alongside the broader sector. While private capital market participants view this as routine bank hedging against existing underwriting commitments, the visible metrics created a scary headline narrative. Higher credit costs and widening spreads typically signal danger for capital-intensive build-outs that rely heavily on debt financing.
However, Baker argues this panic stems from a fundamental misunderstanding of how the current AI infrastructure build-out is financed. If hyperscalers were forced to rely heavily on debt to fund future gigawatts of Blackwell and Rubin deployment, a credit squeeze would trigger a classic, destructive capital cycle. But Wall Street models are currently assuming these next-gen chips will only monetize at the rate of Ampere—two generations behind—rather than current Hopper rates. If Blackwell and Rubin monetize anywhere near current spot values, hyperscaler operating cash flows will top $2 trillion, wiping out roughly $700 billion in projected debt demand and self-funding the build-out entirely out of cash flow.
* Real yields increased, credit spreads widened, and CDS for major tech names like Nvidia and Meta expanded significantly during July.
* Current Wall Street consensus models assume Blackwell and Rubin chips will monetize at the muted rates of two-generation-old Ampere chips.
* Under realistic monetization assumptions, hyperscalers will generate ~$2 trillion in operating cash flow, eliminating the need for roughly $700 billion in debt financing.
`15:22` Open Source as Dark Matter
Reflecting on the emotional climate of the crash, Baker notes that unlike the 2022 market downturn—which had clear macro villains like rate hikes, inflation, and recession fears—the July sell-off lacked a logical catalyst. Market technicians often find sell-offs with no clear villain particularly ominous, adhering to the idiom that "it's the bullet you don't see that gets you." Yet, as Baker pressure-tested his assumptions across Silicon Valley, he found zero quantitative evidence of operational deceleration.
In fact, physical spot pricing highlights just how distorted public market perception has become. Baker shares an example of a top-tier startup that rented a cluster of several thousand Blackwell B200 GPUs six months ago and hoped to secure a similar cluster today for under $4.00 per GPU hour; instead, spot rates have jumped 50% to 60%. Inference providers like Base Ten have openly stated they expect to pay 100% more for Blackwell compute when current contracts expire. Baker compares open source to "dark matter"—an invisible, massive force that public markets struggle to quantify, but one that is driving massive, accelerated demand for underlying compute hardware.
* Spot market pricing for Blackwell B200 GPU clusters has surged 50% to 60% over a six-to-seven-month span.
* Inference cloud providers expect contract renewals for next-gen hardware to cost up to 100% more than previous agreements.
* Nvidia traded down to its lowest forward Price-to-Earnings (P/E) multiple in 10 years, discounting a major drop in demand that operational data contradicts.
`20:00` Claude as the Market's "Walter Cronkite" and the Six-Week Capacitor Cycle
Gavin Baker describes the recent market environment as an extraordinarily tricky period, comparing it to an intense compressed version of 2022. He notes a prevailing sentiment among institutional investors that the optimal short-term trading strategy has been to cycle rapidly through superficial market narratives, cutting risk in response to headlines that do not reflect underlying fundamentals. Baker argues that even if credit markets tighten, the resulting reduction in available FLOPS will only render existing compute more valuable, ultimately strengthening unit economics until credit returns. A major catalyst for this market behavior, in his view, is the algorithmic homogenization of market sentiment. Nearly every public equity investor, from retail traders to major hedge funds, feeds news into Claude or Claude Code agents. Because these probabilistic models interpret news through a consistent lens, Claude has effectively become the "Walter Cronkite of the stock market"—a single, monolithic source of truth that investors implicitly trust, despite its occasional misinterpretations of Bayesian, forward-looking market dynamics.
This unified consensus creates dramatic market volatility and hyper-accelerated cycles. Citing a post by the prominent anonymous semiconductor insider known as "TBU," Baker highlights how Japanese capacitor stocks experienced an entire supply-demand cycle in just six weeks—a trajectory that historically would have spanned three full years—even though actual underlying fundamentals had not yet shifted.
```
+-------------------------------------------------------------------------------+
| THE CLAUDE FEEDBACK LOOP |
| |
| [ Market News & Earnings ] ───> [ Ingested by Claude / Claude Code ] |
| │ |
| ▼ |
| [ Volatile Market Moves ] <─── [ Uniform Investor Action & Trades ] |
+-------------------------------------------------------------------------------+
```
* **Market Dynamics:** Massive risk reductions driven by narrative shifts rather than underlying credit or operational deterioration.
* **Media Analogy:** Claude functions as modern media anchor Walter Cronkite, driving unified, algorithmic interpretations of stock news.
* **Capacitor Cycle:** Japanese capacitor equities compressed a standard 3-year fundamental cycle into 6 weeks due to rapid consensus trading.
---
`23:55` Continual Learning, Routers, and the Architecture of Demand
Looking ahead to architectural evolutions, Baker examines sample-efficient learning and continual learning as potential wildcards. Laboratories like Safe Superintelligence (SSI)—founded by Ilya Sutskever—alongside a new generation of research labs, are aiming to train models on significantly smaller datasets (e.g., 10 trillion tokens instead of 300 trillion) and allow them to learn efficiently post-deployment. While some fear this could create a temporary pause in training compute demand, Baker notes that token generation at the inference layer will inevitably dominate total compute consumption over time.
Furthermore, AI-native enterprises are rapidly moving toward multi-model deployment strategies via intelligent routers. By routing queries first to customized, fine-tuned open-source models and utilizing expensive frontier models (such as Claude or Grok) primarily for verification or complex edge cases, enterprises cut nominal token costs in half. However, Baker stresses that this shift is not bearish for GPU infrastructure: lower price points increase volume elasticity, shifting consumption from high-margin frontier API calls to raw GPU compute hours.
* **SSI Launch Target:** Safe Superintelligence (SSI) targets model releases focusing on sample efficiency and continual learning.
* **Token Unit Economics:** Routing workloads to open-source models reduces vendor margins from ~90% down to ~30%, lowering end-user costs while preserving raw GPU compute demand.
* **Adoption Waves:** Compute demand is expanding from ~250,000–500,000 power users using agentic tools toward an addressable market of hundreds of millions.
---
`30:51` Token Budgets, Economic Growth, and the Game Theory of LTAs
At the organizational level, leading AI-native companies are reallocating massive portions of their compensation budgets away from human headcount and into token consumption. In highly optimized companies, token spend accounts for 20% to 25% of total compensation costs, with extreme cases reaching 30% to 50%. With global knowledge work estimated at $25 trillion, a 20% shift toward AI compute implies a $5 trillion market opportunity funded through direct labor substitution and accelerated enterprise productivity.
```
+-------------------------------------------------------------------------------+
| THE INCENTIVE STRUCTURE OF LTAs |
| |
| Company Considers Breaking Memory LTA During Short-Term Oversupply |
| |
| ┌───────────────────────────────────────────────────────────────────────┐ |
| │ RISKS: │ |
| │ 1. Supplier terminates future volume allocation guarantees. │ |
| │ 2. Allocation shifts directly to 3 rival hyperscalers/competitors. │ |
| │ 3. Structural exclusion when the market shifts back to undersupply. │ |
| └───────────────────────────────────────────────────────────────────────┘ |
| |
| CONCLUSION: High-bandwidth memory LTAs operate like non-cancellable |
| strategic assets; breaking them risks enterprise survival. |
+-------------------------------------------------------------------------------+
```
This structural shift is anchored by long-term supply agreements (LTAs) for critical hardware components like high-bandwidth memory (HBM). Baker contrasts this with historical tech cycles where buyers like Apple could squeeze suppliers without fear of retaliation. In a four-way hyper-competitive race between Amazon, Google, AMD, and Nvidia, breaking an LTA during a temporary downturn carries existential risk: suppliers will reallocate capacity to competitors, leaving the defaulting party stranded when the cycle inevitably tightens again.
* **Token-to-Comp Ratios:** Top-tier AI-native startups spend 20% to 30% (and up to 50%) of their comp budget on tokens.
* **Knowledge Work TAM:** A 20% penetration into the $25 trillion knowledge work market yields $5 trillion in potential compute/token demand.
* **LTA Game Theory:** Multi-year supplier contracts for memory and compute act as strategic barriers; breaking them guarantees lost share in subsequent tight supply cycles.
---
`36:41` Nvidia's Financing Innovation and Memory Sector Strategy
To maintain its dominant market position and bridge the capital deployment lag among cloud providers, Nvidia has introduced novel financing structures. Baker details how Nvidia effectively deploys a "credit wrapper" paired with a revenue-share model on GPU deployments when spot pricing exceeds a baseline floor. Rather than traditional vendor financing—which carries balance sheet risk—this framework enables third-party debt providers to finance GPU infrastructure with downside protection while securing upside participate rights for Nvidia via cloud royalties.
Baker argues that leading memory manufacturers like SK Hynix should adopt identical capital structures. By co-investing cash flow into credit wrappers alongside private debt giants like Blackstone and Apollo, memory vendors can guarantee long-term capacity utilization while retaining upside participation in global token generation revenues.
* **Nvidia Credit Wrapper:** A structured arrangement where Nvidia provides downside protection and revenue-share mechanisms to facilitate third-party debt financing of GPU clusters.
* **Memory Strategy:** High-bandwidth memory capacity remains the primary physical bottleneck for increasing token throughput per unit of compute.
* **Private Credit Partnerships:** Alternative asset managers (e.g., Blackstone, Apollo) are actively structuring hybrid debt-equity solutions to back multi-gigawatt AI infrastructure projects.
<ElicitationsGroup message="Explore related strategic discussions from this conversation:">
<Elicitation label="Examine the public vs. private market AI valuation gap" query="Walk through Gavin Baker's analysis of the public versus private market AI valuation gap and Nvidia's forward P/E metrics."/>
<Elicitation label="Review the China DUV equipment and software bull case" query="Detail Gavin Baker's insights on China's semiconductor capabilities, DUV immersion tools, and the bull case for enterprise software."/>
<Elicitation label="Analyze the SpaceX orbital compute thesis" query="Provide a detailed walkthrough of Gavin Baker's discussion on SpaceX, orbital compute, and space-based AI infrastructure."/>
</ElicitationsGroup>
`40:00` Nvidia’s Revenue Share Model, Startup Cost Disadvantages, and the Compute Game Theory
Nvidia is quietly shifting its business model by taking equity stakes and securing revenue-share royalties on recurring revenues generated by customers using its chips. Gavin Baker highlights that Nvidia’s cash flow generation allows it to opportunistic bridge funding gaps for compute buyers while significantly increasing its own revenue per gigawatt. This strategy cements their competitive position: startups building their own custom silicon face substantially higher costs at TSMC, pay higher prices for HBM DRAM, and struggle to obtain the favorable credit terms that Nvidia can secure.
On the lab front, game theory continues to drive aggressive compute deployment. Anthropic had temporarily taken a more cautious stance on compute expenditure—with CEO Dario Amodei publicly noting the delicate balance where buying too much compute risks bankruptcy, while buying too little risks losing the race. However, OpenAI, xAI (with Grok), and others on the Pareto frontier are pushing hard again. With SpaceX ramping up its compute investments for xAI, no major player can afford to lift their foot off the gas pedal, especially as investments begin to be funded directly out of accelerating operating cash flows.
- **Nvidia's Strategic Edge:** Equity stakes in labs (including Anthropic and Safe Superintelligence) combined with cash flow financing maximize revenue per gigawatt while placing rival startup silicon at a severe cost-and-financing disadvantage.
- **Compute Game Theory:** The aggressive re-entry and scaling by OpenAI and xAI compel all frontier labs to continually expand compute capacity to remain on the Pareto frontier.
---
`43:28` Contrasting Market Pessimism with Valley Bullishness and China's DUV Breakthrough
Baker notes a stark disconnect between public stock markets—where he feels like a "foolish optimist" for remaining constructive—and the ground reality in Silicon Valley, where almost everyone is dramatically more bullish than he is. He references commentary like Dwarkesh Patel’s analysis, which contemplated H100 rental prices rising to $250,000 per year (roughly 15x current spot rates) due to compounding margins, total compute capacity growth, and inference demand.
Turning to geopolitical developments, Baker evaluates reports of China developing its own Deep Ultraviolet (DUV) lithography machinery. While the stock market often overreacts to such headlines, Baker compares moving from no domestic lithography to working DUV as a phase transition—akin to moving from a propeller plane to a jet turbine, even if it remains decades behind EUV "warp drive" technology.
```
Lithography Technological Progression (Analogy)
===================================================
No Capability ---> DUV (Jet Engine) ---> EUV (Warp Drive)
[China's Milestone] [State of the Art]
```
- **Market vs. Industry Disconnect:** Public equities have priced in severe pessimism despite accelerating physical compute deployment and strong unit economics on the ground.
- **China’s Semiconductor Capabilities:** Achieving indigenous DUV capability is an important milestone for China, but catching up to global EUV state-of-the-art requires multi-year "learning by doing" cycles that cannot be bypassed overnight.
- **US-China Decoupling:** The decoupling between the US and China semiconductor supply chains is a self-reinforcing process that both nations are committed to maintaining.
---
`46:10` The Bull Case for Software, Open Source Models, and Routing Architectures
Contrary to the narrative that AI will destroy traditional software, open source models nearing frontier capability—combined with inference optimization platforms like Fireworks AI—are proving to be a massive catalyst for software and AI-native startups. By utilizing tools like Fireworks' Nexus, applications can ingest domain-specific data, perform reinforcement learning (RL) on open-source weights, and route queries so that 30% to 60% of traffic runs on custom, low-cost models while calling frontier models only when necessary.
> "If you can go from just using one, two, or three frontier models to using those frontier models for whatever it is, 30 to 60 percent of your token consumption and then use your own RL model, all of a sudden you're not a wrapper. You're way more defensible."
This architectural shift allows AI-native startups (such as Cursor or Harvey) to build real defensibility and improve gross margins. Furthermore, fast-growing inference clouds like Together, Modal, and BaseTen are scaling revenue at rates comparable to early frontier labs while remaining surprisingly cash-efficient and operating with impressive Rule-of-40 SaaS-like metrics.
- **AI-Native Stack Strategy:** High-level planning and complex tasks are assigned to frontier models, while execution tasks are routed to distilled or domain-tuned open-source models, cutting overall costs by up to 15x.
- **Inference Cloud Efficiency:** Inference providers (Together, Modal, BaseTen) are achieving explosive revenue growth with minimal cash burn compared to model training labs.
- **Frontier vs. Commodity Tokens:** Cheap, abundant open-source tokens may actually increase the marginal value of top-tier "160 IQ" frontier tokens that act as orchestrators.
---
`50:35` Regulatory Risks, Public Relations Failures, and Data Center Myths
When asked about the single biggest threat to the AI ecosystem, Baker immediately highlights regulatory risk and negative political narratives as the primary danger. Data center moratoriums, such as those proposed in New York, stem from what he describes as a total public relations failure by the tech industry to communicate the real-world economic benefits of AI infrastructure.
Popular narratives falsely claim that data centers drain local power grids, consume excessive water, and destroy jobs. In reality, modern behind-the-meter energy deals often lower electricity rates for surrounding communities, while developers fund local infrastructure like schools, hospitals, and emergency services. Additionally, data center maintenance and operations provide durable, high-paying blue-collar jobs for electricians, plumbers, and HVAC technicians.
- **Data Center Misconceptions:**
- **Power:** Large-scale energy agreements frequently lead to reduced local utility rates.
- **Water Usage:** Claims of astronomical water consumption stem from a widely cited, debunked academic error (a "Popeye spinach decimal point" mistake).
- **Employment:** Constructing and updating data center infrastructure generates sustained, high-wage blue-collar employment.
- **Industry PR Imperative:** Baker argues the AI sector urgently needs a coordinated media and political campaign (e.g., running Super Bowl or World Series ads) to highlight community investment and life-saving medical breakthroughs driven by AI.
---
`57:15` Hardware Disaggregation and Dark Horses in the AI Race
Baker points to hardware architecture disaggregation as an overlooked driver for improving AI compute ROI. Specifically, splitting inference into its core components—pre-fill, decode attention, and decode feed-forward networks (FFN)—allows hardware builders to pair HBM DRAM chips with SRAM-based accelerators produced on mature nodes. SRAM accelerators excel at handling feed-forward workloads without being constrained by expensive HBM DRAM supply bottlenecks.
To close, Baker touches on potential "dark horse" leaders and rising players in the landscape:
- **Key Figures & Startups to Watch:**
- **Fireworks AI:** Led by Lin Qiao (referred to as a "killer" operator), enabling custom model fine-tuning and routing.
- **Cognition:** Led by Scott Wu, pushing autonomous software engineering forward with Devin.
- **SpaceX & xAI Integration:** SpaceX’s massive expansion into compute cluster buildouts for xAI demonstrates unmatched speed in deploying physical infrastructure at scale, effortlessly absorbing market compute capacity without dampening spot prices.
<FollowUp label="Want me to summarize Gavin's core arguments on GPU economics and memory supply agreements?" query="Can you summarize Gavin Baker's main points from this podcast regarding GPU economics, contract vs. spot prices, and memory supply agreements?"/>
Here is the detailed walkthrough of the final part of the episode:
`01:00:00` SpaceX, Orbital Compute, and the Benchmark Table
Gavin Baker weighs in on the mind-boggling scale of SpaceX's ambitious expansion into compute infrastructure. Citing a public report from SemiAnalysis (The Information/Funder AI), he references claims that SpaceX is aiming to bring online an astonishing eight gigawatts of compute power over the next 18 months. While Gavin emphasizes that he would "never bet against Elon," he finds that target "truly incredible" and "very implausible." To put that number into perspective, each gigawatt is monetizing at roughly $50 billion, which would dwarf current consensus revenue estimates for SpaceX next year (around $73 billion). Even when ignoring core revenue drivers like Starlink V3, Starlink Direct to Cell, Grok 4.5, and Cursor—which alone could hit a $10 billion ARR very quickly—bringing eight gigawatts online is a monumental task. Rates have increased since their last contracts were signed, making it even harder. However, Gavin acknowledges that outside of the major hyperscalers, the only non-hyperscale companies to have successfully brought on over 500 megawatts in a single year are CoreWeave, Crusoe, and SpaceX—with SpaceX bringing on the most power, the fastest, and at the lowest cost.
Gavin notes that public market investors and Wall Street consensus have virtually zero of this compute upside built into their valuation models. He points out a prominent New York hedge fund short case on SpaceX that hinges on the assumption that spot prices for compute will drop by 90%, crippling expected returns. Addressing Elon Musk's track record, Gavin quips with one of Musk's well-known self-deprecating phrases: "We specialize in making the impossible late." He references the popular internet meme labeling SpaceX as "the data center company," acknowledging how surprisingly accurate it is becoming. Furthermore, following a recent visit to Starbase and witnessing a Starship landing, Gavin notes that orbital compute feels increasingly real. He highlights Benchmark's investment in StarCloud—an orbital compute startup partnering with SpaceX to leverage Starlink's crucial optical laser mesh technology. The fact that Benchmark (a firm with no direct ties to the Musk ecosystem) backed StarCloud without SpaceX's internal cost-structure advantages serves as a solid sanity check that orbital compute isn't just a wild fantasy.
The conversation closes with a playful nod to their physical location, revealing that they are recording at the famous dining table inside Benchmark's offices. Gavin and the host express their gratitude to Benchmark partners Sheila Patel and Eric Vishria for hosting them. Looking ahead at the probabilistic nature of the market and the rapid pace of model releases, they joke that at this rate, they will be meeting again in just a couple of weeks.
* **Public Report Baseline:** The Funder/SemiAnalysis report outlines an 8-gigawatt compute target for SpaceX over 18 months, which Gavin finds highly unlikely to be fully realized in that timeframe given power grid constraints.
* **Hyperscale Power Club:** The only non-hyperscalers to successfully deploy over 500 megawatts of power in a single year are CoreWeave, Crusoe, and SpaceX.
* **Short Thesis:** A prominent New York hedge fund holds a major short position on the premise that spot compute prices will crater by 90%.
* **Orbital Partnering:** StarCloud is partnering with SpaceX to utilize Starlink's laser-interlink technology to make space-based compute viable.
* **Musk Quote:** "We specialize in making the impossible late."
---
`01:05:00` Closing Sponsor Acknowledgments
The episode wraps up with standard closing disclosures and promotional messages highlighting the podcast's key sponsors, including Ramp (capital allocation and spend management), Vanta (automated security compliance), WorkOS (enterprise readiness infrastructure for AI companies), Ridgeline (cloud operating systems for asset managers), and Rogo (financial AI agents built for Wall Street).
## Notable quotes
> `06:53` Jensen is the world's largest supporter of open source... But does it really stand to reason that Jensen would be the world's biggest supporter of open source if it was bad for his business? — Gavin Baker
> `46:10` If you can go from just using one, two, or three frontier models to using those frontier models for whatever it is, 30 to 60 percent of your token consumption and then use your own RL model, all of a sudden you're not a wrapper. You're way more defensible. — Gavin Baker
> `01:00:02` We specialize in making the impossible late. — Elon Musk
## Mentioned
Gavin Baker, Patrick O'Shaughnessy, Atreides Management, Benchmark, OpenAI, Anthropic, Claude, Claude Code, Meta, Muse 1.1, Microsoft, Amazon, Google, AMD, Nvidia, Blackwell, Rubin, Ampere, Hopper, H100, B200, SK Hynix, Kimi, GLM 5.2, Fireworks AI, Base Ten, Modal, Together, Safe Superintelligence, Ilya Sutskever, Grok, SpaceX, Starlink, StarCloud, TSMC, Blackstone, Apollo, Dwarkesh Patel, Cursor, Harvey, Cognition, Scott Wu, Devin, Lin Qiao, Dario Amodei, Elon Musk, Sheila Patel, Eric Vishria, CoreWeave, Crusoe, SemiAnalysis, Ramp, Vanta, WorkOS, Rogo, Ridgeline, The Podcast Consultant
Gavin Baker argues that public market sell-offs in artificial intelligence reflect an algorithmic sentiment disconnect rather than fundamental deterioration, as physical compute pricing, cash flow generation, and token demand continue to accelerate. He contends that expanding operating cash flows and open-source inference routing will self-fund infrastructure expansion, leaving regulatory and political pushback as the primary threat.
Market Sentiment Disconnect Versus Hardware Fundamentals (0:00)
Baker observes that public AI equities fell 40% to 60% during a sharp July drawdown, driven by narrative shifts rather than deteriorating fundamentals. He attributes this heightened volatility partly to algorithmic homogenization, noting that institutional investors feeding news into models like Claude have turned the tool into an algorithmic 'Walter Cronkite.' This shared consensus compresses multi-year supply-demand cycles into weeks, as seen when Japanese capacitor equities completed a three-year cycle in six weeks without changes to baseline operations.
In contrast to public pessimism, Baker reports that physical compute metrics in Silicon Valley are accelerating. Legacy contracted compute currently trades at a discount to the spot market, meaning expiring multi-year contracts will reprice higher. Spot rates for Nvidia Blackwell B200 GPU clusters have jumped 50% to 60% over a six-month period, while inference cloud providers report expectations of paying up to 100% more upon contract renewals, supporting revenue and margin growth.
Hyperscaler Self-Funding and Novel Compute Financing (10:51)
Baker disputes Wall Street fears that rising real yields and wider credit default swap spreads will derail the capital-intensive AI build-out. Consensus financial models assume future Blackwell and Rubin hardware will monetize at the muted rates of two-generation-old Ampere chips. Baker calculates that if next-generation silicon monetizes anywhere near current spot values, hyperscalers will generate roughly $2 trillion in operating cash flow, eliminating approximately $700 billion in projected debt requirements. Adjusting for one-off European Union regulatory fines, hyperscaler operating cash flow growth already accelerated from 28% to 35% quarter-over-quarter.
To bridge capital deployment lags without taking debt onto its balance sheet, Nvidia has structured credit wrappers that provide downside protection to third-party lenders while securing cloud revenue-share royalties when spot prices exceed a baseline floor. Concurrently, long-term supply agreements (LTAs) for components like high-bandwidth memory (HBM) have become non-cancellable strategic assets; Baker notes that in a competitive race among Amazon, Google, AMD, and Nvidia, defaulting on an LTA during a temporary lull risks permanent loss of supplier allocations.
Open-Source Models, Routing, and Software Defensibility (23:55)
Baker characterizes open-source models as market 'dark matter' that public investors misinterpret. When silicon token indices dipped due to a mix shift toward cheaper open-source models like Kimi, markets treated the shift as a demand drop. However, Baker argues that 'a token is a token' requiring identical raw compute, memory, and wattage. By reducing nominal token costs, open-source adoption expands volume elasticity and transfers margin from frontier model developers directly to underlying compute providers.
This shift supports software defensibility via multi-model router architectures. AI-native applications route 30% to 60% of execution volume to low-cost, fine-tuned open-source models, querying expensive frontier models like Claude or Grok only for complex planning and edge-case verification. Baker notes that this architecture can lower blended token expenses by up to 15 times, enabling enterprise software startups to protect gross margins while capital-efficient inference clouds like Together, Modal, and BaseTen scale rapidly.
Power Deployments, SpaceX, and Regulatory Risks (50:35)
Baker identifies political narratives and regulatory intervention—such as proposed data center moratoriums in New York—as the single greatest threat to the AI ecosystem. He views this as an industry public relations failure, arguing that popular claims regarding data centers draining community water supplies stem from a debunked academic citation error, whereas modern behind-the-meter energy deals often reduce local utility rates and create durable, high-paying infrastructure jobs.
Regarding physical infrastructure execution, Baker highlights SpaceX, CoreWeave, and Crusoe as the only non-hyperscalers to successfully deploy over 500 megawatts of power within a single year. While Baker considers public reports of SpaceX targeting 8 gigawatts over 18 months to be very implausible due to power grid constraints, he emphasizes SpaceX's unmatched speed in deploying physical clusters. Furthermore, venture investments by Benchmark into StarCloud suggest that space-based orbital compute using Starlink's optical laser mesh is becoming a viable medium-term alternative.
Baker concludes that operational AI fundamentals remain insulated from public equity volatility, supported by rising compute contract rates, cash-generative hyperscaler balance sheets, and architectural efficiency. However, the ecosystem's momentum depends heavily on whether the technology sector can mount a cohesive public relations effort to defeat local utility misconceptions and regulatory data center bans before they restrict physical power deployment.
[6:53] Gavin Baker: Jensen is the world's largest supporter of open source... But does it really stand to reason that Jensen would be the world's biggest supporter of open source if it was bad for his business?
[46:10] Gavin Baker: If you can go from just using one, two, or three frontier models to using those frontier models for whatever it is, 30 to 60 percent of your token consumption and then use your own RL model, all of a sudden you're not a wrapper. You're way more defensible.
[60:02] Elon Musk: We specialize in making the impossible late.
Original transcript
[0:00] Ramp is the only platform built to make your finance team leaner, faster, and better, saving businesses 5% annually on average so you can stay focused on growth. Ramp customers grew revenue 3.2 times faster than the average American business. Visa, Vercel, Cursor, Stripe, Notion, 11Lab, Shopify, and 70,000 other businesses all run on Ramp. Mine does too, and so should yours. Learn more at ramp.com slash invest. Felix by Rogo is a personal finance agent that turns a single prompt into finished client-ready work using your firm's own templates, context, and standards. Send Felix an email like, take these comments and turn them for me, or update my tracker with the context of these emails, or run the ability to pay math on this buyer, and Felix sends back finished PowerPoint decks, Excel models, and sourced research. Felix works the way your team already does, delivering work quickly and accurately around the clock. Learn more at rogo.ai slash Felix. The best AI and software companies from OpenAI to Cursor to Perplexity use WorkOS to become enterprise ready overnight, not in months. Visit WorkOS.com to skip the unglamorous infrastructure work and focus on your product. Hello and welcome everyone I Patrick O and this is Invest Like the Best This show is an open exploration of markets ideas stories and strategies that will help you better invest both your time and your money If you enjoy these conversations and want to go deeper, check out Colossus, our quarterly publication with in-depth profiles of the people shaping business and investing. You can find Colossus along with all of our podcasts at colossus.com. Patrick O'Shaughnessy is the CEO of Positive Sum, All opinions expressed by Patrick and podcast guests are solely their own opinions and do not reflect the opinion of Positive Sum. This podcast is for informational purposes only and should not be relied upon as a basis for investment decisions. Clients of Positive Sum may maintain positions in the securities discussed in this podcast. To learn more, visit PSUM.VC. Gavin, it's only been two months. Like the model release cycles, the gap between our podcast episodes are shortening. We're basically, you and I are basically on a model release cadence at this point. Well, I was sensitive to criticism that I think somebody pointed out that our podcasts were coincident with like local market peaks. And nobody can say that after this What on your mind It been a crazy Yeah I would describe July as 2022 in a month Yeah There are some fundamental negatives which we should talk But on the whole the ballots of fundamentals, I think, is improving significantly. Loads of AI names are down 50, 60 percent from their highs. We'll call it 40 to 60 percent in a month in a straight line. And I asked you before we started, you've been out here for the summer. Have you heard a single negative quantitative metric about AI? A single instance of deceleration? Nothing. Nothing. In fact, every metric is accelerating. And to your point, not just blind optimism from people excited about AI, but like, here's some data that they can show you from their different vantage points. Absolutely. I mean, however you cut it, whether you cut GPU availability, whether you cut GPU rental pricing, whether you cut the spot price of DRAM this month, token growth, everything is actually accelerated. And I do think a big part of the problem is one the market does not have visibility into anthropic open AI And then I would say these open source inference clouds that monetize inference here in America Fireworks, Base 10, Modal together. And the picture looks very different when you see that. Because open source has accelerated massively because of GLM 5.2, Kimi K3. And then Nematron continues to kind of chug along. We had a great, very small American open source model release. OpenAI has accelerated. Anithropic continues to grow really strongly and is almost certainly pumping out significant amounts of free cash flow. And I just think if there's this chart that everybody looks at of semiconductor cash flow going like this and hyperscale free cash flow going like that, and you're missing these private companies. But I also think that that chart misses something very important, which is just that you have everyone in 24 and 25. Even if you were really bullish, you thought that GPU prices, if you're really bullish, you thought they would decline slowly. If you're bearish, you thought it would decline precipitously. I don't think anyone in 24 or 25 thought that the prices of old GPUs
[5:00] would be going vertical. Everybody thought, hey, we're going to be smart. We're going to sign these long-term contracts. And to some degree, like a lot of the neoclouds had to do that because they needed an offtake agreement to finance the GPUs. And so essentially you have the contracted base of installed compute trading at a massive discount to the current spot market. And as those contracts roll off and compute gets repriced higher, and SPOC can decline and compute will still get repriced higher. I think you're going to see a lot of acceleration that's going to answer these ROI questions. You've started to see that this quarter. If we look at operating cash flow, not free cash flow, operating cash flow from Microsoft, Meta, and Amazon has reported accelerated from 28 to 32. There are some actually pretty big unusual items now, like these hyperscalers, they always seem to have billions of dollars of legal expenses that are unusual, mostly fines to the EU. But there is an unusual amount of one-timers this quarter. And if you adjust for that we went from 28 to 35 That a material acceleration at this scale And that really before they start to light up the Rubens which will come at a meaningful premium before these contracts reprice It been a challenging month. Is it helpful to kind of like walk through the month, how we got here? Yeah. So first, Meta is going to rent out compute. And this is seen as like very bearish. They have excess capacity. They're going to cut CapEx. This is a disaster. This is not at all what it was. They just reported they didn't cut CapEx. What it was is they saw SpaceX have a big installed base of compute and sell some big trading optimized clusters into the market at a truly massive premium to these contracted rates. And at least analysts like that, they saw an opportunity. There's a lot of speculation they're going to raise capital. So maybe what they're thinking is like, hey, we will show on a small chunk of capacity that we can generate really strong IRRs, then we're going to raise equity capital and we'll be off to the races and probably raise CapEx. It doesn't look like that's what they're doing. But nonetheless the market sold off because it interpreted this very negatively And I was really sure it wasn negative A lot of telemetry into Metis CapEx plans None of that telemetry had shifted at all If anything they continuing to get more aggressive And then shortly after that, they released their best model in a long time, Muse 1.1, which is actually a very good model. It was overshadowed by GROC 4.5, but it was a good model. Way better than anything in two years. So just no chance they're taking their foot off the gas. Then Kimi comes out. And then there's this huge freak out about open source. And at the same time, this silicon data token index kind of dips and flattens. And the two are connected. What the silicon data token index captures is mix. And they don't see all the tokens. But because of GLM 5.2 and then Kimmy, although it took a while to layer in, there's kind of a mix shift in this data from more expensive frontier tokens, which probably have an inference margin. We can debate whether it's 80, 90, or 95, but super high towards open source tokens. And for whatever reason, the market thought this was negative, but the reality is a token is a token and you need the exact same amount of compute to make a token all else equal It takes the same amount of flops the same amount of memory the same amount of watts Tokens are not equal but broadly speaking all open source taking share does is take margin dollars out of the frontier model layer There is elasticity, thereby driving token demand. You need more demand for compute. And the margins, you know, Anthropic and open source, they all run on the same underlying cloud providers who charge the same amount of compute. So you're literally just taking margin from frontier models and essentially driving more margin dollars into the AI infrastructure layer. That was the catalyst. This combination of things. Well, yeah. Jensen is the world's largest supporter of open source. He is like a super idealistic guy. He's a patriotic American. I think he always does what's right. But does it really stand to reason that Jensen would be the world's biggest supporter of open source if it was bad for his business? You know, he'd still support if it was the right thing for the world. And by the way, I think open source is really important to worlds where there's just one or two dominant frontier models that charge like 90% margins. It's not good for humans. It might not be good for society. And I think we want a lot of models
[10:00] as we've discussed before. So then it's like, okay, the market digests that and comes to turn with it. Then China has a DUV machine. Everybody's in these baskets. This causes a huge sell-off in semi-cap equipment. And then we get to what I think is, in a lot of ways, the real concern, which is real yields have gone up, which makes sense. We're investing a lot to fund this investment. And for sure, credit is an increasing part of it, even if the majority is still funded out of operating cash flows. So real yields go up and spreads widened. Meta priced a bond last week, and it did not price where you would think a Meta bond would price. And this just shows that the credit market- NVIDIA CDS was blowing out. All of the CDS, CDS for everybody is blowing out. And very smart private capital people just like, hey, this is just exactly what you'd expect. These are just banks hedging their commitments, but nonetheless, it doesn't look good. And these are undeniable facts. CDS is up, spreads are widened, real yields are up. That would be really, really scary if we needed debt to finance this buildout And that where I think it this differential between spot and contract pricing for the installed base of compute is so important It so important to understand what the financing will be like for the next six months or something The degree to which this build out is going to require credit. Right. Which would be the classic capital cycle. Absolutely. Overextend ourselves with debt. And that's where things get 100 percent. And then debt fueled build outs. They demand immediate repayment. So if supply and demand get a little bit out of whack, things can unwind very, very quickly. That's what happened to the Internet. If one believes, as I do, rightly or wrongly, after this month, I'm super open. You know, I'm looking like I've been pressure testing all of these. And like I really went deep on credit because, hey, this is real. It's undeniable. And if we need credit to fund this build out, this is a significant negative. And if you model it out, if you look at the amount of gigawatts that are supposed to come on and consensus estimates for hyperscalers, they're effectively modeled. And these are gigawatts of Blackwell and Rubin, Rubin being NVIDIA's next chip, Blackwell being the current chip. They are essentially modeled to monetize roughly at the rate of Ampere which is two generations behind not at Hopper but Ampere So there 1 to 1 trillion in hyperscale operating cash flow If you just assume I think it's very unlikely they monetize at the rate of Ampere. We could go into why. Some of it comes from just seeing what is happening on the ground with demand here for real quantitative metrics. But let's just say they monetize at a discount to current Blackwells. Then it's more like $2 trillion of operating cash flow. And that kind of takes $700 billion of credit demand out, ironically, as that improves all the credit ratios. As these installed bases of compute reprice, we're going to continue accelerating. Because since this is modeling at a deceleration, which I think is unlikely, then the credit metrics look better. And then all of a sudden, it gets easier to finance with credit. Now, whether they choose to do that or not, we'll see. This is all a little bit, you know, I think we spoke. Two months ago. No, but the time before that about kind of the risks of a Blackwell air pocket. Oh, yes. Where you're spending hundreds of billions of dollars on Blackwells. They're mostly being used for trading initially. Trading does not generate a return This could be a risk We actually really saw that in the first quarter I think one reason to the podcast two months ago I got comfortable with that risk was just that you were seeing such incredible things out of Anthropic. And then it's like, okay, well, the market's kind of gonna look past this. And it did look past it in April, in May, in June. And then in July, because of this kind of confluence of things, stopped looking past it. just as the operating cash flow started to really accelerate. And this is just a fact. It is accelerating at big scale. Like Microsoft, they brought on a huge slug of capacity in the month of June. That didn't even show up in the second quarter. So essentially, what this all comes down to is, do you believe that the quantitative demand signals seeing on the ground here in Silicon Valley from private companies are going to continue such that the installed base of compute reprices higher as contracts roll off, operating cash flows go up, and you could fund most of this out of operating cash flows, maybe all of it. Like if it reprices at current rates, you could probably fund all of it for the next several years. It has been a very unusual episode
[15:00] in the market. We should talk about what the fundamentals are that are getting better that I'm talking about. Technicians would say it's actually in 22. Okay. The market is worried about a recession rates going up inflation. That's what the market was worried about in 22. You knew exactly what it was. Okay. Deep seek. You know what it's worried about liberation day. You know what it's worried about. There's something very clear and in a weird way, that's comforting. Sure. And here, you know, we talked about a lot of specific things, but it just feels all those specific things with the exception of credit are just kind of ridiculous. And so the fact that it is still going down, a technician would say, hey, that's a little scary. It's definitely the bullet you don't see that gets you. I think we've talked before about how I think the three most important words in investing aren't margin of safety, but I don't know. Oh, but just you've been out here for two months. I've been out here. I literally spoke to a company this morning who rented a cluster of several. And this is one of the sexiest startups that people want to be in business with. And they had rented a cluster of several thousand black wells And we just call it somewhere in the mid per GPU hour They renting the exact same size cluster essentially identical in every way B200s no differences. And they're hoping seven months later to pay just under $4 today. That's pretty crazy because, again, you would expect a really gentle decline in prices would be bullish. Instead, we're up, depending on the starting point, 50 to 60 percent in six or seven months. There have been so many anecdotes like that. Like I think one of the inference clouds, I think it was based in, I'm not sure, they went on a podcast and they essentially said, we are planning to pay 100 percent more for Blackwell's when our contract expires. And that just means that essentially all the hyperscalers are under-earning. my main kind of mission out here this week is like pressure test. Yeah. Yeah. Tell me something negative. Like, you know, the question I asked you, is there one negative quantitative metric you've heard has been what I've been asking everyone. The main thing people are saying is the third party data suggests that the anthropic curve started to go off of its trajectory a little bit That like the only thing that I think that may very well be true But then you have open AI and open source massively accelerating Yeah the complex You look at the sum It is net accelerating. Like, I think open source is a little bit of a, you know, they talk about dark matter in the universe, like open source is kind of dark matter to the public markets. It's hard for public markets to measure it. But like, if you just track what these inference clouds are saying, people saying things on podcasts or people saying things in meetings. They're not audited financials. Demand is clearly accelerating, which makes sense because you have this huge capability leap with GLM 5.2 and Kimi K3, which I think we're going to see continue. I think you're going to see NVIDIA bring Nebotron steadily closer to the frontier. But man, it has been a humbling, challenging month. But just it's also like, wow, I've kind of pressure tested every assumption. The underlying fundamentals are improving. NVIDIA is actually, as we record this, at its lowest forward PE of the last 10 years. Crazy. The only time the SIMIs have been cheaper were Liberation Day and DeepSeek, and those were kind of B bottoms. And that means to you just that the market thinks they significantly over Yeah the market 100 thinks they significantly over And we need to be humble Maybe they are. Maybe they are. But my kind of mission out here this week was to look for negative data points as hard as I could. And normally you come to Silicon Valley and there's a mixture of here's something negative, here's something positive, da-da-da, unbalance it's positive. If you know tech, it creates value over time. But I haven't been able to find one that is like a quantitative metric. That anthropic third-party data, I would say that seems to be hotly contested by the anthropic shareholders who are chomping at the bit to tell you what they know. We're also very scared they're not going to get an IPO allocation if it gets back to the company that they're the ones who said, actually, things are great. You know, you can just see Anthropic shareholders. Like they want to be like, it's not true. You know? It's hard for me to believe that open source and open AI have accelerated to the extent they did. But yeah, Anthropic is clearly in the pole position. And oh, by the way, Grok and Cursor have also, you can see from third party data, like July was a pretty transformational month with Grok 4.5, Grok builds coming out.
[20:00] So it has been a tricky month. And I have a friend, a friend of fidelity, who just says the way to have navigated the last three years is just do the dumbest, most superficial thing as quickly as possible and just cycle between them. What is that now? Yeah. Well, that's just that has been to cut risk all month in response to these narratives that factually, except for credit, are not true. And the work we've done makes me think that credit just isn't going to matter as the street prices. Let's just say you do need credit to, like, build the flops we need. Well, if credit's not there, it just means the flops that are there are going to be even more valuable. And then eventually that will improve the metrics. And then it's like credit is there. So as long as we're in a compute shortage, which I'm just like desperately trying to find a single sign that we're not in one and that it's not actually getting worse almost by the day. It's almost like the problem becomes the solution. And then this company Black Forest Labs I think that their name I hope I got it right Because there is an interesting essay that got sent to me I think we talked before about Mike Momison theory that breakdown in diversity is kind of what leads bubbles and crashes And essentially everyone I know in the public equity investment business, whether retail or institutional, every piece of news gets fed into Claude. And Claude, Claude code, sometimes a Claude agent. And it's probabilistic. There's probably not that much variation in the way it's interpreting this news. It's almost like we're back to, in stock market terms, there's never really been this way in the stock market before, but people talk about the fragmentation of media and how it used to be like Walter Cronkite, only voice of truth, and now we don't have that anymore. It's like Claude is kind of Walter Cronkite for the stock market, and everybody just believes whatever it says. By the way, It's really smart, but it's not always right. It's interpretation isn't always correct. And with the stock market, you are fundamentally dealing about, you know, a probabilistic Bayesian interpretation of the future. It feels like in the market here this piece of news It gets fed through Claude Claude interpreted this way It a huge chunk of people trade on claude view and so you seen stuff there this guy tbu he like a part of the anonymous semiconductor mafia on x yeah actually very smart guy i know him in real life but he posted this amazing chart of japanese capacitor stocks and he said we've had an entire capacitor cycle in six weeks and it's true you know the stocks like whether they double triple or quadruple I don't know, but like vertical and then whoosh, like the actual fundamentals haven't even hit. And yet you've already had what probably would have normally been a three-year cycle in like six weeks. Vanta automates security and compliance for over 16,000 fast-moving companies like Ramp, Cursor, and Harvey, keeping them audit-ready around the clock. It's the number one agentic trust platform, and it now helps companies like yours watch for the risks that show up between audits across your vendors, your AI tools, and your whole environment. Every new tool your team signs up for, every vendor that turns on AI features is an opportunity for something to go wrong. And most security programs weren't built for AI's pace of growth. The Vanta agent works like a 24 seven GRC engineer in the background finding issues drafting fixes for you and cutting vendor assessment time by up to 50 Whether you a fast startup or a global enterprise Vanta helps you earn and prove trust. Invest like the best listeners get a special offer for $1,000 off at vanta.com slash invest. Ridgeline is the first end-to-end system of record with embedded AI for investment management firms, running portfolio accounting, reconciliation, reporting, trading, and compliance on one unified platform. Firms are moving off legacy technology and onto Ridgeline because of how far ahead Ridgeline's AI features are compared to anything else in investment management software, which is why I believe that firms that come out ahead in the AI era will be the ones running on Ridgeline's unified platform. If you're serious about your firm's AI strategy, Ridgeline should be part of that conversation. You can request a demo at ridgeline.ai. What's your sense of being out here, especially it makes me especially curious about this, the innovation that is going on here to improve the efficiency and every aspect of serving inference of training models, et cetera, and how that will affect like public markets over time. Like, have you learned anything interesting about the long lead time innovation type stuff that has you especially excited or excited?
[25:00] Curious? Yeah, I am very curious. A lot of people seem to feel like they are very close to solving continual learning and sample efficient learning, which we've talked about before. And it is possible that if those are solved, that could that be like a temporary discontinuity in demand if instead of I was trained on effectively 20 billion tokens and that it's like these models are trained on 300 trillion tokens. And if you can trade something on 10 trillion tokens and then let it out into the world and learn sample efficiently, that doesn't sound good for trading demand. But trading has a percentage of semiconductor demand to compute is going to asymptote to something not approaching zero, but very small. But I would say that is the most interesting. And who knows if it's long horizon or short horizon. SSI says that they're going to come out with their model in August. There's this whole generation of new labs that are focused on this. And this would be good for the world. This would be amazing. To be clear, yeah. This would be awesome for the world. We all want this. Yeah, we want this. It would be amazing for the world And it just it hard for me to believe that that would actually be negative for AI infrastructure demand But again trying to be really really open I would say that was probably like the biggest scientific or technical takeaway. You know, it's also- I just don't know. Well, yeah. And also like NVIDIA is heavily involved with all of these startups. If you were just forced to come up with the set of circumstances that would really switch you around and get you really scared, would it just be that this operating cash flow thing doesn't play out and therefore we just need to debt finance this? Yeah, if the operating cash flow does not continue to accelerate, that would be negative. And that, to some degree, is going to be a function of how Anthropic, OpenAI, GrokCursor, and open source do. If there was a pretty dramatic contraction in GPU prices that was kind of sustained, the market would react to that instantly. That would be worrisome if it started to get to be really easy to get GPUs. I mean, have you heard anyone say they have too many GPUs? Like not a single person. It's not like it's the opposite. It sounds like a drug market or Yeah it really does It just wild But yeah I mean I think there a long list of pretty obvious things If the sum of these labs plateaus or starts to decline that really negative unless it just because open source tokens are net growing the pie and taking share. And I do really think the future is multi-model, particularly for the AI natives. They're going to want to take an open source model. It's got all these inference clouds have gotten really good at supervised fine tuning and reinforcement learning. So you can take your data, customize an open source model, and then get something that you can put behind a router. And the router routes it to often first your model and then quad frontier model, whatever, quad grok checks it. And you can, in a lot of cases, get slightly better outcomes at half the cost. But again, that half the cost, I think a lot of people hear that They're like, that's bad for AI demand. It's actually not at all because the cost the user pays is just a function of the margin on the tokens. And you're literally just shifting tokens from really expensive tokens with like 90 gross margins to tokens with maybe let call it a 30 gross margin And that where the savings are coming from but the tokens cost the same amount of compute to produce And then also all these things are kind of happening on different cycle times. All these big public companies are like, oh my God, my AI spend is 20X, I've burned my budget in three months. So they set up a router and that actually cuts their AI spend, but it doesn't really impact, It may actually increase the amount of tokens that they are generating just by shifting them to these cheaper open source tokens. And that's just more compute. So a company getting smarter about which model to use for which task, that may lead to a stabilization of their spend or even a decline. But it actually has nothing to do with the amount of GPU compute hours they are effectively consuming behind these model layers of this router. The GPU computer hours probably are going up as you shift to these cheaper tokens you can use more of. That's happening to like a cutting edge of public companies. And then you have this whole wave of AI natives. They're leaning into this so hard and they're not hiring humans. They're just putting it mostly into tokens. They're not slowing down.
[30:00] And then you have companies on the East coast of America who have like barely adopted AI companies, broadly speaking, you know, not on the coast who maybe are as cutting and then Europe, who's just trying to figure out how to regulate it. Before using it. Yeah, so just like there's kind of these differential waves of adoption all happening at the same time. But the thought I can't get out of my mind is like, I think I said it maybe last time, but just you access it out. Like 500,000 people in the world, 250,000 maybe are using agentic AI and we're in an acute compute shortage. There's seven or eight billion people on the planet. What happens when we go from 500,000 to 100 million, you know, to 500 million? It is interesting. You know, a lot of people, I do think it's like helpful to post on X to see the pushback. And a lot of people are saying, we accept your argument that hyperscalers are under earning and it's compute reprices. Their operating cashflow is going to accelerate and maybe we could fund this. But like, where's that operating cashflow going to come from? Where is the customer? And kind of definitionally it has to either come from faster economic growth through productivity kind of such as comments like either we going to start growing 10 or we not or labor substitution And for sure I think in a lot of these AI natives, you're seeing labor substitution, but not because they're firing people. They're just not hiring nearly as many humans. The gross profit dollars per FTE and A16Z, Iconic, a bunch companies that have done this work, they're vertical, particularly relative to past generations of startups. And then it is interesting. Are you doing any surveys of your companies and their token spend relative to labor spend? Oh, yeah. I mean, it's tokens as a percent of total comp spend or something like this. What are the ranges you've seen? I mean, like in the really pilled companies, like it gets really high, 20 percent, 25 percent. Our friend Dylan Patel at his company, So he's an ASI maxi, but he's at 30%. That's probably the highest one I've heard. I've actually heard of 50. And there's $25 trillion in knowledge work. Let's take your 20% number. That's $5 trillion. And that either comes out of labor substitution or faster economic growth. And we really really really want as humans to come from faster economic growth One interesting thing I heard this morning from one of the great leading technology CEOs that founded several companies If you look at the founder and controlled companies and adjust for some of the COVID era overhiring nobody really laying people off. These are the people that would probably be most quick to adopt AI to become more efficient or whatever. They're not really doing, jack aside, huge scale layoffs, which probably tells you something about where they think there will be lots of opportunity to still have people plus. 100%. Well, the bull case, you've seen church from cognition, ramp and stripe that the companies that are spending the most on AI are growing meaningfully faster. Yeah. I love that cognition index. The cognition index is wild. All the skeptics will point out rightfully. It's not really controlling for industry, but then if like you dig down into it, I think one of them gave an example of, I forget if it was a plumber or an HVAC contractor, but like everybody who's a blue collar workers doing great because of AI, by the way, something that I think we should touch on, and we can do it now or later, is just everybody is signing these LTAs. So everything's at a shortage. If there's weakness, it's just because we can't energize the gigawatts fast enough. The gigawatts are going to get energized, like regulatory policies moving in a good way The turbine manufacturers the diesel jet manufacturers you ripping turbines off old airplanes and reconditioning them and then repurposing them There crazy things happening Capitalism is very, very good at this. But I do think one of the most important questions of the market and like a transition of the market that I got wrong is we are shifting, particularly for memory more than anything else, from crushing numbers in the short term to their trading short-term upside for these, what they call supply chain agreements, long-term agreements, LTAs. There's many flavors, but customer prepays, there's a floor and a ceiling. And this comes back to the point about labor, because a lot of people after firing too many people during COVID were really reluctant to lay people off. They talked about labor hoarding, if you remember a few years ago. You remember this? Yes. Let's just think about the game theory of breaking an LTA. So there's four companies that matter at scale. There's Amazon with their tradiums. There's Google with their TPUs. There's AMD. And then there's NVIDIA, who's like much bigger than everybody else combined. Let's just say it's 2027. And it's very important to realize as memory is...
[35:00] More memory you put with flop for a given unit of compute, the more tokens you get out. It's the single most important thing you could do to increase token output per unit of compute. And then that obviously, definitionally, actually lowers costs, which is why the demand hasn't responded at all negatively. There's been no elasticity just because it's the access that is dominating all others. and this is at some level like a giant Game of Thrones or IMPERS between these companies. Okay, it's 2027 or 28. You're vaguely tempted to break one of these LTAs and try and get a lower price. But to a large degree, market shares, I think for the next several years, are going to be determined by supply chain allocations and kind of what you have pre-purchased. So if you break the LTA, this is assuming we're not in a severe oversupply situation. The game theory even holds in a severe oversupply situation. If you break your LTA, and then in the next two or three years, for any reason, leverage shifts back to the memory, guys, you out of business It over Let just say Google breaks an LTA There an oversupply I making this up at 28 29 They break their LTAs Well if they breaking their LTAs it probably means your oversupply prices are coming down and then capacity naturally contracts. Well, what do you think is going to happen to Google's allocations? And then this is a cyclical industry and oversupply is followed by undersupply. What do you think they think is going to happen to their allocations next time. So I just think given that this is the axis around which kind of everything is revolving, you might blow up your entire business and your franchise by breaking an LTA. And that was never the case before. Apple, who cares? They don't have a competitor. They're overwhelmingly the largest purchaser. This is going back three, four, five years. They know they can do whatever they want with no consequences because their volume is so big that even if they like super screw Hydex, Micron will of course take them. This is just different. You have at least four players. Did you have all the startups? You're an investor and etched. If you break an LTA, they just say, okay, fine, great. You broke the price agreement. We going to break the volume agreement and screw you We going to give the volume to your competitor You just lost share you know NVIDIA dominance the current environment the extent to which it favors NVIDIA it is a little hard for me to understand why it's trading at such a low multiple. In other words, if you need to be able to finance the chips, and you do, nothing's more financeable than an NVIDIA GPU. Nothing. If you need to get land and power, well, they're doing a very good job of playing that chess game and matchmaking. And then they've rolled out this really clever new business model, which I would describe as kind of like a credit wrapper with a revenue share if GPU prices are above the floor. Yeah, this could lead to them having a really giant cloud business effectively through royalties really quickly. And it is another way of kind of alleviating this cash flow mismatch. Like, hey, we're making all the cash. this isn't really vendor financing because they're not loading them the money somebody else is loading the gpu buyer the money they're still making equity investments but it's not like you're just putting money into someone that some of that money was used to buy your chips even though nvidia said that they write into all their equity investments that the money can be used to buy nvidia chips but obviously money is fungible and um funny thing makes no sense sense Yeah But you know I think at some level it probably makes everybody feel better What would you do if you were the member, like if you were the CEO of Hynix? I'd do the exact same thing NVIDIA is doing right now. Which is? I would be going to the buyers of GPUs, Tradiums, and whoever and say, I'll participate in the NVIDIA credit wrapper. Now, their business is just inherently less stable and predictable. but in some way, and maybe they just put up some cash up front, so it's like they're not on the hook. I'm just making this up. But do something. Because you have money now, and credit markets are revolting. I'm sure our friends at Blackstone and Apollo are suggesting some variant of this to the memory companies. But hey, we will put up some amount of money from our cash flow today, and then it's gone. It's surety that makes the person who's extending the debt feel better. But we want some sort of a cut of the ongoing revenues as well. That is 100% what I would do. And it's almost like a logical extension of the LTAs where they're trading upside for durability. Here,
[40:00] you can effectively get a royalty on recurring revenues. And that is what NVIDIA is doing. And I do think that is very misunderstood. And I think it would serve NVIDIA well to really explain this. One, they're really bullish on AI. Essentially, every time they haven't taken an equity stake in something, it's been a mistake. They've taken equity stake in everything, essentially, except the memory companies that for a long while, Anthropik, that they took an equity stake in Anthropic. But like, why not if you have cash flow and you're bullish on AI and Jensen because he sees every lab, he knows all the advances, you know, like all these continual learning labs, you know, safe super intelligence is now working with them. He sees everything and like what he sees makes him bullish. So what have some equity upside and then to have a revenue share and you're generating hundreds of billions of dollars of free cash flow and helping to kind of bridge what is clearly kind of a gap, at least given everybody's got free cash flow negative, until the operating cash flow accelerates enough that you can internally fund this. It very opportunistic in a good way and it significantly increases their revenue per gigawatt And then it also strengthens their competitive position You and I we both have startups but okay that great Use that startup chip What prices are they paying at Taiwan Semi Higher than NVIDIA and all these guys. What prices are they paying for HBMD RAM? Higher. Can you finance those chips easily at the same rate as NVIDIA? No. And so it's always like there's a real burden, particularly if you use HBMD RAM, you're in the crosshairs of this. Unless like actually they made really different architectural choices. Everything that's happening is actually pretty good for him. By the way, going back to game theory, Anthropic, if they had been as aggressive on compute as OpenAI had been, they would have run away with it. Now OpenAI is back in the game. I think Grok is in the game. those are the companies on the Pareto frontier. And they have the compute. Do you think after watching that, anyone is going to let off the gas? Right. It was, I think, four months ago that Dario was talking about how it was a really thoughtful commentary, but he's like, it's really, really hard because if you buy too much compute, you could go bankrupt at the scale of these things. But if you don buy enough you could lose Well OpenAI just got back into the game and now SpaceX is in the game in a big way with Glock 4 and Cursor After watching that from a game theory perspective, is anybody going to back off anytime soon, especially if it can be funded out of operating cashflow? Have you met anyone in your travels out here that you would say is like way more bullish than you? And if so, what do they believe that you don't? I mean, essentially everyone out here is more bullish than me, man. You know, I read this thing that Dorkesh wrote and I was like – The 3x compute price thing or whatever? Yeah, well, he was – I forget what it was. No, no, it was like 15x or something. Yeah, but just basically that renting an H100 for a year would cost $250,000. And that's 15x the current spot or something. Exactly. Like, wow, you know, that was just like – That wasn't in my book. That wasn't in my – forget my like Bayesian probability space of expected outcomes. that wasn't even in my considered but dismissed his totally unlikely outcomes for cash he's very smart guy he's very plugged in then he pointed out that margins on compute are going up the amount of compute is going up and inference margins going up and if you multiply those three that how you getting this crazy acceleration into some of the labs plus open source although the margins on open source are not really going up I look at what happening in the stock market and I feel like a foolish optimist And then when I talk to people, whether it's people at the labs, anyone in this ecosystem, I'm like bearish relative to essentially everyone. Just a strange state of affairs. What do you make of the DUV news out of China where I've seen reactions really along a spectrum of like, this is the equivalent of like what ASML had in 2001 or something. Or like, no, this is actually the first bit of news in a new story for how we should think about the global supply of cutting edge compute. I think both could be true. Make an analogy. Like, let's just say a DUV machine was a jet turbine. And now an EUV machine is like a warp drive. to UV machines like a propeller plane, UVs like a jet turbine. They didn't have it before, and now they allegedly do. And that is like a phase transition. You've gone from liquid to solid. Now, that solid, that jet engine, prop plane, whatever, is 25 years behind. But still, it's important, and I don't think it should be dismissed, but I also...
[45:00] So, you know, it's kind of funny. You just see this in the stock market. The stock market massively overreacts. And then if this ever hits ASML's orders, maybe it hits it in five years. And like the market has forgotten about it, got worried about it, forgotten about it, got worried about it, forgotten about it multiple times along the way. So I do think that was probably an overreaction, but we shouldn't dismiss that either. And if you're China, like this is really important to you. You know, there are some reports that like an EV machine had been smuggled into China. I mean, what a feat of espionage because those things are like huge. I don't know if that's true. You know, there's some noise about it. But, you know, China, they're really, really good. They're really, really smart. They work really hard. They see this as super important for them as a country. But are they going to go from the year 2001 to 2026 or even 2030? It's a learning by doing. And you can't accelerate the doing. You can't teleport into the future. You actually have to go through those learning cycles. Is it significant? Yes Did the market overreact Probably It very hard as an American to really understand what is happening in China and have total conviction and clarity For better or worse we are decoupling. That is a process that has been set in motion. And at this point, it almost feels like self-reinforcing on each side. That's unfortunate. We are where we are. They're not going to stop. Neither are we. Any commentary on like every other company in America? Like I feel like right now it is 10 companies, couple private. Not last month. Everything but AI was vertical. And I do think open source getting closer to the frontier and companies like Fireworks making it really easy to customize a model such that you can get, in some cases, better than Frontier Performance for a meaningfully lower cost. That is a godsend for the software industry. And it's also a godsend for all these AI natives. You know, it's like our friend Vishria, I think he said two years ago, I've never seen more companies go from being founded to like $50 million a year in revenue and generating cash flow in like whatever it is, nine months. And it's hard to know if any of them are durable because a lot of people would dismiss them as chat GPT wrappers Well now with open source you generated some data that unique to your use case whatever your vertical you're going after as a wrapper is. Fireworks did come out with a really cool product called Nexus. And if you're using Cloud Code, OpenAI Codex, GrokBuild, it is literally three lines of code, like 20 words. And Fireworks ingests your data. They can RL a model, and then there's a router that sends the query, and they've had amazing results. And this is kind of the solution for every AI native. That's why you saw Harvey before it was acquired, Cursor, lean so heavily into this. Harvey, Lagora, all of them. Because if you can go from just using one, two or three frontier models to using those frontier models for whatever it is, 30 to 60 percent of your token consumption and then use your own RL model, all of a sudden you're not a rapper. You're way more defensible. I was so interested by that cursor thing that came out. I think it was cursor where it's sort of like AI is speed running, like what we learned amongst humans which is you could use the frontier model to plan and then farm out tasks to the dumber models and it 15 times more efficient or whatever the metric was And it may be and this is like super ironic lower margin open source tokens that are just a little bit behind the frontier. We have friends who believe that once a frontier model hits RSI, it will actually have a dramatically lower cost to serve at every level of intelligence by kind of distilling this. And then there's no place for open source. And I would say that's like a anthropic, open AI, Grok, maximalist view. We shouldn't dismiss anything. Anything is possible. We want to be very humble. I particularly want to be humble after the month I've had. But that doesn't seem that likely to be. One, because there are so many of these AI natives that have actually generated a decent amount of domain-specific proprietary data. And before open source had this moment and these inference clouds and these routers really developed, you kind of didn't have a choice. Like whatever the terms of service were, you accepted them. But if you can now get off that treadmill, that gives you a degree of
[50:00] independence, maybe durability, safety. But going back to your point, it may be that these cheaper tokens massively inflate the value of the most cutting edge frontier tokens. Because if today, if you have, I'm going to make this up, 120 IQ open source models, and they're really cheap to run, doesn't that make a 160 IQ model that can orchestrate them more valuable? We talked last time about how I've been really surprised that so much of the economic returns have accrued to the frontier. That is changing with what we're seeing with these inference clouds, Together, modal, base 10, they're all working in a very cash efficient way. What's shocking about those business models is they're growing almost as fast as the frontier labs in the early days, but burning very little cash. It's pretty extraordinary to go back to silly SaaS metrics like the rule of 40 perspective, these are crazy numbers. Do you think there's a lot of instruction in just the distribution of pay inside of an organization? Like the CEO makes X times more than the median person at a company and maybe that frontier tokens versus open source tokens Yeah Something simple Yeah it may be that what we discussed last time where you know frontier tokens like the pie is growing really, really fast. They may continue to capture the overwhelming majority of economic value, but not all of it the way they have been. And open source tokens might be the majority of tokens processed. Again, going back, that's great for infrastructure demand because a token is a token. And it takes the same amount of flops, watts, space, cooling to make. What's the worst thing that could happen in AI? Is it regulatory? I think regulatory has to be the biggest risk. It's the most obvious risk. And so that was kind of one reason I was excited to be here this week. I want to be scared. You know, I like I don't want to feel like a lunatic watching these stocks get cheaper, thinking the expected forward returns are going up. While it feels like the on-the-ground fundamentals have pretty materially improved in July relative to even June, but I still come away thinking like regulation, it just has to be the biggest risk. Like you just can ignore New York making a data center moratorium We living in this weird post post political world And I mean I think the AI industry it has done a terrible job of PR And I do think I think it at least realizes that now. Maybe if not fixed it, it realizes it. Yeah. But like the political narrative, I think amongst a lot of ordinary Americans is like data centers, they're going to raise your electricity prices. They're going to take all your water, And then they're going to take your job. The reality is, given the deals that are being cut now, when a data center goes in, electricity prices actually generally go down for everyone around there because of behind the meter deals. This is that data center pledge that Trump asked people to sign. Generally, the data center developer used to be they just had to get the police department or the fire departments new trucks and new cars and new body armor or whatever. Now it's like, we're going to build you a hospital, a school, a new police station, and a fire station, and we're going to lower your power bills. How does that sound? And by the way, the jobs are ongoing because it turns out that you kind of need these plumbers, electricians, HVAC contractors, data centers are in a lot of ways the best thing to happen for blue wages in my lifetime And yet you have the Democrats who ostensibly represent the blue collar workers taking those jobs away It just kind of wild how what is the phrase Like a lie could go around the world. Faster than truth gets out of bed. Yeah. Yeah. Faster than truth gets out of bed. But an author made a mistake in a book. It overestimated the amount of water usage in data centers by 10,000 X. Not a little bit, like not one order of magnitude, not two orders of magnitude, not three she's admitted that mistake many times i was completely wrong it's like been super debunked like the popeye effect you ever hear that example no you know popeye spinach the reason was same deal in an academic book they placed the decimal two things wrong so spinach does not have more iron than everything else it was just this one source and then that propagated people still say it has more iron i literally had i thought it had more iron i mean that's like 80 years ago that's wild I literally thought spinach had more iron. That's amazing. It'd be crazy. Yeah, you learn something new every day. Yeah, same thing though. Yeah, it's the same thing. And it's just, so somebody just needs to tell the truth. I feel like the industry, geez, maybe if nobody else is going to do it, like I'll do it. There needs to be some sort of foundation. Maybe it's a pack that runs ads during the final four, during NFL games, during college football games.
[55:00] games. Here's the virtues. World Series. Here's what a data center does. Your power, a data center that signed this pledge in your community, your power prices are going to go down. They're almost certainly going to contribute to the community in a material way. You're going to see a massive influx of super high playing blue collar jobs that are going to persist. And I think a lot of people thought that they were one time and they're just not like there's for sure a spike. And then that moves to the next data center. But there is an ongoing need for RMA and then upgrades at these data centers and technology is changing. So you're going to have more jobs. You're going to have cheaper power. You're going to have a wealthier community. There's going to be no impact on water, no impact on the environment. But it's easy to build the data center 10 miles out of town. You know, that story needs to be told along with we heard a story, I think we talked about it last time, about how AI is increasingly really saving lives, curing rare diseases. I think it was at ASCO this year. The vibe was like, this is the most scientific breakthroughs we've ever seen at a single conference. And for sure, some of that is due to AI. And so we need to tell those stories Like you know if you have a sick child sick parent a sick loved one like AI meaningfully increases the odds of them recovering Everybody needs to tell this. And I think people out here, all of this is so blindingly obvious to them. They can't process that this is a true but wildly divergent view from most Americans. The industry really needs to tell its story better. New York, it just feels like is the first of many. And even in some of these deep red states, they're super pro-growth. They're just like, hey, you guys are not doing a good job telling your story. We can't tell your story. If you tell your story, though, we can retell it. But like, you're the experts. If you do not speak your own truth, no one else will. What have we missed? I do think something that is missing from all of this conversation about compute is what is going to happen when you put these sram based accelerators that are not constrained by hbmd ram that are often made on older nodes that are not competing with like the latest greatest gpus when you disaggregate inference people talk about pre-fill and decode but decode is two parts attention and feed forward network and like the ultimate holy grail is if you could do pre on one chip that probably doesn have HBM DRAM do the attention on a super high powered chip with HBM DRAM and then do the feed forward network on one of these SRAM chips But like the ROI on adding these SRAM accelerators to the existing installed base of compute and new compute. But like what we're seeing is you do better. You just can't beat SRAM in particular for that feed forward network. And no matter how much you try and get the ratio of compute to HBM DRAM to SRAM on the chip correct, the workloads are always changing and there's different workloads. being able to disaggregate into these three parts, this is going to be really, really positive for the ROI on AI. For some reason, I just thought of a funny question, which I love their framing of Game of Thrones versus all these people. Can you imagine a player that is not currently on everyone's mind becoming relevant at like the major Game of Thrones scale? Like that could be like Micron all of a sudden, someone that becomes as important as Anthropic, OpenAI, Microsoft, Amazon. So like a dark horse. Like Leap Boo is probably a dark horse lit at fireworks She is an absolute killer I think our friend Scott Wu cognition is kind of You here to that one Yes. I think those are the most obvious names. What about SpaceX? What's it been like watching that be digested by public markets, at least initially? Do you think the market understands it as a company, the most important new company to be public? It doesn't really feel like it does. The fundamentals have gotten better since an IPO, like ROK 4.5, the Cursor acquisition. Cursor has clearly accelerated meaningfully. They've shown over the last three years they can bring on more compute faster than anyone at lower prices. And now we know that they can, even adjusting for the spot first contract gap, their big advantage was they came into the market, hit those spot highs. And in a strange way, like one of the more bullish things for compute is they put a vast amount of compute into the market overnight. And it wasn't even really a blip. It was like the market just utterly absorbed it. The freight trade didn't slow down at all. A sub stack writer will fund to AI. They think that SpaceX is going to try and bring on eight gig
[60:00] of compute over the next 18 months. So eight gigawatts over the next 18 months. I will never bet against Elon, but I mean, that would be a truly incredible feat. Rates have gone up since they signed those last contracts, not down. And they're monetizing at something like 50 billion a gig. And consensus estimates for next year are 73 billion. So forget Starlink V3, forget Starlink Direct to sell. Grok, 4.5 and cursor. I think that the sum of that probably hits a $10 billion ARR pretty quickly. Forget all of that. Forget the core base Starlink business. If they bring out anywhere near that, the consensus estimate is 73 billion, and that's eight gigs at 50 billion a gig. And obviously, that would not all be lit up at the beginning of 27. And it seems very implausible to me. like I almost don't believe the funder report. But to this day, the only companies that have brought on more than 500 megawatts of power in a year are the hyperscalers, CoreWeave, Crusoe, and SpaceX And SpaceX has kind of brought on the most the fastest at the lowest cost And then people do actually really like their clusters But again it kind of like the market is going to need to see that That would not be the market's interpretation of SpaceX today. No, no. And it does feel like, you know, there's this big New York hedge fund short case on it. And I think they think the spot price for compute is going to go down 90%. You're going to bring on all this compute. It's not going to generate, you know, nearly as much revenue as you think. Maybe, but I also want to be really clear. Like I've seen Elon's companies do really impressive things. The funder AI report of 8 gigawatts in 18 months. I mean, I'm just quoting that because it's public. It's available to everyone. I think one of Elon's phrases is we specialize in making the impossible late. I've never heard that. That's great. You know, there's kind of a lot of truth to that. Yeah, yeah. but I just think very little is built in from my perspective to that stock for the amount of compute that they might be able to bring on. And again, I don't think it's anywhere near eight, and it's going to be really hard. And energizing these GPUs is really hard, but they been good at it And it doesn feel like that in estimates or really in people thinking I thinking about that funny meme that says SpaceX the data center company Oh 100 Yes absolutely And then I would also just say like I did spend a lot of time at Starbase and orbital compute feels more real every day. Pretty cool to see that Starship landing the other day. Pretty cool to see the Starship landing and that it's, you know, it is funny. Our friends at Benchmark, they funded StarCloud. And I don't know, last time StarCloud is an orbital compute company that like SpaceX is kind of partnering with. They're going to, I think, let them use the Starlink laser technology, which is really important for orbital compute. But I do think that's like kind of a good sanity check. Last time I checked, the benchmark guys were pretty smart and they're not coming from the Elon ecosystem at all. And they chose to fund an orbital compute company, a decent valuation without the internal launch costs that SpaceX gets. To me, that's a good like, hey, am I crazy? And it's like, well, maybe I'm crazy and maybe Elon's crazy. And maybe Benchmark is also crazy. And maybe the SpaceX engineers are also crazy that, man, that just doesn seem that probable to me Should we say whose offices we in Yeah we sitting in the Benchmark office Yes this is their famous table for their famous dinners So thank you Benchmark Thank you Benchmark for this episode Yes, thanks, Eric. And Sheila, we should thank them all. Eric coordinated for me, so he gets a special shout out. Thank you, Eric. Thank you, all the partners. Thank you, Eric. But I mean, we will see where all of these stocks are in a year. And the great thing is, time will tell. People are going to be right or wrong. The future is probabilistic, but it's an exciting moment. Well, if we keep doing this on the model release cycle, I'll see you in a couple of weeks. Yeah, it's crazy. You're going to benchmark. It's always a blast to do with you. If you enjoyed this episode, visit Colossus.com. You'll find every episode of this podcast complete with hand edited transcripts. You can also subscribe to Colossus, our quarterly print, digital, and private audio publication featuring in-depth profiles of the founders, investors, and companies that we admire most. Learn more at Colossus.com slash subscribe. Thank you.
[65:00] pound over time. That's true in investing and just as true in how you run your company. Your spending system is your capital allocation strategy. Ramp makes it smarter by default. Better data, better decisions, better economics over time. See how at ramp.com slash invest. As your business grows, Vanta scales with you, automating compliance and giving you a single source of truth for security and risk. Learn more at vanta.com slash invest. The best AI and software companies from OpenAI to Cursor to Perplexity use WorkOS to become enterprise ready overnight, not in months. Visit WorkOS.com to skip the unglamorous infrastructure work and focus on your product. Ridgeline is redefining asset management technology as a true partner, not just a software vendor. They've helped firms 5x in scale, enabling faster growth, smarter operations, and a competitive edge. Visit RidgelineApps.com to see what they can unlock for your firm. Every investment firm is unique and generic AI doesn't understand your process. Rogo does. It's an AI platform built specifically for Wall Street, connected to your data, understanding your process and producing real outputs. Check them out at rogo.ai slash invest.