## Background
This episode was published by TBPN on YouTube on June 30, 2026. According to the page description, Diet TBPN delivers the best of today’s TBPN episode in 30 minutes, bringing highlights from its daily live tech talk show hosted by John Coogan and Jordi Hays.
## TL;DR
The hosts analyze GLM-5.2's impact on the global AI race and discuss how Chinese open-weight models are challenging American closed-source dominance, drawing on perspectives from George Hotz and John Luttig. The discussion explores technical topics like distillation and token economics before transitioning to Meta's Gemini usage caps, internal safety policies, and non-invasive brain-decoding research. They also recount Yahoo's famous failed 2006 acquisition of Facebook, examine how rising memory chip costs are squeezing AI profit margins, and cover Chamath Palihapitiya’s $135 million Series A for 890.
## Atmosphere & style
The show carries a fast-paced, conversational, and banter-filled energy characteristic of daily tech commentators. The hosts blend analytical deep dives on model benchmarks and macroeconomic hardware shifts with playful humor, lighthearted startup jokes, and casual Silicon Valley storytelling. It feels like an insider, high-energy discussion that balances serious technical insights with lighthearted camaraderie.
## Key takeaways
- [00:02](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=2s) Chinese startup Zhipu AI released GLM-5.2, an open-weight model that matches top US models like Anthropic's Claude Opus 4.8 in identifying software vulnerabilities.
- [04:20](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=260s) Evaluations of AI models are shifting from measuring 'cost per token' to 'cost per task,' as token-hungry models may require massive test-time compute for complex reasoning.
- [07:38](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=458s) George Hotz posits that China strategically funds open-source AI as a deflationary weapon to reduce the value of the US high-margin service economy.
- [10:33](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=633s) Leading cybersecurity firms use advanced closed-source frontier models like GPT-5.5 Cyber and Mythos to pre-emptively patch vulnerabilities before open-weight models can be exploited.
- [12:27](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=747s) Heavy model distillation enhances specific coding and benchmark scores, but often degrades a model's ability to generalize in open-ended creative tasks.
- [15:33](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=933s) The AI market is splitting between expensive frontier models used for high-risk tasks and cheap, open-source models deployed for high-volume automated point solutions.
- [19:04](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=1144s) Google constrained Meta's usage of Gemini AI models due to cloud compute infrastructure bottlenecks, delaying several internal Meta initiatives.
- [19:04](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=1144s) Meta issued internal restrictions against using competitor models like Claude and Codex to avoid unintended distillation into its own model pipeline.
- [19:04](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=1144s) Meta published research in Nature detailing 'Brain-to-QWERTY V2,' which advances non-invasive neural decoding from basic characters to full semantic text.
- [23:50](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=1430s) In 2006, Mark Zuckerberg walked away from a $1 billion acquisition offer from Yahoo after CEO Terry Semel tried to reduce the price to $800 million following a drop in Yahoo's stock.
- [26:31](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=1591s) Soaring memory prices (HBM and DRAM) are allowing hardware vendors like Micron, Samsung, and SK Hynix to capture a massive share of profits from AI model developers.
- [26:31](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=1591s) Comcast announced a corporate restructuring to split its NBCUniversal and Sky entertainment units from its core telecommunications infrastructure.
- [31:19](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=1879s) Chamath Palihapitiya raised $135 million in Series A funding for 890, bringing together a syndicate that includes his fellow All-In Podcast co-hosts.
## Detailed walkthrough
### [00:02](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=2s) Front Page Wall Street Journal: China Resets the AI Race
The episode opens with the hosts discussing how artificial intelligence topics have escalated from the business pages to the very front page of *The Wall Street Journal*. The lead story focuses on GLM-5.2, an open-weight model released on June 13 by Chinese startup Zhipu AI (also known as Z.ai). While it took a couple of weeks to break into mainstream headlines, security researchers at Semgrep report that GLM-5.2 matches top American models—such as Anthropic’s Claude Opus 4.8—in finding software vulnerabilities. Prior to this release, a narrative was taking hold in American tech circles that open-source AI was stalling out compared to closed-source frontier labs, bolstered by the massive capital expenditure, data center capacity, and research talent concentrating in the US.
Unlike proprietary models from OpenAI or Anthropic, GLM-5.2 is open weight, meaning anyone with sufficient compute and electricity can download, host, and modify it without oversight or API paywalls. The hosts joke about naming a new startup "Unfettered Intelligence," referencing the unconstrained nature of running such models locally. Data from OpenRouter, which offers access to over 400 AI models, ranks GLM-5.2 among its top 10 most used models. When given specialized instructions, researchers found that Opus 4.8 and GLM-5.2 could even match Mythos in bug-finding performance.
- **Key Model Releases Mentioned:** Zhipu AI's GLM-5.2, Anthropic's Claude Opus 4.8, and Mythos.
- **Platform Highlight:** OpenRouter (led by Alex Atallah) serves as a front-door aggregation platform for over 400 models.
- "Unfettered intelligence."
---
[04:20](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=260s) Benchmarks, Elo Trends, and Token Economics
To visualize the global AI competition, the hosts bring up an Elo progress chart created by CASI (Center for AI Standards and Innovation). The chart plots linear baseline trends across various frontier releases—from GPT-4o and o1 to o3-mini, o3-Opus, Claude Opus 4.6, and GPT-5 iterations—alongside a lower, secondary trendline for Chinese models. The hosts debate whether Chinese models are destined to plateau or if releases like GLM-5.2 prove open source can keep pace.
The conversation shifts to the economics of AI evaluation, noting that the industry needs to move beyond evaluating "cost per token" and instead focus on "cost per task." While GLM-5.2 is reportedly token-hungry, its low cost per token might still translate into a higher overall cost for complex reasoning tasks if it requires massive test-time compute or millions of tokens to solve a problem.
- **Chart Creator:** Center for AI Standards and Innovation (CASI).
- **Benchmarking Insight:** Epoch AI studies indicate a relatively stable capability gap between closed-source and open-source models extending back to 2023.
- "GLM-5.2 sounds too much like a gray market peptide you're taking."
---
[07:38](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=458s) Open Source vs. Closed Source: The Strategic Playbook
The show revisits a May 2024 essay by John Luttig, who argued that the future of foundation models is fundamentally closed source. Luttig predicted that exponential capital expenditure requirements and proprietary data flywheels would starve open-source providers of ROI, leaving open source confined to smaller, task-specific enterprise applications. At the time, Meta's Llama series represented the primary counterargument, serving as a talent magnet and a play to commoditize complements.
However, the rapid rise of Chinese models starting with DeepSeek at the beginning of 2025 altered the geopolitical game theory. The hosts cite a recent post by George Hotz, who argued that China intentionally funds and distributes open-source AI as a deflationary weapon against the US economy. Because the US relies heavily on a high-margin service sector, flooding the market with free intelligence tools deflates service values and undermines American monopolies. Hotz characterized Washington's regulatory attempts to contain open source as "rearranging deck chairs on the Titanic."
- **John Luttig's Thesis (2024):** Open source acts as marketing and complement commoditization, but will ultimately lose the capex spending war to frontier labs.
- **George Hotz's Thesis (2026):** Open-source AI acts as a deflationary force targeting the US service economy, giving China a strategic incentive to release models for free.
---
[10:33](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=633s) National Security Risks and the White-Hat Defense Gap
A 2023 congressional testimony clip featuring Anthropic CEO Dario Amodei has resurfaced online. In the video, Amodei warned that within two to three years (pointing directly to 2025–2026), open-sourcing advanced models would expose critical national security vulnerabilities, particularly in biosecurity and cyber warfare.
While those timeline predictions are now playing out, the hosts note that cybersecurity leaders at companies like CrowdStrike and Palo Alto Networks have already been leveraging advanced frontier models—such as Mythos and GPT-5.5 Cyber—for months to harden digital infrastructure. This capability gap between leading closed-source defense tools and open-weight attacker models gives "white-hat" defenders a crucial head start to patch vulnerabilities before "black-hat" malicious actors can exploit them at scale.
- **Cybersecurity Defense:** Major firms use frontier models like GPT-5.5 Cyber and Mythos to pre-emptively patch vulnerabilities before open-weight models expose them.
- **Core Security Concern:** The lag time between open-source feature parity and defensive hardening remains the critical safety buffer for Washington policymakers.
---
[12:27](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=747s) Developer Hands-On: Distillation, Synthetic Data, and Benchmarks
Tyler shares his technical breakdown and hands-on reviews of GLM-5.2. A primary criticism leveled against top Chinese models is that their impressive performance stems from "distillation"—training on outputs generated by leading American models like Claude or GPT. Anthropic has previously accused Chinese labs like Alibaba of distilling their model outputs. Furthermore, a professionalized gray market has emerged where intermediaries bundle API access, enterprise subscriptions, and VPNs to harvest training data at scale.
However, the line for distillation has blurred. As a massive portion of public GitHub repositories, open-source codebases, and digital books are now generated by LLMs, any model trained on public web data inherently ingests synthetic LLM patterns (such as distinct stylistic choices like "it's not X, it's Y"). While distilled models frequently score exceptionally high on public benchmarks, developers report that they often fail to generalize as effectively in open-ended creative tasks, lacking the subtle "je ne sais quoi" of massive base-trained models, even if their coding performance remains top-tier.
- **Technical Nuance:** Heavy distillation improves specific benchmark and coding scores but degrades broad task generalization.
- **Market Phenomena:** Gray-market syndicates actively route traffic through VPNs and aggregated accounts to harvest frontier API outputs for model training.
[15:33](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=933s) Open Source Models, Token Hunger, and Government Restrictions
The hosts dive into the economics and practical market dynamics of AI models, focusing on how companies deploy open-source versus proprietary frontier models. One host highlights a sharp divergence in the market: on one end are expensive frontier models reserved for high-stakes tasks like coding agents or cybersecurity—where the risk of a breach is so catastrophic that organizations pay whatever it takes. On the other end are small, fast, and cheap open-source models (such as DeepSeek Flash) used for high-volume point solutions and sub-agent orchestration. A practical example is highlighted through Ramp, where every single uploaded receipt is processed by an LLM; doing standard OCR on a $10 coffee receipt obviously does not require an ultra-expensive frontier model.
```
┌─────────────────────────────────────────────────────────┐
│ AI MODEL MARKET SEGMENTS │
└────────────────────────────┬────────────────────────────┘
│
┌────────────────────────┴────────────────────────┐
▼ ▼
┌───────────────────────┐ ┌───────────────────────┐
│ FRONTIER MODELS │ │ SMALL / FAST MODELS │
│ (Expensive, High IQ) │ │ (Cheap, High Token) │
├───────────────────────┤ ├───────────────────────┤
│ • Coding agents │ │ • Sub-agent workflows │
│ • Cybersecurity │ │ • High-volume OCR │
│ • High-stakes risk │ │ • Point solutions │
└───────────────────────┘ └───────────────────────┘
```
The discussion turns to the geopolitical and regulatory hurdles looming over the sector. Government intervention—such as enforcing Know Your Customer (KYC) requirements or requiring special approvals for access to top-tier models—creates friction for tech companies. However, open-source developments threaten to render these regulatory delays irrelevant. If a company faces a three-month government review before getting approval for a model like "GPT-7," they may simply pivot to an accessible open-source model like GLM-6 that is "close enough" by the time the government responds.
* Open Router usage data reveals that small open-source models account for the highest token volume, driven by repeated, task-specific automation.
* High marginal costs for extra model intelligence ("IQ points") are causing companies to re-evaluate their balance sheets and cut back on token maxing.
* Open-source models can easily be fine-tuned to bypass restrictive baked-in behaviors or alignment constraints.
---
[19:04](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=1144s) Google Caps Meta’s Gemini Usage and Distillation Fears
The hosts review a report from the *Financial Times* revealing that Google placed limits on Meta's consumption of its Gemini AI models around March. Despite spending hundreds of billions on capital expenditures, Google Cloud faced compute infrastructure constraints and was unable to fulfill Meta’s massive appetite for capacity, causing delays in Meta's internal AI projects. The hosts analyze whether distillation—using a competitor's model outputs to train one's own models—played a role in Google's decision or in Meta's own operational policies.
> "If you thought Instagram was listening to your conversations, now you can have a new conspiracy at home, which is that they might be just listening to your thoughts."
Simultaneously, *The Information* reported that Meta issued internal directives instructing its employees to restrict the use of rival models like Anthropic's Claude and OpenAI's Codex in certain parts of the business to prevent accidental distillation into Meta's models. Switching topics to Meta's research breakthroughs, the hosts discuss Meta's publication in *Nature* regarding its "Brain-to-QWERTY V2" project—a non-invasive brain-decoding pipeline capable of converting raw brain signals into real-time text and semantics. Looking at an image of the massive magnetoencephalography rig required for the tech, the hosts joke about "daily driving" a room-sized device.
* Google informed Meta around March that it could not supply the requested Gemini capacity due to widespread compute bottlenecks.
* Meta’s internal restriction on Claude and Codex stems from fears of unintended model distillation.
* Meta's Brain-to-QWERTY V2 advances non-invasive neural decoding from basic character-level output to full semantic sentence decoding.
* Tech commentator Rob Tercek recently issued five bold industry predictions in *Forbes*, including a forecast that telepathy will be commonplace by 2030.
---
[23:50](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=1430s) The $1 Billion Regret: How Yahoo Lost Facebook
The conversation shifts to Silicon Valley history, examining a classic M&A blunder detailed by *Wired*: Terry Semel's failed attempt to acquire Facebook for Yahoo in 2006. At just 18 months into building Facebook, an 22-year-old Mark Zuckerberg verbally agreed to sell the company to Yahoo for $1 billion in cash. However, immediately following the agreement, Yahoo posted disappointing financial results and delayed its new ad platform, causing its stock to plummet 22% overnight.
```
┌────────────────────────────────────────────────────────────────────────┐
│ THE 2006 YAHOO-FACEBOOK DEAL │
├────────────────────────────────────────────────────────────────────────┤
│ 1. July 2006: Mark Zuckerberg verbally agrees to $1B cash sale. │
│ 2. Yahoo stock drops 22% after poor sales reports & ad platform delay. │
│ 3. Yahoo CEO Terry Semel slashes offer by 20% down to $800M. │
│ 4. Zuckerberg walks away from the renegotiated terms. │
│ 5. Semel reinstates $1B offer 2 months later; Zuckerberg rejects it. │
└────────────────────────────────────────────────────────────────────────┘
```
In response to the stock crash, Yahoo CEO Terry Semel lowered his offer by 20%, cutting the price down to $800 million. Warned about Semel's tendency for last-minute price cuts, Zuckerberg walked away. Although Semel tried to reinstate the original $1 billion offer two months later, Zuckerberg convinced his board that Yahoo was not a serious partner and that Facebook was worth far more on its own, forever cementing his reputation as the young founder who turned down a billion dollars.
* Mark Zuckerberg was roughly 18 months into building Facebook when the original $1 billion acquisition deal was struck in July 2006.
* Terry Semel's 20% price cut to $800 million was the pivotal trigger that caused Zuckerberg to pull out of the deal.
* The hosts speculate whether Facebook under Yahoo would have ever had the conviction or capital to execute legendary defensive acquisitions like Instagram and WhatsApp.
---
[26:31](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=1591s) Memory Chips Eat AI Profits and Comcast Restructures
Turning to macroeconomics and hardware supply chains, the hosts break down a front-page business report detailing how memory chip manufacturers are capturing immense profits at the expense of AI model developers. Companies like Micron Technology, Samsung Electronics, and SK Hynix act as the "oil producers" of the AI boom. High Bandwidth Memory (HBM) and DRAM capacity are severely constrained, allowing chipmakers to drastically raise prices. Over the quarter ending May 28, Micron raised DRAM prices by over 60% while shipments only grew by single digits, and NAND flash prices jumped over 80%.
> "We are witnessing an extraordinary transfer of cash from the providers of AI, and perhaps one day AI users, to memory chip makers."
This memory squeeze is spilling over into consumer electronics. Apple recently raised MacBook prices by over 15%, and one host noted that standard RAM purchased on Amazon for a custom PC build tripled in price over a single year, now costing more than the CPU itself. Because AI laboratories are prioritizing market share over profitability and burning cash to solve supply problems, these higher input costs threaten to widen operational losses across the entire AI ecosystem. Finally, the hosts touch on Comcast's announcement that it will split its media and connectivity businesses, separating NBCUniversal and Sky's film, theme park, and streaming units from its core telecom infrastructure.
* Micron's revenue surge propelled the memory maker into the exclusive $1 trillion market cap club.
* Consumer memory costs tripled over a 12-month period, upending the historical trend of annual memory price declines.
* Sports betting volume recently surpassed total consumer spending across movie theaters, theme parks, and several other live entertainment categories combined.
* Thrive Capital is making moves in real-world assets (IRL experiences), including acquiring a stake in the San Francisco Giants baseball franchise.
[31:19](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=1879s) Chamath’s $135M Series A for 890 and the Besties Union
The conversation wraps up with a look at venture funding and investor participation, noting that while transaction or search volume isn't an exact proxy for revenue, it remains a highly meaningful metric for growth. The big news of the segment is Chamath Palihapitiya raising a massive $135 million Series A round for 890. The co-hosts point out the impressive syndicate assembled for the deal, which includes major players like Salesforce Ventures, Craft Ventures, Launch, and David Friedberg's investment firm, The Production Board.
The hosts react with classic banter, realizing that the round effectively reunited the "Besties" from the *All-In Podcast* behind a single startup. They joke about making sure Friedberg was included alongside Craft (Jason Calacanis/David Sacks) and Launch, concluding that "you actually have all three of the other besties" on board for the venture. With the investment roundup complete, the hosts wrap up the show, signing off with a quick "we will see you tomorrow. Goodbye."
- **Funding Amount:** $135 million Series A round raised by Chamath Palihapitiya for 890.
- **Participating Investors:** Salesforce Ventures, WonderCo, Craft Ventures, Launch, and The Production Board.
- **Key Highlight:** The investment round brings together all of Chamath's co-hosts from the *All-In Podcast* (the "Besties").
> [04:20](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=260s) GLM-5.2 sounds too much like a gray market peptide you're taking.
> [19:04](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=1144s) If you thought Instagram was listening to your conversations, now you can have a new conspiracy at home, which is that they might be just listening to your thoughts.
> [26:31](https://www.youtube.com/watch?v=jgJYskq-1Yo&t=1591s) We are witnessing an extraordinary transfer of cash from the providers of AI, and perhaps one day AI users, to memory chip makers.
## Mentioned
John Coogan, Jordi Hays, Ramp, Public, Cisco, Console, CrowdStrike, Figma, MongoDB, NYSE, Railway, Shopify, The Wall Street Journal, GLM-5.2, Zhipu AI, Z.ai, Semgrep, Claude Opus 4.8, OpenAI, Anthropic, Unfettered Intelligence, OpenRouter, Alex Atallah, Mythos, CASI, Center for AI Standards and Innovation, GPT-4o, o1, o3-mini, o3-Opus, Claude Opus 4.6, GPT-5, Epoch AI, John Luttig, Meta, Llama, DeepSeek, George Hotz, Dario Amodei, Palo Alto Networks, GPT-5.5 Cyber, Tyler, Alibaba, GitHub, DeepSeek Flash, GPT-7, GLM-6, Financial Times, Google, Google Cloud, Gemini, The Information, Codex, Nature, Brain-to-QWERTY V2, Rob Tercek, Forbes, Wired, Terry Semel, Facebook, Yahoo, Mark Zuckerberg, Instagram, WhatsApp, Micron Technology, Samsung Electronics, SK Hynix, Apple, MacBook, Amazon, Comcast, NBCUniversal, Sky, Thrive Capital, San Francisco Giants, Chamath Palihapitiya, 890, Salesforce Ventures, Craft Ventures, Launch, David Friedberg, The Production Board, All-In Podcast, WonderCo, Jason Calacanis, David Sacks
中国GLM-5.2模型比肩美国AI安全与防御能力
中国开源模型作为通缩力量削弱高利润服务业垄断,对美国AI市场的主导地位构成威胁。
主持人结合George Hotz和John Luttig的观点,分析了GLM-5.2对全球AI竞赛的影响,并探讨了中国开放权重模型如何挑战美国闭源模型的主导地位。讨论涉及模型蒸馏与Token经济学等技术议题,随后转向Meta的Gemini使用上限、内部安全政策以及非侵入性大脑解码研究。此外,他们还回顾了2006年雅虎收购Facebook失败的著名案例,审视了内存芯片成本上涨对AI利润空间的挤压,并报道了Chamath Palihapitiya为890筹集1.35亿美元A轮融资的消息。
中国初创公司智谱AI发布开源权重模型 GLM-5.2,在识别软件漏洞方面的表现已能匹敌 Anthropic 的 Claude Opus 4.8 等美国顶尖闭源模型。 (0:02)
AI 模型的评估重心正从“每 Token 成本”转向“每任务成本”,市场也加速分化为高成本的前沿模型与廉价高效的开源小模型两大阵营。 (4:20)
因云算力基础设施出现瓶颈,Google 限制了 Meta 对 Gemini 模型的调用量;同时 Meta 内部也限制员工使用 Claude 和 Codex,以防发生意料之外的底层模型蒸馏。 (19:04)
高带宽内存(HBM)及 DRAM 产能严重紧缺推高芯片价格,Micron 等存储厂商大幅提价攫取巨额收益,正进一步挤压 AI 产业整体利润并波及消费电子市场。 (26:31)
Reading summary
TBPN explores how the rise of competitive open-weight models from China is challenging assumptions about proprietary AI dominance, while physical compute bottlenecks and skyrocketing memory chip prices transfer industry profits upstream.
Open-Weight Models Challenge American Frontier Labs (0:02)
Zhipu AI's release of the open-weight GLM-5.2 model has challenged previous industry assumptions that open-source artificial intelligence would lag behind well-capitalized closed-source laboratories. Security researchers at Semgrep reported that GLM-5.2 matches Anthropic's Claude Opus 4.8 in identifying software vulnerabilities, placing it among the top ten most utilized models on OpenRouter. The emergence of capable open models has reignited debate over open versus closed development paths. In 2024, John Luttig argued that exponential capital expenditure would starve open-source providers of returns, while George Hotz has more recently claimed that China utilizes open-source AI as a deflationary lever targeting the high-margin United States service economy.
Model Distillation, Task Economics, and Security Buffers (4:20)
The economic evaluation of AI is shifting from cost-per-token toward cost-per-task, as token-hungry open models can incur higher overall costs on complex reasoning. Simultaneously, developers observe a bifurcation: expensive proprietary models are reserved for high-stakes cybersecurity and coding agents, while smaller open-source models handle high-volume automation such as receipt OCR. Technical questions also persist around distillation, as Chinese models frequently train on outputs from American systems like Claude and GPT. While distillation lifts benchmark scores, developers note it can reduce generalization on open-ended tasks. On national security, although Dario Amodei warned in 2023 of catastrophic biosecurity and cyber risks from open weights within two to three years, defense firms like CrowdStrike and Palo Alto Networks currently rely on frontier systems like Mythos and GPT-5.5 Cyber to patch vulnerabilities ahead of open exploits.
Compute Constraints and Distillation Policies Within Big Tech (19:04)
Infrastructure bottlenecks and proprietary data protection are shaping operational decisions across major tech companies. The Financial Times reported that Google capped Meta’s access to Gemini models around March due to broad compute infrastructure constraints. Internally, The Information reported that Meta restricted employee usage of rival systems, including Anthropic's Claude and OpenAI's Codex, to prevent accidental distillation into Meta's proprietary architectures. Outside software infrastructure, Meta published research in Nature detailing its Brain-to-QWERTY V2 project, which uses magnetoencephalography to decode raw neural signals directly into full semantic sentences.
Memory Chip Bottlenecks Extract AI Industry Profits (26:31)
High-bandwidth memory (HBM) and DRAM shortages have concentrated profitability in hardware manufacturing rather than foundation model development. Micron Technology, Samsung Electronics, and SK Hynix have capitalized on supply constraints, with Micron raising DRAM prices by more than 60% and NAND flash by over 80% in the quarter ending May 28, despite single-digit shipment growth. These price surges have pushed Micron's market capitalization past $1 trillion and spilled over into consumer electronics, contributing to a 15% price increase on Apple MacBooks and a tripling of retail RAM costs over 12 months. With AI labs subsidizing compute to maintain market share, input costs increasingly compound operating losses across the software ecosystem.
Tech History, Restructuring, and Venture Syndicates (23:50)
Corporate restructurings and venture investments highlighted broader commercial realignments. Comcast announced the separation of its connectivity infrastructure from NBCUniversal and Sky entertainment units. Silicon Valley history underscored the stakes of dealmaking through Wired's retrospective on Yahoo CEO Terry Semel's 2006 bid to purchase Facebook; after an initial $1 billion verbal agreement, Semel lowered the offer to $800 million following a stock drop, prompting Mark Zuckerberg to exit the transaction permanently. In current venture funding, Chamath Palihapitiya raised a $135 million Series A round for 890, backed by Salesforce Ventures, Craft Ventures, Launch, and The Production Board.
The hosts leave open whether open-source AI can sustain its capability parity without direct access to frontier models for distillation, and whether surging memory hardware costs will eventually force foundation model providers to abandon loss-leading pricing models.
[0:02] Unfettered intelligence.
[4:20] GLM-5.2 sounds too much like a gray market peptide you're taking.
[19:04] If you thought Instagram was listening to your conversations, now you can have a new conspiracy at home, which is that they might be just listening to your thoughts.
[26:31] We are witnessing an extraordinary transfer of cash from the providers of AI, and perhaps one day AI users, to memory chip makers.
Original transcript
[0:02] Well, on the front of the Wall Street
[0:04] Journal today, this is how you know this
[0:07] is the whole AI 2027 Washington waking
[0:10] up. The AI stories are making it to the
[0:13] front page, the the the world news
[0:15] section, not just the business and
[0:17] finance section, more and more. So, the
[0:20] picture is about the heat wave, but the
[0:22] lead, the the story with the largest
[0:25] text, is about artificial intelligence.
[0:27] China resets the AI race with the United
[0:30] States as security models mark gains.
[0:34] We're going to get into it. This is a
[0:35] fascinating debate because I thought
[0:37] that we'd have a conclusion to the
[0:39] open-source AI debate by now. Either
[0:43] they would the the frontier would have
[0:44] collapsed and there would be, you know,
[0:46] perfect commoditization, or they would
[0:49] have fallen so far behind.
[0:51] >> It'll It'll just go, "It's over. We're
[0:53] so back. It's over."
[0:55] >> If you're in open-source AI, that's
[0:56] exactly how it feels. The big The big
[0:58] story is centered around GLM 5.2 from
[1:01] Z.ai,
[1:03] uh is officially released June 13th. So,
[1:05] it's taken a couple weeks for it to
[1:07] really break through to the front page
[1:09] of the Wall Street Journal, but uh
[1:11] they're seeing some strong performance
[1:12] on benchmarks, some positive reviews
[1:14] from developers. I have a whole review
[1:16] from Tyler we can go through in a little
[1:17] bit, but we're now entering another
[1:19] round of debates around open-source AI.
[1:21] What can the model actually do? Is this
[1:23] a threat to national security? What are
[1:26] the geopolitical ramifications here? And
[1:28] so, I'm sure this will be an ongoing
[1:29] conversation throughout this week,
[1:31] probably next week. We have some guests
[1:33] lined up to help contextualize it. But,
[1:35] uh laying down the facts from the
[1:37] journal, "Security researchers said that
[1:39] a new AI model released this month by
[1:41] China's Zhipu AI, also known as Z.ai,
[1:45] can match the latest US models when it
[1:47] comes to finding security bugs, a
[1:48] development poised to reset the global
[1:51] tech race and pressure the White House
[1:53] in its overhaul of US AI policy. So,
[1:57] unlike models from Anthropic or OpenAI,
[2:00] Zippo's GLM 5.2 is open weight. You can
[2:03] just download it, run it anywhere. You
[2:05] don't need to go to an API. You don't
[2:07] need to go to a private company and pay
[2:09] them. You can run it on your own server,
[2:11] provided you have the electricity and
[2:13] GPUs to do so. It is expensive to run,
[2:16] as we'll go into, but it is open weight.
[2:18] That means it can be downloaded right on
[2:20] hardware operated by anybody and can be
[2:22] modified and used without supervision.
[2:24] Scary stuff. Open weight models are
[2:26] ideal for users who want unfettered
[2:28] access to systems they control, uh but
[2:30] they're also ideal for hackers who want
[2:32] to run them in the shadow.
[2:34] >> Unfettered intelligence.
[2:36] >> Unfettered Oh, that's a good
[2:37] >> completely out of We are completely out
[2:39] of names for new Neo Labs.
[2:41] >> That's a good Neo Labs name, yeah.
[2:43] >> Unfettered intelligence.
[2:44] >> Unfettered intelligence is good.
[2:46] Uh GLM 5.2 has ranked as one of the top
[2:50] 10 most used AI models, according to
[2:52] data from OpenRouter, a company that
[2:54] provides access to more than 400 AI
[2:56] models. And what a fantastic business,
[2:59] uh Alex Atallah over there. Absolutely
[3:01] cooking it OpenRouter. It's such an
[3:02] exciting way to plug into the AI
[3:06] the AI race without actually needing to
[3:08] play the play the benchmark game so
[3:10] much. Be the uh the front door. Anyway,
[3:13] uh in some benchmarking tests, according
[3:14] to cybersecurity company Semagrap, GLM
[3:17] 5.2 bested Anthropic's Claude Opus 4.8
[3:21] model, which was released in May. When
[3:23] given further instructions, Opus 4.8 and
[3:26] GLM 5.2 can match Mythos in bug binding
[3:30] ability, according to researchers. So,
[3:31] prior to this launch, uh and there's a
[3:34] chart that we should pull up here about
[3:35] overall AI capability, and we can talk
[3:37] to Tyler about what this chart actually
[3:38] means, but there was this narrative
[3:40] brewing that open-source AI was slowing
[3:43] down relative to the closed-source
[3:45] frontier. And I saw a lot of uh American
[3:48] AI fans sort of cheer for this. Hey, the
[3:53] we have the capital markets, we have the
[3:55] data centers, we have the researchers,
[3:57] and so we are able to push the frontier
[4:00] at a different rate. And if we're
[4:01] actually growing at a faster rate in
[4:03] America within the closed-source labs,
[4:06] that will compound and there will be a
[4:08] stronger takeoff in the American
[4:10] closed-source AI industry. Now, this
[4:13] chart sort of goes back and forth and
[4:15] there's some debate over it. It's in the
[4:17] newsletter. You can go sign up at
[4:18] tbpm.com.
[4:20] >> While we're pulling that up, let me tell
[4:21] you about Codex. Codex is a powerful
[4:23] workspace for getting work done with AI
[4:25] agents. Whether you're writing code,
[4:27] analyzing data, creating content, or
[4:29] automating business workflows, Codex
[4:31] helps you move projects forward from
[4:32] start to finish. This chart, which we
[4:34] can pull up, shows progress from GPT-40
[4:37] to 01, 03 mini, 03 Opus, 4 GPT-5, 5.2,
[4:43] Opus 4.6, GPT-5.4, GPT-5.5,
[4:47] showing
[4:48] you know linear trend in this Elo.
[4:50] >> Ryan says GLM-5.2 sounds too much like a
[4:54] gray market peptide [laughter] you're
[4:55] taking.
[4:56] >> It actually does.
[4:58] It does sound a lot like that. And and
[4:59] then you can see the red line are the
[5:02] are the Chinese models, which are also
[5:05] improving over time but at a slightly
[5:08] lower rate. And so the question was are
[5:10] they going to plateau while America's
[5:12] progress continues to advance? This
[5:15] latest model GLM-5.2 seems it's very
[5:18] hard to apply it to this particular
[5:20] benchmark because this Elo was Can you
[5:22] give us some background, Tyler, on where
[5:24] this chart came from, what this is
[5:26] demonstrating?
[5:27] >> Yeah, so this is by Casey. I think
[5:29] that's how you pronounce it, the Center
[5:30] for AI Standards and Innovation. They
[5:31] they have this way to calculate like the
[5:33] Elo of models. It's basically
[5:34] approximation of a bunch of different
[5:35] benchmarks. Um some of those like are
[5:37] proprietary like they're they're they're
[5:38] not open. So it's actually hard to run
[5:40] these. Also cuz I was basically trying
[5:42] to bench like all the recent models
[5:44] since this was published. It it I I want
[5:46] to say May 1st.
[5:47] >> Yeah, it'd be great to throw 5.6 Soul,
[5:49] Mythos, and Fable. All all I it would be
[5:52] great to just continue this chart cuz
[5:54] it's an interesting trend.
[5:55] >> a lot of those benchmarks aren't
[5:56] actually public, so it's very hard to
[5:57] estimate. Um but I I tried I got you can
[6:01] look at like some of the benchmarks that
[6:02] that are public that you can reference.
[6:04] You can kind of match them up to
[6:05] previous models. 5.2 looks like it it it
[6:07] it is like a big step up from the like
[6:11] Chinese trend line, right? I think that
[6:13] the the group of benchmarks that were
[6:14] chosen for this ELO definitely
[6:16] accentuate that the gap between US and
[6:19] Chinese labs. Um I I think there's a
[6:21] bunch of other like groups like Epoch AI
[6:24] has done a chart. They basically a
[6:26] relatively stable gap between close
[6:28] source and open source models since like
[6:30] 2023, like a long time.
[6:32] >> Yeah. And perhaps at this point the the
[6:35] discussion should be more centered
[6:37] around cost per task more than cost per
[6:40] token.
[6:41] >> Yes. Yeah, definitely. Because even
[6:42] like, you know, new models a lot of
[6:44] times when when they come out like,
[6:45] "Okay, maybe the token price is actually
[6:47] the exact same, but the token efficiency
[6:49] is much better." So, then when you do a
[6:51] lot of these tasks, it's like it it's
[6:52] not the the the price per token, it's
[6:54] price per per, you know, something
[6:56] completed. And then you actually see it
[6:58] go down.
[6:58] >> And there's a lot of test time scaling
[7:00] laws where you can just throw a million
[7:02] dollars of compute at a particular
[7:03] problem and
[7:05] all the models do really well at it, but
[7:07] it's completely non-viable for any real
[7:10] enterprise use case and probably not
[7:12] even viable if you're trying to
[7:13] be a nefarious hacker.
[7:15] >> Yes. Most people are saying like 5.2 is
[7:17] very token hungry, right? So, it uses a
[7:18] lot of tokens. So, maybe it like it
[7:20] definitely is much cheaper than the
[7:21] frontier models.
[7:22] >> On a per token basis.
[7:23] >> On a per token basis.
[7:24] >> per task basis, it might be more
[7:27] expensive.
[7:28] >> Yeah. I mean, on that that's still it's
[7:29] generally not, but on on specific tasks,
[7:31] you can get you know, if you have low
[7:33] thinking models, low thinking mode on
[7:35] the close source ones, you can see.
[7:37] >> Well, let's revisit John Ludwick's post
[7:40] from 2024, May 2024. This is pre-deep
[7:43] seek talking about his
[7:47] prediction about why the future of
[7:48] foundation models is closed source. He
[7:50] got a lot of pushback from this because
[7:52] a lot of people like open-source models,
[7:54] but he laid out a
[7:56] thesis around closed-source data
[7:59] flywheels, exponential capex intensity
[8:02] of training. And he said open-source
[8:04] will have a home wherever smaller, less
[8:07] capable, and configurable models are
[8:09] needed. Enterprise workloads, for
[8:11] example. But the bulk of the value
[8:13] creation and capture in AI will happen
[8:15] using frontier capabilities. The impulse
[8:18] to release open-source models makes
[8:20] sense as a free marketing strategy and
[8:23] as a path to commoditize your
[8:24] complements, but open-source model
[8:26] providers will lose the capital
[8:28] expenditure war as open-source ROI
[8:30] continues to decline. And that was the
[8:32] thesis around the time that
[8:36] the open-source AI discussion was
[8:37] primarily driven by Mark Zuckerberg's
[8:39] work at Meta on the llama family of
[8:41] models.
[8:42] The idea was that Meta would benefit
[8:44] from attracting talent. It was good
[8:46] marketing. It told the story that Meta
[8:49] has an AI story and has AI talent
[8:51] in-house, even if they weren't
[8:53] monetizing it and sharing, you know, a
[8:56] really fast takeoff in ARR around those
[8:58] models. It showed that, "Hey, they're
[9:00] able to develop these models." And and
[9:02] that might help them cut their costs in
[9:04] the long term. Very interesting that
[9:06] that wound up being very different in
[9:08] 2026 looking at the news today, which
[9:11] we'll go into about them spending a lot
[9:13] on Gemini. There's been reports about
[9:15] them spending a lot with other
[9:16] closed-source frontier labs that they
[9:19] should have commoditized with their
[9:20] open-source plan. But nonetheless, that
[9:23] was the idea with Meta. But then China
[9:25] sort of woke up and the deep seeks and
[9:27] deep seeks launch at the start of 2025.
[9:30] And the game theory became way more
[9:32] complicated. So George Hotz sort of
[9:34] summed this up nicely. He has a take in
[9:36] AI will be massively deflationary a post
[9:39] from just a few weeks ago as to why
[9:41] China benefits from investing in open
[9:43] source more than American firms. He says
[9:46] this explains why Chinese the Chinese
[9:48] are giving the much more moderate
[9:50] resources to train models away for free.
[9:52] They love to see deflationary economics
[9:55] in the US. It is not as much less of a
[9:58] service-based economy and so if they can
[10:00] go and give away free tools that deflate
[10:04] the value of the service sector that is
[10:05] an advantage to the Chinese economy in
[10:08] his formulation.
[10:10] He says even if you don't regulatory
[10:12] capture the US government, nobody is
[10:13] getting a monopoly on AI. We don't live
[10:15] in a unipolar world anymore and so he
[10:18] likens what's happening in DC to sort of
[10:20] rearranging deck chairs on the Titanic.
[10:22] It's a very
[10:24] fun fun means.
[10:26] So we're back to this discussion
[10:28] what are the consequences and the
[10:29] impacts of open source models
[10:31] particularly in the United States. And
[10:33] there's been this clip that's
[10:34] resurfacing from Dario Amodei when he
[10:36] was testifying in front of Congress in
[10:38] 2023
[10:40] and is now recirculating and it was
[10:41] reposted like he just said it and he did
[10:44] not. So be clear about that. This is
[10:46] from 3 years ago, but some of his
[10:48] predictions were very prescient as of
[10:51] where the frontier is today. So he said
[10:53] I'm very concerned about where things
[10:55] are going. If we talk about 2 to 3 years
[10:58] for the frontier models for the bio
[11:00] risks sort of
[11:02] a bad transcription of what he was
[11:03] saying. He's talking about 2025 2026.
[11:06] Remember he was saying this in 2023.
[11:09] We're there now. I think the path that
[11:11] things are going in terms of the scaling
[11:13] of the open source models. I think it's
[11:15] going down a very dangerous path. And
[11:16] again, if the path continues, I think we
[11:18] could get to a very dangerous place. So
[11:20] he was worried about cybersecurity and
[11:22] bio risks being open sourced and then
[11:26] not having a counterweight to that. Now
[11:29] the good news is that uh talked to the
[11:31] CEOs of cybersecurity firms like
[11:33] CrowdStrike and Palo Alto Networks and
[11:36] uh they've been working with Mythos and
[11:37] GPT 5.5 Cyber for months now to harden
[11:40] systems from LLM-driven attacks. And so,
[11:43] there's still this gap between
[11:44] closed-source and open-source models,
[11:46] and that gap allows white-hat hackers to
[11:48] implement fixes before black-hat hackers
[11:51] have a chance to exploit easy bugs.
[11:53] There still will be a bigger discussion
[11:55] here though in DC over the next few
[11:57] months as the frontier models roll out,
[11:59] and the gap doesn't appear to be
[12:00] widening at the moment, so security
[12:02] stances must adjust. It's not a a
[12:06] closed source is falling behind, so it's
[12:07] never going to be an issue. Uh there
[12:09] will be this gap and how uh the American
[12:11] cybersecurity industry and eventually
[12:13] the biosecurity industry implements
[12:15] changes and fixes before open source
[12:18] catches up or or commoditizes and makes
[12:21] that particular capability widely
[12:22] available is going to continue to be
[12:25] important. Uh so, let's go over to
[12:27] Tyler's quick review of GLM 5.2. Why
[12:30] don't you take me through your bullet
[12:31] points, uh and you can tell us like what
[12:33] is the shape of this model? How are the
[12:35] reviews?
[12:36] >> Yeah, so I I think so far um one of the
[12:39] main things is like people are saying
[12:40] it's oh it's distilled, right? This is
[12:41] this has been a big thing with a lot of
[12:42] these open-source models, especially the
[12:44] Chinese ones. Oh, the only reason that
[12:45] they're good is cuz they're distilled.
[12:47] It It's very hard to actually figure out
[12:48] how true this is. It certainly seems
[12:51] like there there there's some uh you
[12:53] know
[12:53] >> I think Anthropic's of of Anthropic
[12:55] models.
[12:56] >> wait oh Anthropic openly accuse Alibaba
[12:59] of distilling models?
[13:01] >> of these these labs
[13:02] >> Yeah, and there's also been a big like
[13:04] professionalization of the gray market
[13:06] where a whole bunch of different uh sort
[13:09] of individual groups will connect a
[13:12] whole bunch of different entities and
[13:14] users accounts and subscriptions and
[13:16] APIs to then create a front end to like
[13:20] the model that can be served at a very
[13:22] high rate through a VPN most likely. Uh
[13:25] what's interesting is that you'd think
[13:27] that if you were going to do a training
[13:29] run, you would just find and replace on
[13:33] the other lab's name before you hit run.
[13:36] Is that not something people can do? I
[13:38] don't understand.
[13:40] >> Yeah, I mean, it also depends on what
[13:41] you're actually like maybe you're not
[13:42] directly distilling on the API, but you
[13:44] know, you're training on
[13:46] you know, public GitHub, you know, repos
[13:49] and those were all used those were all,
[13:50] you know, made with with with open
[13:52] source models. Then you're kind of like
[13:53] distilling, but it's not really
[13:55] like is this really kind of distilling?
[13:57] I don't know.
[13:57] >> Yeah.
[13:58] >> But so so if you are like if you're
[13:59] convinced that these are like super
[14:01] distilled, the only reason that they're
[14:02] good is is because they're just, you
[14:03] know, basically taking the closed
[14:05] sourced
[14:05] >> Yeah.
[14:06] >> like labs. There's also this weird thing
[14:07] with distilling where as more and more
[14:09] of the public internet and GitHub
[14:11] broadly and open source repos become
[14:15] LLM outputs, you if you train on that,
[14:19] you are in some ways distilling because
[14:22] an LLM has a quirk like it's not this,
[14:24] it's that in text and you'd wind up
[14:26] training on a whole bunch of Amazon
[14:28] Kindle books, you're going to wind up
[14:30] learning it's not this, it's that. And
[14:32] the same thing applies for different
[14:34] code conventions in open source repos
[14:36] that have effectively been completely
[14:38] been rewritten by closed source models.
[14:40] >> Yeah, and so so I think it's safe to say
[14:41] that like we've generally seen that
[14:43] distilled models
[14:45] generally will generalize worse, right?
[14:48] So you'll see really good benchmark
[14:49] scores. And maybe they're benchmarks,
[14:51] maybe they're not, but even if they're
[14:52] not like directly benchmarks, you still
[14:54] find that they generally
[14:55] >> Yeah, they're kind of accidentally
[14:56] benchmark sing.
[14:57] >> Yeah.
[14:57] >> Yeah.
[14:57] >> So so you should always so I think
[14:59] initially you should just be a little
[15:00] bit suspicious of these super high
[15:01] benchmark scores.
[15:02] >> Yeah.
[15:02] >> Um
[15:03] >> But they lack that big model je ne sais
[15:05] quoi.
[15:06] >> Yeah, and this is like anecdotally
[15:07] reinforced. A bunch of people have been
[15:08] saying, you know, for coding these
[15:11] models are really great. GLM is it's a
[15:12] very good model, you know, for creative
[15:14] writing or something like this where
[15:15] you'd imagine it's a bit harder to to
[15:17] kind of benchmark this.
[15:18] >> I wonder hey have have people have
[15:20] testing it with the like Tiananmen
[15:22] Square bench. Like it does it reject
[15:24] that stuff or because it felt like that
[15:26] was something that was
[15:28] like widely misunderstood by American
[15:30] audiences that in fact that might not be
[15:33] the biggest deal for the CCP and
[15:36] >> Yeah, also I I think you know even if
[15:37] that's true like the model is open
[15:39] source. You can kind of just fine-tune
[15:40] it to like not that. And maybe maybe
[15:42] it's a bit harder than that but I think
[15:44] you can kind of get around like that
[15:45] kind of stuff.
[15:45] >> Okay. Yeah. So we talked about the token
[15:47] hunger and the API price
[15:51] and in general I mean you said I'm not
[15:53] convinced that there's a big market for
[15:54] this class of model especially as
[15:56] frontier models get more efficient. If
[15:58] you look at open router the most used
[16:00] models are the smallest open source
[16:02] models presumably being used for
[16:05] specific tasks that need to be repeated
[16:07] over and over again.
[16:09] >> Yeah, so I think like what we've seen is
[16:11] you know a marginal IQ point of the
[16:13] models is like extremely expensive.
[16:15] Frontier models are are getting very
[16:16] expensive. People have to cut back. You
[16:18] know they're they're token max and this
[16:19] is like massive bill in their balance
[16:21] sheet or whatever. It seems like there's
[16:22] there's now basically like two classes
[16:24] of models that that people really use.
[16:26] There's like the frontier ones and
[16:28] they're they're using coding agents.
[16:30] They need the best thing. If you're
[16:31] doing cyber like you you just need the
[16:32] the best model because you know the risk
[16:35] of of someone hacking you it's so great.
[16:36] You just need the best thing. You pay
[16:37] whatever it is.
[16:38] >> Yeah.
[16:38] >> And then there's the second class which
[16:40] is like these very small
[16:42] very fast very cheap models that you can
[16:44] use for these kind of point solution
[16:46] things. Maybe you have some
[16:47] orchestration where you're using a
[16:48] really big model to to have these like
[16:50] little agents using these very cheap
[16:51] models. I I think in the middle it's
[16:53] hard to actually figure out what is the
[16:55] the real use case. Maybe it's like
[16:56] hobbyists using these coding agents and
[16:59] and they don't want to pay the super
[17:00] expensive tokens of the closed source
[17:02] labs. You see this on open router where
[17:04] like what are the top models by by token
[17:07] like usage. It's these very small
[17:09] models. It's like
[17:10] you know
[17:11] deep seek flash
[17:12] >> Yeah, cuz you're spamming them for like
[17:14] you know every receipt that goes into
[17:16] ramp gets processed by an LLM at this
[17:18] point. Does it need to be a frontier
[17:21] model telling me that I spent $10 on a
[17:24] coffee? No. Yeah. It can just do
[17:26] standard OCR.
[17:27] >> That'd be my preference.
[17:29] >> [laughter]
[17:29] >> Yeah, you want you want super
[17:31] intelligence overseeing your expenses
[17:33] most likely. Um but no, you use the
[17:36] right tool for the job and that's
[17:37] clearly what's happening right now.
[17:38] >> Yeah. But also I I think like it is a
[17:40] very good model, right? Like we should
[17:41] not fully dismiss I I think that the
[17:43] idea that oh, the gap is widening. We we
[17:45] really don't have to worry about these
[17:46] these open source models. I think they
[17:48] are like very good.
[17:49] And maybe if you're super worried about
[17:51] distillation, maybe something changes if
[17:53] if the models are are, you know, kept to
[17:55] these big partners, right? Like what
[17:57] we've seen recently with with government
[17:58] coming in, but
[17:59] >> Yeah.
[18:00] >> I think we we can't really fully dismiss
[18:02] these these labs.
[18:02] >> Yeah, it it throws it throws a little
[18:04] bit of a wrench in the
[18:07] like the monetization potential, like
[18:09] how long can you monetize a new frontier
[18:11] model? That's more tricky. And then the
[18:15] other one is just like if you're going
[18:16] to
[18:18] keep a model behind KYC or behind a an
[18:22] approval for specific companies like the
[18:24] government has been sort of edging
[18:26] towards and moving towards, it gets a
[18:28] little bit tricky if all of a sudden
[18:32] you just wait 3 months and oh, I was
[18:34] waiting to get approved for this one for
[18:37] like
[18:38] GPT-7 or whatever, but by the time I the
[18:41] government got back to me, my company
[18:43] got access to GLM-6 and it's
[18:47] close enough. And so
[18:49] that in that just throws another wrench
[18:51] that I think the government will have to
[18:54] figure out how it puzzles together with
[18:55] the rest of the strategy, which has
[18:57] been, yeah, back and forth as always.
[19:00] >> Google caps
[19:04] Meta's Gemini use as AI demand strains
[19:08] capacity in the Financial Times. Surging
[19:10] appetite for advanced models is turning
[19:12] computing power into
[19:14] And they have a picture here of a Google
[19:16] Gemini bicycle, which looks fantastic.
[19:19] >> What what does that have to do with with
[19:22] uh meta though?
[19:23] >> I think that was just the best Google
[19:26] Gemini picture.
[19:27] Google has put limits on Meta's use of
[19:29] its Gemini AI models after the social
[19:31] media giant sought more computing
[19:33] capacity than the rival tech group could
[19:36] provide in the latest evidence of the
[19:38] infrastructure constraints facing even
[19:39] the world's largest AI providers. Google
[19:41] told Meta around March that it could not
[19:43] provide all of the Gemini capacity the
[19:44] company wanted to purchase, according to
[19:46] three people familiar with the matter.
[19:48] In a move that has disrupted and delayed
[19:51] some of Meta's internal AI projects. So
[19:54] >> I don't understand how this is possible.
[19:56] >> yeah. So so one
[19:58] >> Google spent $200 on CapEx.
[20:01] >> Okay. So so So of course like around
[20:03] this time token maxing was becoming a
[20:06] thing. A lot of every company in the
[20:07] world, at least every tech company in
[20:09] the world kind of going a little bit of
[20:11] crazy from a spending standpoint. You
[20:13] know, I could see Meta going and like
[20:15] wanting to basically buy a bunch of
[20:16] capacity and then being told like, "Hey,
[20:19] we we can't fulfill that." But I'm I'm
[20:22] wondering is it worth reading
[20:24] >> I mean it it sounds extremely bullish
[20:25] for Google. Like if they're
[20:26] >> Yeah, no.
[20:27] And this this tracks with what they talk
[20:29] about on on earnings calls.
[20:31] Um
[20:32] >> Yeah, Google Cloud.
[20:33] >> But
[20:34] you do have to wonder like
[20:37] could distillation be be part of this
[20:40] this story? Is is that Could that be a
[20:42] factor here? I have I have no idea.
[20:44] >> know. Zero Hedge said Meta puts limits
[20:46] on Claude and Codex fearing
[20:47] distillation, the information.
[20:49] >> But but but so this story is different.
[20:51] This is Meta telling its own employees,
[20:53] "Don't use Claude and Codex in certain
[20:57] parts and certain parts of our business
[21:00] because we don't want we don't want to
[21:02] accidentally do distillation."
[21:04] >> Oh.
[21:04] >> Meta is saying. So So, that's different.
[21:07] I was wondering like is Google thinking
[21:09] like well, that's a lot of
[21:10] you know.
[21:11] >> Yeah, yeah.
[21:11] >> Cool it, you know. Owing to the
[21:13] restrictions which remain in place as
[21:15] well as a broader push to streamline AI
[21:16] costs, Meta has encouraged staff to be
[21:18] more efficient with AI tokens.
[21:20] Uh several other Google clients have
[21:22] been affected by the restrictions
[21:23] although to a lesser extent. Meta has
[21:25] been particularly impacted because of
[21:27] its exceptionally high demand for
[21:29] Google's models.
[21:30] >> Interesting.
[21:31] >> Um
[21:32] very interesting. On the topic of Meta
[21:35] >> Yeah.
[21:35] >> Meta shared this morning
[21:37] >> What they do?
[21:38] >> a new milestone. It is a mind reader.
[21:40] >> Mind reader.
[21:41] >> Non-invasive brain detects decoder
[21:43] research brain to QWERTY V2 building on
[21:46] V1 which was published today in nature
[21:48] brain to QWERTY V2 is the highest
[21:50] performing end-to-end pipeline capable
[21:52] of real-time sentence decoding from raw
[21:55] brain signals. It advances beyond
[21:58] character level performance to decoding
[22:00] words and semantics enabling accuracy
[22:03] for overall communication. So, if you
[22:06] thought Instagram was listening to you
[22:09] >> [laughter]
[22:10] >> It's going to
[22:10] >> Uh if you thought it was listening to
[22:12] your, you know, conversations, now you
[22:14] can have a, you know, new conspiracy at
[22:17] home which is that they might be just
[22:19] listening to you to your thoughts.
[22:21] >> you know do you know the device they
[22:22] they say this is a non-invasive device?
[22:24] I just shared an image of this device
[22:26] and I want you to tell me, do you
[22:27] consider this non-invasive or invasive?
[22:31] Look [laughter] at this image of the
[22:33] magnetoencephalography
[22:36] uh graphy device.
[22:38] >> No, you got to go
[22:39] you need to
[22:40] scroll up a little bit cuz you can't
[22:43] even see the whole thing here.
[22:45] >> [laughter]
[22:46] >> It's not invasive.
[22:47] >> Cuz it looks like the device could
[22:48] actually potentially carry on for like a
[22:50] whole half of a football [laughter]
[22:51] >> It really does seem like it's a just put
[22:53] yourself in this in this room-sized
[22:55] device. No, of course this will shrink
[22:57] down.
[22:57] >> giving him I'm giving him credit here.
[22:59] Non-invasive.
[23:01] >> Okay. As long as he
[23:03] >> You're You're putting this thing on?
[23:04] You're daily driving this thing.
[23:05] >> I don't know if I'm ready to daily it.
[23:07] >> [laughter]
[23:09] >> I don't know if I'm ready to daily it.
[23:11] >> Yeah.
[23:12] >> This will be a cool demo. Like this this
[23:14] will actually when when
[23:16] when you can just walk in, sit down in a
[23:19] chair, and see your thoughts on a
[23:21] screen.
[23:21] >> No, we were debating earlier. My buddy
[23:22] Rob Tev has been on the show twice,
[23:24] uh dropped five predictions in Forbes
[23:26] recently. We can go through them at some
[23:27] point. He's going to come on the show.
[23:28] But, uh
[23:30] four of the five were very very like
[23:33] reasonable, you know, Anthropic's going
[23:35] to be bigger, and uh you know, TSMC is
[23:38] going to face more comp- more
[23:39] competition. And then he predicts that
[23:41] in 2030 telepathy will be commonplace,
[23:45] which is a very aggressive prediction in
[23:47] my it it in my estimation. How Terry
[23:50] Semel fumbled Yahoo's Facebook deal. Uh
[23:53] how much is Facebook worth? 5 billion,
[23:55] 10 billion, 15 billion, whatever the
[23:57] number, it's probably a lot more than
[23:59] the 1 billion that Yahoo could have
[24:02] bought it for a year ago. As Yahoo
[24:04] continues its soul-searching, here's an
[24:06] unpleasant rendition of Semel's
[24:08] catastrophic decision, courtesy of
[24:11] Wired. When Yahoo came calling with a
[24:13] bid of $1 billion in cash, the pressure
[24:16] became too much. Zuck relented in July
[24:19] of 2006. He was just like 18 months into
[24:22] building the company, something like
[24:23] that. Verbally agreeing to sell Facebook
[24:26] to Yahoo. He said yes. He said he was
[24:28] going to sell Facebook
[24:29] >> allegedly.
[24:30] >> to Yahoo, allegedly. Uh strategically,
[24:32] it [snorts] seemed like a good match.
[24:34] Yahoo had hundreds of millions of users,
[24:36] but its foray into social networking was
[24:38] struggling. Facebook had cool tools and
[24:40] was looking for a mass audience. The
[24:42] timing, however, could not have been
[24:44] worse. In the days after Zuckerberg
[24:46] agreed to sell, Yahoo announced it was
[24:48] projecting slower sales and earnings
[24:50] growth, and that it's that the launch of
[24:52] its new advertising platform would be
[24:54] delayed. Its stock price tumbled 22%
[24:58] overnight. Terry Semel, Yahoo's CEO at
[25:00] the time, reacted by cutting his offer
[25:02] from 1 billion to 800 million. He just
[25:05] took 20% off, but Zuckerberg, who had
[25:07] been warned about Semel's reputation for
[25:09] last-minute renegotiations, walked away.
[25:12] And that's probably reasonable. I mean,
[25:13] if they're cutting the price there, you
[25:15] have to imagine that as it gets papered,
[25:17] you get cut down again, then the earn
[25:19] out, you get cut down again, and all of
[25:20] a sudden you're walking away with barely
[25:22] anything. Uh but, 2 months later, Semel
[25:25] reissued the original 1 billion-dollar
[25:27] bid, but by then, Zuckerberg had
[25:29] convinced his board and executive team
[25:30] that Yahoo wasn't a serious partner, and
[25:32] that Facebook would be worth more on its
[25:34] own. He rejected the offer and became
[25:36] famous as the cocky youngster who turned
[25:39] down 1 billion dollars from Wired.
[25:41] >> Legendary.
[25:42] >> Legendary.
[25:43] Um
[25:44] it's so interesting to imagine the road
[25:46] not traveled there, because the the the
[25:49] the dynamic, the way Facebook is built
[25:52] as a social network, like could it have
[25:55] been successful under Yahoo's
[25:57] stewardship, or would it have been uh
[26:00] less exciting,
[26:02] attract less talent, ultimately been
[26:04] disrupted, and would they have had the
[26:06] capital and the guts to go and buy
[26:09] WhatsApp, and then also buy Instagram?
[26:11] Um you know, to actually maintain the
[26:14] the dominant position in social
[26:15] networking.
[26:16] >> What do you
[26:16] >> I think Yahoo should make another offer.
[26:19] I would like to see Yahoo make another
[26:21] bid.
[26:21] >> Hey, Meta is trading down, just keeps
[26:23] going.
[26:24] >> If it continues at this
[26:25] trend
[26:28] >> might be able to pick it up
[26:29] >> at at this trend
[26:30] >> Anyway.
[26:31] >> Uh chip makers are profiting off AI at
[26:33] the expense of just about everyone else.
[26:36] >> on the cover of the business and finance
[26:38] section today.
[26:39] >> Uh we are witnessing an extraordinary
[26:41] transfer of cash from the providers of
[26:43] AI, and perhaps one day AI users, to
[26:45] memory chip makers. Take us away, John.
[26:48] >> Yeah, the explosive growth in Micron
[26:50] Technology's profit in the latest
[26:52] quarter is extraordinarily good news for
[26:54] its shareholders, but it comes at the
[26:56] expense of the artificial intelligence
[26:58] companies to which it sells fast memory
[27:00] chips. Micron, along with the Korea with
[27:03] Korea's Samsung Electronics and Sam and
[27:06] SK Hynix are to AI what oil producers
[27:09] are to the airlines, makers of an
[27:12] essential input that this year suddenly
[27:14] became much more pricey. Because there
[27:16] is extremely limited capacity to make
[27:18] the high bandwidth memory that AI needs,
[27:21] and it takes years to build production
[27:23] facilities. Soaring data center demand
[27:25] simply jacked up prices. Micron's
[27:27] soaring profits are for its customers
[27:30] soaring costs. "We are witnessing an
[27:32] enormous transfer of cash," they said.
[27:34] "Profit shift of this scale are rare
[27:37] events, and investors should be paying
[27:39] attention to where the money's coming
[27:41] from, where it's being spent, and how
[27:43] long it will keep flowing." In the
[27:44] quarter ended May 28th, Micron increased
[27:47] prices for DRAM chips more than 60% on
[27:51] the previous 3 months while increasing
[27:52] shipments by a low single-digit
[27:55] percentage. It said last week prices for
[27:57] NAND flash memory also used in data
[28:00] centers jumped more than 80%. Usually,
[28:02] memory doesn't matter that much, but for
[28:04] Micron customers paid $18 billion more,
[28:07] and that was just in the quarter. Prices
[28:09] quadrupled in a year, and it's hurting
[28:11] outside AI, too. Apple last week raised
[28:14] prices for MacBooks more than 15% Closer
[28:17] to home for me, the memory I bought on
[28:20] amazon.com a year ago to build a super
[28:22] quiet computer, I hate fan noise, good
[28:25] good color commentary here, uh has
[28:27] tripled in price
[28:28] and now costs more than the CPU. For an
[28:31] industry
[28:32] in which prices usually drop every year,
[28:34] it's a huge turnaround. And consumer
[28:36] electronics passing on higher prices
[28:38] helps limit demand for chips just as
[28:40] higher oil prices reduce consumption.
[28:42] But the AI companies aren't passing on
[28:44] higher prices because they're able to
[28:46] throw money at supply problems. The
[28:48] problem in AI is that the end users
[28:50] aren't covering the cost of the service
[28:51] with big losses being recorded by AI
[28:54] model producers. Everything is still
[28:56] priced to bring in new customers, yet
[28:58] not yet to make money. So, higher input
[29:01] costs create a nasty problem. Either
[29:03] losses will either be bigger or higher
[29:05] prices will be needed, putting off
[29:07] potential customers. And you can see the
[29:09] price of Micron's stock price has been
[29:12] through the roof as the company joins
[29:15] >> the $1 trillion club.
[29:16] >> Tyler, how many trillion-dollar
[29:18] companies are there in Europe out of
[29:19] curiosity?
[29:22] >> I'm going to go with zero.
[29:24] >> That's true.
[29:25] >> Uh NBCUniversal and Sky will separate
[29:28] the company's connect connectivity
[29:29] business from its film, theme park, and
[29:31] streaming operations. Oh, yeah.
[29:33] Universal Studios. Uh Comcast plans to
[29:36] separate its media and connectivity
[29:38] businesses.
[29:39] >> the Anduril of theme parks?
[29:42] >> It does seem like a
[29:43] >> Could there not be an opportunity to
[29:44] create a a net new theme park business
[29:49] with with modern a modern technology
[29:52] stack?
[29:52] >> It's very expensive. Everything needs to
[29:54] be Like, the modern technology stack in
[29:57] theme parks is expensive.
[29:59] >> in the theme park capital markets?
[30:01] >> know. I I I I I I know I've known people
[30:03] that have worked on theme parks at
[30:04] Disney, and it's tricky because you you
[30:08] have to amortize a ride over like 20
[30:10] years. And so, you'll go and
[30:12] >> like an absolutely brutal business.
[30:14] >> Yeah.
[30:15] >> That is probably harder today because at
[30:17] the time that a lot of these parks were
[30:19] built, like, you didn't have like
[30:21] infinite online entertainment for every
[30:24] single sub
[30:26] niche.
[30:27] >> Yes, but instantly available.
[30:28] >> I mean, there's a whole bunch of trend
[30:30] pieces right now about how IRL
[30:32] experiences are seeing higher than ever
[30:35] pricing in the face of you could just
[30:38] watch the Knicks game on TikTok
[30:41] highlights, but people still forked over
[30:44] $5,000 to go see the game. And so, you
[30:47] know, you have that like barbell
[30:49] strategy where Thrive is buying a stake
[30:51] in the San Francisco Giants, a baseball
[30:53] team that should face competition.
[30:56] >> uh the the NBA team to Vegas.
[30:58] >> Yeah.
[30:58] >> Uh
[30:59] but at the same time at the same time,
[31:01] John, there was a stat that came out
[31:02] last week that came out. There's more
[31:04] sports betting volume than all sales of
[31:08] uh movie tickets, theaters, theme parks,
[31:11] and like a couple other these IRL
[31:12] categories.
[31:13] >> Was it up or down?
[31:14] >> Uh lat uh less
[31:16] >> Less. Like in in in in the the stat was
[31:19] like volume.
[31:20] >> Yeah, yeah.
[31:21] >> Uh and so it's not exactly like
[31:24] uh a proxy for like revenue, but still
[31:29] meaningful. Chamath raised $135 million
[31:32] series A for 890. They got sale They got
[31:35] Salesforce Ventures. They got Wonder
[31:38] Cow. They got Craft, and they got
[31:40] Launch.
[31:41] >> The besties.
[31:41] >> They got the besties.
[31:42] >> the besties together, too.
[31:43] >> You think Fried
[31:45] Friedberg Friedberg's got to be in.
[31:47] >> Yeah, that's the production board.
[31:48] >> Oh, the production board.
[31:49] >> Yeah. No, Friedberg's fine.
[31:50] >> Oh, great.
[31:51] >> So, yeah, you actually have all three of
[31:53] the other besties. And we will see you
[31:55] tomorrow.
[31:56] Goodbye.