Sabine Hossenfelder
Algorithms shatter expert timelines because pure software faces zero friction, while physical constraints and industrial bottlenecks stall automation across the broader economy.
AI-assisted summary of The Experts Were Wrong About AI. Again. — original source. Check the original for full context.
Source published:
Key ideas
- AI benchmark forecasts in pure software have collapsed years ahead of schedule, including AI substantially assisting in solving a Millennium Prize Problem by September 2026 despite expert surveys assigning only a 10% probability by late 2027. (0:00)
- Coding and reasoning capabilities vastly exceeded expectations, with top models reaching 53.8% on LiveCodeBench Pro in May 2026 against a year-end forecast of 14%, and matching International Mathematical Olympiad gold-medal performance five years ahead of projections. (0:00)
- In the physical world, AI adoption has significantly underperformed forecasts: the World Economic Forum's estimate of 50% task automation across the global workforce by 2025 yielded a real-world substitution rate of just 22%. (3:24)
- The immediate future of scientific discovery will likely be propelled by AI cross-indexing and synthesizing fragmented academic literature across theoretical fields where physical hardware friction does not apply. (5:05)
Detailed notes
## Background Published on YouTube by Sabine Hossenfelder on October 7, 2026, this video investigates how experts have persistently miscalculated the trajectory of artificial intelligence. According to the show description, benchmarks once projected to take a decade collapsed within a single year, even as forecasters made the opposite mistake in other domains.
## TL;DR AI specialists have consistently underestimated progress in purely digital and symbolic domains, shattering multi-year benchmarks in competitive programming, math proofs, and vulnerability detection far ahead of schedule due to academic forecasters failing to anticipate private capital velocity. In contrast, prognosticators radically overestimated AI's immediate impact on physical labor and infrastructure, where the real-world friction of power generation, hardware construction, and institutional resistance significantly slowed adoption compared to predictions. Because pure software exhibits zero friction, the near future offers a rapid revolution in scientific literature synthesis, allowing distributed researchers to solve long-standing theoretical puzzles before confronting broader societal crossroads.
## Atmosphere & style The presentation is marked by Sabine Hossenfelder’s trademark dry wit, skeptical pragmatism, and deadpan comedic delivery. She pairs rigorous survey data with biting satire aimed at circular Silicon Valley hype and bewildered academic researchers who openly submit papers they cannot comprehend. The video feels like an engaging and grounding reality check, shifting smoothly from brisk debunks of tech hyperbole to genuinely curious optimism about the immediate future of scientific discovery.
## Bulletin - [00:00](https://www.youtube.com/watch?v=xdwFncdu8t0&t=0s) AI benchmark forecasts in pure software have collapsed years ahead of schedule, including AI substantially assisting in solving a Millennium Prize Problem by September 2026 despite expert surveys assigning only a 10% probability by late 2027. - [00:00](https://www.youtube.com/watch?v=xdwFncdu8t0&t=0s) Coding and reasoning capabilities vastly exceeded expectations, with top models reaching 53.8% on LiveCodeBench Pro in May 2026 against a year-end forecast of 14%, and matching International Mathematical Olympiad gold-medal performance five years ahead of projections. - [03:24](https://www.youtube.com/watch?v=xdwFncdu8t0&t=204s) In the physical world, AI adoption has significantly underperformed forecasts: the World Economic Forum's estimate of 50% task automation across the global workforce by 2025 yielded a real-world substitution rate of just 22%. - [05:05](https://www.youtube.com/watch?v=xdwFncdu8t0&t=305s) The immediate future of scientific discovery will likely be propelled by AI cross-indexing and synthesizing fragmented academic literature across theoretical fields where physical hardware friction does not apply.
## Key takeaways - [00:00](https://www.youtube.com/watch?v=xdwFncdu8t0&t=0s) Society has normalized rapid AI breakthroughs so quickly that the public routinely overlooks how consistently expert forecasts have failed. - [00:00](https://www.youtube.com/watch?v=xdwFncdu8t0&t=0s) More than 200 AI researchers surveyed in 2025 assigned only a 10% median probability to AI solving or aiding a Millennium Prize Problem by late 2027, a milestone reached in September 2026. - [00:00](https://www.youtube.com/watch?v=xdwFncdu8t0&t=0s) On LiveCodeBench Pro, models reached a 53.8% score by May 2026, delivering nearly four times the median expert forecast of 14% well ahead of schedule. - [00:00](https://www.youtube.com/watch?v=xdwFncdu8t0&t=0s) The AI task-completion time horizon reached 3 hours and 6 minutes in spring 2026 before the survey forecasting 3.4 hours by year-end had even closed. - [01:56](https://www.youtube.com/watch?v=xdwFncdu8t0&t=116s) A 2023 survey of over 2,000 researchers predicted it would take 22 years for AI to prove publication-grade math theorems, yet preprint archives were flooded with AI proofs within three years. - [01:56](https://www.youtube.com/watch?v=xdwFncdu8t0&t=116s) Academic forecasters systematically underestimate progress because their mental models are anchored to slow academic research rather than private markets backed by hundreds of billions in capital. - [03:24](https://www.youtube.com/watch?v=xdwFncdu8t0&t=204s) Forecasters committed the opposite error in physical domains, overpredicting autonomous trucking adoption and projecting 50% workforce task automation by 2025 when actual replacement reached only 22%. - [03:24](https://www.youtube.com/watch?v=xdwFncdu8t0&t=204s) Speculative 'intelligence explosion' models, such as Leopold Aschenbrenner's 2027 thesis, rely on flawed circular logic regarding natural gas drilling, power plant construction, and robotic automation. - [03:24](https://www.youtube.com/watch?v=xdwFncdu8t0&t=204s) Technological velocity is dictated by friction: pure software and symbolic math experience near-zero friction, while industrial supply chains, hardware labs, and power infrastructure require decades to scale. - [05:05](https://www.youtube.com/watch?v=xdwFncdu8t0&t=305s) Theoretical physics and mathematics may experience rapid breakthroughs not from a new Einstein, but from AI systems capable of reading, verifying, and connecting the entirety of existing literature. - [05:05](https://www.youtube.com/watch?v=xdwFncdu8t0&t=305s) Because access to software models is widely distributed, independent researchers globally are poised to participate in a temporary golden age of scientific discovery.
## Detailed walkthrough ### [00:00](https://www.youtube.com/watch?v=xdwFncdu8t0&t=0s) Underestimating the Digital Frontier: Benchmarks Shattered Years Ahead of Schedule
A decade ago, the suggestion that computer software could generate an entire book—much less an academic research paper—would have sounded preposterous to almost anyone. By September 2026, headlines casually announced that a university professor had used AI to produce 200 papers in a single year, and the general public barely blinked. Society has normalized artificial intelligence so swiftly that people easily overlook how dramatically the technology has outpaced official forecasts. While experts have consistently attempted to forecast the trajectory of artificial intelligence, their benchmark projections have routinely collapsed in record time.
The extent of this forecasting failure is underscored by several surveys. When more than 200 AI researchers were surveyed in 2025 regarding the likelihood of an AI solving or substantially helping solve one of the Millennium Prize Problems by the close of 2027, the median expert estimated the probability at a mere 10%. AI crossed that milestone in September 2026. Similarly, when the same cohort evaluated how top-tier models would perform on LiveCodeBench Pro—an exceptionally rigorous coding benchmark—the existing high score stood at 7.7%. The median expert expected that figure to inch up to 14% by the end of 2026. Instead, models surged to 53.8% by May 2026, delivering nearly four times the predicted capability more than half a year ahead of schedule.
A parallel miscalculation emerged around the AI task-completion time horizon, a metric capturing how long a complex programming job would take an experienced human engineer while still allowing an AI system to solve it reliably. When queried in April and May 2026, specialists estimated the horizon would hit roughly 3.4 hours by the end of the year. In reality, a newly released model clocked 3 hours and 6 minutes before the polling survey had even closed.
- **Millennium Prize Problems:** 200+ researchers gave a 10% median probability of AI solving or aiding a solution by late 2027; benchmark achieved in September 2026. - **LiveCodeBench Pro:** Baseline stood at 7.7%; experts forecast 14% by year-end 2026; actual performance reached 53.8% in May 2026 (~4x the forecast). - **Task-Completion Horizon:** Forecasted to reach ~3.4 hours by late 2026; hit 3 hours and 6 minutes while the survey was actively underway in spring 2026.
---
[01:56](https://www.youtube.com/watch?v=xdwFncdu8t0&t=116s) The Academic Blind Spot: Decades of Progress Compressed into Months
These broken forecasts are not an isolated fluke from the current year; they reflect a persistent multi-year pattern. In the autumn of 2023, a comprehensive poll of over 2,000 artificial intelligence researchers found an average estimate that it would take 22 years before AI could independently prove mathematical theorems worthy of publication in top-tier mathematics journals. Instead, mathematics and physics preprint servers are already inundated with submissions written by AI—manuscripts that their own submitters openly admit they cannot comprehend. The real novelty is not academic authors publishing work they fail to understand, but rather that "the new part is that they admit it." The debate in academic publishing has ceased to be about whether machine-generated proofs are technically publishable; it has shifted entirely to who bears legal and scholarly responsibility for the content.
Other domains reveal identical gaps between expert skepticism and subsequent reality. In 2023, leading cybersecurity professionals claimed that software capable of discovering and weaponizing zero-day software exploits on its own remained years in the distance; autonomous tools demonstrated those capabilities the very next year in 2024. In 2022, forecasters projected that competitive AI would not achieve a gold medal at the International Mathematical Olympiad (IMO) before 2030; competitive systems matched gold-medal performance by 2025.
The root cause of these serial underestimates lies in the sociological background of the forecasters. Because so many credentialed AI specialists work inside academia, their expectations are anchored to institutional research speeds where projects move at a crawl. They routinely fail to anticipate the sheer velocity of commercial markets when accelerated by hundreds of billions of dollars in private capital.
- **Automated Mathematical Proofs:** 2023 survey of 2,000+ researchers predicted a 22-year timeline; preprint servers were overwhelmed with AI-authored proofs within three years. - **Cybersecurity Exploits:** Autonomous finding and exploiting of vulnerabilities labeled "years away" in 2023; realized in 2024. - **International Mathematical Olympiad (IMO):** Gold-level achievement estimated for 2030 in 2022; achieved in 2025 (five years early).
---
[03:24](https://www.youtube.com/watch?v=xdwFncdu8t0&t=204s) The Physical World Strikes Back: Why Truckers, Jobs, and Power Plants Resisted AI
While experts repeatedly lowballed algorithmic capability in purely digital environments, they made the exact opposite mistake regarding the physical economy and the labor market. Long-standing predictions that commercial trucking would be among the first sectors eliminated by autonomous driving have proven hollow, with widespread driver displacement barely underway. Back in 2020, the World Economic Forum (WEF) estimated that almost 50% of all tasks across the global workforce would be automated by 2025. A follow-up analysis published in 2025 revealed the real-world substitution rate sat at roughly 22%. Practical experiments highlight ongoing limits; attempting to have ChatGPT write an entire script still flounders because the software struggles to distinguish meaningful points from irrelevant trivia—having merely perfected "the important skill of sounding very confident while wasting my time."
The starkest conceptual failure in AI forecasting belongs to Leopold Aschenbrenner and his thesis of an impending "intelligence explosion" arriving by 2027. This speculative scenario depended on generating hundreds of gigawatts of new power by simply drilling more natural gas, using AI-designed robots to construct the gas power plants, while running the AI models on the gas-powered supercomputers assembled by those very robots. The realization that Silicon Valley investors entrusted roughly $30 billion to an individual operating on such circular logic demonstrates how detached tech culture has become from physical logistics.
```mermaid flowchart LR accTitle: Leopold Aschenbrenner's Circular Scaling Logic accDescr: Diagram mapping the recursive feedback loop between gas extraction, power plants, supercomputers, and robot construction. subgraph PhysicalLoop["The Unrealistic Industrial Feedback Loop"] A["Drill for Natural Gas"] --> B["Build 100 GW Power Plants"] B --> C["Power AI Supercomputers"] C --> D["AI Engineers Autonomous Robots"] D -->|"Builds plants & drills wells"| A end ```
The governing principle of technological diffusion is simple: the pace of transformation is governed by physical constraints and institutional friction. Pure software environments—symbolic mathematics, code execution, and manuscript text—offer virtually zero friction, enabling exponential leaps. Conversely, erecting wet labs, building fleets of self-driving hardware, retooling industrial supply chains, laying power lines, and mining raw minerals involve friction that requires decades, not months, to resolve.
- **World Economic Forum Labor Projections:** 2020 estimate projected ~50% workforce task automation by 2025; actual 2025 audit measured 22%. - **Industrial Bottlenecks:** Physical construction, environmental permits, resource extraction, and corporate organizational habits do not scale at the velocity of digital code.
---
[05:05](https://www.youtube.com/watch?v=xdwFncdu8t0&t=305s) The Paper-Reading Revolution and the Future of Science
Recognizing the distinction between digital software fluidity and physical inertia makes it possible to predict the immediate future of research. Anything bound purely to software will advance at breakneck speed, unlocking tasks that were historically impossible due to human cognitive limits. A prime example is literature reconciliation: unifying, cross-indexing, and verifying the entire body of mathematical publications is suddenly feasible.
A vast collection of longstanding puzzles in theoretical physics and sister fields is poised for rapid resolution because the fundamental techniques required to solve them are already scattered across existing papers. The field may not require a once-in-a-century genius: "Maybe physics isn't waiting for a new Einstein, it's just waiting for someone to read all the papers!" Because software access is widely distributed rather than restricted to mega-corporations, independent researchers around the world can participate directly, kicking off a temporary golden age where virtually anyone can make genuine scientific discoveries. Eventually, society will reach the ultimate fork in the road: "Well, then we will either all die, or never work again, depending on whom you ask." Until then, the takeaway from the historical record is plain: "don’t listen to the experts. Follow me for more uninformed opinions."
---
[06:07](https://www.youtube.com/watch?v=xdwFncdu8t0&t=367s) Sponsor: Outskill and OpenAI's GPT-6 Astra Crash Course
With AI accelerating and OpenAI's newly surfaced GPT-6 Astra bringing the field closer to artificial general intelligence (AGI), keeping up with practical toolsets has become essential. Today's sponsor, Outskill, is offering a free three-hour crash course designed to teach participants hands-on workflow development for GPT-6 Astra. As an official partner of OpenAI, Outskill obtained advance access to test the model thoroughly before its public rollout.
The course demonstrates how to build tailored personal and professional systems, such as building targeted job-hunting workflows based on individual resumes or creating automated real-time monitors to track specific stock holdings. Enrollees also receive the Astra Power Playbook, complete with plug-and-play prompt formulas and preconfigured workflows. Viewers can register using the link in the video description or by scanning the on-screen QR code.
## Notable quotes > [01:56](https://www.youtube.com/watch?v=xdwFncdu8t0&t=116s) the new part is that they admit it. — Sabine Hossenfelder
> [03:24](https://www.youtube.com/watch?v=xdwFncdu8t0&t=204s) the important skill of sounding very confident while wasting my time. — Sabine Hossenfelder
> [05:05](https://www.youtube.com/watch?v=xdwFncdu8t0&t=305s) Maybe physics isn't waiting for a new Einstein, it's just waiting for someone to read all the papers! — Sabine Hossenfelder
> [05:05](https://www.youtube.com/watch?v=xdwFncdu8t0&t=305s) Well, then we will either all die, or never work again, depending on whom you ask. — Sabine Hossenfelder
> [05:05](https://www.youtube.com/watch?v=xdwFncdu8t0&t=305s) don’t listen to the experts. Follow me for more uninformed opinions. — Sabine Hossenfelder
## Mentioned Sabine Hossenfelder, OpenAI, GPT 6 Astra, Outskill, Millennium Prize Problems, LiveCodeBench Pro, ChatGPT, International Mathematical Olympiad (IMO), World Economic Forum (WEF), Leopold Aschenbrenner, Albert Einstein
## Video description 👉 Grab your free seat to the GPT 6 Astra Crash Course: https://links.outskill.com/SAHOOCT2 🔐 100% Discount for the first 1000 people 💥 Master GPT 6 Astra, Build Powerful AI Agent Workflows & Unlock the Astra Power Playbook — All for Free! 🎁 Bonuses worth $5100+ if you join and attend
For years, experts have tried to predict how fast artificial intelligence would progress, and they've been wrong again and again. Benchmarks they expected in a decade fell in a year. But in some areas, they got it wrong in the opposite direction. Let's take a look.
#artificialintelligence #technology #sciencenews
👕T-shirts, mugs, posters and more: ➜ https://sabines-store.dashery.com/ 💌 Support me on Donorbox ➜ https://donorbox.org/swtg 👉 Transcript with links to references on Patreon ➜ https://www.patreon.com/Sabine 📝 Transcripts and written news on Substack ➜ https://sciencewtg.substack.com/ 📩 Free weekly science newsletter ➜ https://sabinehossenfelder.com/newsletter/ 👂 Audio only podcast ➜ https://open.spotify.com/show/0MkNfXlKnMPEUMEeKQYmYC 🔗 Join this channel to get access to perks ➜ https://www.youtube.com/channel/UC1yNl2E66ZzKApQdRuTQ4tw/join 📚 Buy my book ➜ https://amzn.to/3HSAWJW
[Source](https://www.youtube.com/watch?v=xdwFncdu8t0)