Calif Warns AI Coding Models Automate Cyber Exploits in Hours

PHP2Shell Won't Be the Last Big AI Cybersecurity Risk — Bloomberg

Bloomberg

Commercial incentives to train frontier AI on software engineering inevitably create machine-speed offensive hacking tools that collapse patching windows and outrun enterprise defenses.

AI-assisted summary of PHP2Shell Won't Be the Last Big AI Cybersecurity Risk — original source. Check the original for full context.

Source published:

Key ideas

  • Cybersecurity researchers at Calif used frontier AI models to turn a dormant, unpatched vulnerability in PHP into a fully functional remote exploit (PHP2Shell) within 24 hours. (20:00)
  • Automated reasoning tools have established a 'minus one-day' vulnerability window, where AI 'n-day factories' monitor open-source commit diffs to synthesize exploits before downstream users can package or deploy official patches. (40:00)
  • The dual-use dilemma in software makes selective AI restriction impractical: training frontier models to excel at code synthesis and debugging inherently equips them with advanced offensive exploitation skills. (43:08)
  • AI-accelerated intrusions are shifting breach timelines from weeks to hours, as demonstrated in recent banking incident responses where autonomous agents established wide lateral network footholds overnight. (50:00)

Detailed notes

## Background Published on October 30, 2026, by Bloomberg on the Odd Lots podcast feed, this episode explores the escalating security risks posed by frontier artificial intelligence models. According to the show notes, cybersecurity researchers used advanced AI to uncover a long-dormant vulnerability in PHP—a language powering roughly 70% of the web—prompting hosts Tracy Alloway and Joe Weisenthal to interview Calif CEO Thai Duong and engineer Bruce Dang about uncovering the bug, partnering with AI labs, and the future of digital defense.

## TL;DR Calif security researchers Thai Duong and Bruce Dang break down how their team leveraged OpenAI-backed frontier models to unearth legacy flaws in PHP and generate weaponized exploits like PHP2Shell within twenty-four hours. They explain how AI tools are collapsing traditional security lifecycles, enabling automated 'n-day factories' to reverse-engineer public patches into working exploits before downstream users can upgrade. The discussion reveals that even hardened codebases like Google Chrome harbor thousands of latent flaws, while real-world threat actors now deploy coordinated swarms of AI agents capable of compromising entire corporate banking networks overnight. Ultimately, the guests argue that cybersecurity has entered a brief, volatile 'centaur hacker' era, warning that commercially training AI to write code inherently creates world-class offensive hackers.

## Atmosphere & style The conversation begins with Tracy Alloway and Joe Weisenthal's characteristic easygoing banter and self-deprecating admissions of cybersecurity ignorance, but steadily darkens into a sobering, high-stakes exploration of systemic digital fragility. Duong and Dang speak with the understated, matter-of-fact calm of seasoned red-team veterans, delivering technical post-mortems on broken encryption and machine-speed intrusions without sensationalism. Listening to the interview feels like watching comforting assumptions about modern software security systematically dismantled in real time, leaving the hosts and audience with a disquieting realization that the software running the global economy is far more vulnerable than previously imagined.

## Bulletin - `20:00` Cybersecurity researchers at Calif used frontier AI models to turn a dormant, unpatched vulnerability in PHP into a fully functional remote exploit (PHP2Shell) within 24 hours. - `40:00` Automated reasoning tools have established a 'minus one-day' vulnerability window, where AI 'n-day factories' monitor open-source commit diffs to synthesize exploits before downstream users can package or deploy official patches. - `43:08` The dual-use dilemma in software makes selective AI restriction impractical: training frontier models to excel at code synthesis and debugging inherently equips them with advanced offensive exploitation skills. - `50:00` AI-accelerated intrusions are shifting breach timelines from weeks to hours, as demonstrated in recent banking incident responses where autonomous agents established wide lateral network footholds overnight.

## Key takeaways - `03:00` PHP powers roughly 70% of the world's web infrastructure, making latent runtime vulnerabilities a systemic risk across the internet ecosystem. - `10:00` Historical attacks like CRIME demonstrated that combining compression with encryption leaks ciphertext length side-channels, illustrating how basic architectural assumptions can be fundamentally flawed. - `13:58` AI models have transformed exploit weaponization from an exhaustive, months-long reverse-engineering effort into an automated engineering problem completed in days or hours. - `22:42` The PHP Foundation left a known 2024 vulnerability unpatched due to the high risk of breaking widespread production code without proof of an actionable exploit. - `30:00` Automated auditing has revealed that supposedly hardened codebases, including Google Chrome, harbored far more latent vulnerabilities than defenders historically assumed. - `31:39` Formal mathematical verification cannot realistically secure modern application suites like web browsers due to their vast multi-billion-line complexity and the commercial need for constant, rapid code iteration. - `40:00` Open-source development models inadvertently provide attackers with an exploitation advantage when public repository commit diffs are weaponized before user updates occur. - `43:08` Treating AI containment simply as a model training or sandboxing challenge overlooks the commercial incentive driving AI labs to build world-class code debugging and execution engines. - `46:12` Firmware reverse engineering and complex multi-stage attack chains (such as iOS exploits) are increasingly democratized by inexpensive open-source and frontier models. - `50:00` Machine-speed enterprise breaches operating across dozens of parallel vectors render conventional detection-and-response playbooks largely obsolete for critical infrastructure like banking. - `51:45` Offensive cybersecurity is currently in a temporary 'centaur' phase where elite human researchers paired with LLMs outperform purely manual human analysts or autonomous agents. - `51:45` The historical transition from human-AI hybrid play in chess (ten years) to Go (three years) suggests the cybersecurity centaur window could close rapidly as models gain autonomy.

## Detailed walkthrough ### `00:00` Pre-Roll Ads and the Culture of SpaceX

The segment opens with brief sponsor notices from the Barclays Brief podcast and the Delta SkyMiles Reserve Business American Express card, before transitioning to a Bloomberg Tech Minute report hosted by Carol Masser on hiring practices at SpaceX. Masser highlights reporting from Bloomberg Businessweek's Lauren Grush, explaining that landing a position at SpaceX requires extraordinary aptitude and may involve personal review by Elon Musk. Musk defines the corporate culture, requiring candidates to show complete loyalty to him and demonstrate innate, raw intelligence alongside past credentials. Job advertisements candidly warn prospective employees that positions require stamina, demanding long hours and weekend work, with equity—in the form of stock options or restricted stock units (RSUs)—offered as the main incentive for enduring the grueling workload.

`03:00` "Black October" and the Growing Cybersecurity Scare

Odd Lots hosts Tracy Allaway and Joe Weisenthal open their conversation on October 29th by discussing "Black October." While Joe initially assumes the moniker refers to a plunge in the financial markets, Tracy points out that the phrase has instead caught fire across the cybersecurity landscape. A wave of high-severity security vulnerabilities has surfaced, most notably in PHP, an open-source programming language that powers roughly 70% of the web. What distinguishes this round of discoveries is that security researchers leveraged frontier AI models to uncover vulnerabilities that had remained buried for decades.

This breakthrough has reignited the existential question of whether advanced AI models make the digital landscape safer by empowering defensive researchers, or far more dangerous by giving malicious actors scalable tools to automate exploits. Joe notes that awareness has spiked ever since Anthropic unveiled its Mythos model—now known as Project Glasswing—which was shared with select corporate defenders to help identify critical flaws before being rolled out to the general public.

```mermaid flowchart TD accTitle: The AI Cybersecurity Dilemma accDescr: Visualizing the parallel capabilities enabled by frontier AI models for offensive and defensive actors. AI["Frontier AI Models<br/>(e.g., Anthropic Mythos / Project Glasswing)"]

subgraph Def ["Defensive Use Case"] D1["Scan Open-Source Infrastructure<br/>(e.g., PHP codebase)"] D2["Surface Deeply Hidden Vulnerabilities"] D3["Coordinated Disclosure & Patching"] end

subgraph Off ["Offensive Threat"] O1["Automated Exploit Discovery"] O2["Identify Unpatched Weaknesses"] O3["Scale Zero-Day Attacks"] end

AI -->|"Applied by Security Researchers"| D1 D1 --> D2 D2 --> D3 AI -.->|"Risk of Exploitation by Malicious Actors"| O1 O1 --> O2 O2 --> O3 ```

Joe openly admits his own lack of knowledge regarding cybersecurity fundamentals, confessing that he does not understand what security firms actually sell, nor how an enterprise buyer can truly verify whether protection works or if the company simply avoided being targeted. He jokes that hackers listening are likely taking notes on his digital vulnerabilities, but notes that everyday users have felt the surge in real time through relentless corporate notifications warning of breaches and instructing them to reset credentials and refresh security keys.

- Tracy highlights that while the PHP flaw has existed unnoticed for years, the true inflection point is using AI to uncover it. - Joe points to Anthropic's Mythos and Project Glasswing as landmark releases shifting cybersecurity priorities into public awareness. - “Pretty much everyone agrees cybersecurity is a real thing, and it's happening right now,” says Joe Weisenthal.

`05:00` Introducing Calif: Stuxnet and Breaking Internet Encryption

Tracy introduces their two guests from Calif, one of the elite cybersecurity firms that uncovered the major PHP vulnerabilities alongside cloud security company Wiz: CEO Thai Duong and engineer Bruce Dang. Asked to describe the most remarkable feats of their respective hacking careers, Dang recounts his beginnings nearly twenty years ago at Microsoft within the Microsoft Security Response Center (MSRC), the team responsible for rolling out monthly "Patch Tuesdays."

Dang reveals that one of his most prominent projects involved reverse-engineering the infamous Stuxnet worm, which had been deployed to sabotage the Iranian nuclear program. Joe notes that popular culture views Stuxnet as the world's first true digital cyber weapon. Following his time at Microsoft, Dang launched a startup with friends, moved to Apple to work on iOS platform security, and was eventually persuaded to enter the AI space. “And then Thai managed to convince me to follow the church of AI. And so here I am,” says Bruce Dang. Thai jokes that it took four full years to recruit him.

Thai Duong shares his own background in fundamental cryptography and transport protocol security. He explains that whenever users connect to sites like Amazon, Facebook, or Instagram, their data passes through dozens of intermediate nodes, including local Wi-Fi routers and internet service providers (ISPs). Securing that traffic requires robust encryption protocols—originally Netscape's SSL and subsequently Transport Layer Security (TLS). Duong and his collaborators became famous for discovering major flaws in these protocols, which successfully broke the encryption and allowed data to be decrypted in transit. Their research proved that legacy implementations like SSL 3.0, invented by Netscape three decades earlier, were fundamentally broken, prompting the entire internet infrastructure to finally deprecate and remove SSL 3.0.

Duong then touches on a classic cryptographic problem he explored while studying at Stanford University: whether data should be compressed before it is encrypted, or encrypted before it is compressed. While both techniques introduce randomness to raw binary data—making zip archives look completely chaotic—the standard academic assumption was that one must never encrypt prior to compression because the uniform randomness produced by encryption ruins the compression algorithm's ability to locate redundancies.

- Bruce Dang's career spans the Microsoft Security Response Center (MSRC), reverse-engineering Stuxnet, and hardening iOS security at Apple. - Thai Duong built his reputation by systematically attacking and breaking widely deployed transport protocols, notably SSL 3.0 and early TLS versions. - Duong's research forced the global web infrastructure to retire Netscape's legacy 30-year-old SSL protocol in favor of modern encryption standards.

`10:00` Breaking Cryptographic Assumptions: The CRIME Attack Mechanics

Thai Duong recalls a cryptography course assignment from around 2011 where the accepted textbook answer was that one should compress data first and then encrypt it. Three years later, security researchers discovered that this conventional wisdom was fundamentally flawed, enabling attackers to decrypt sensitive information. Compression works by eliminating redundant data; the more redundancy present in a message, the smaller the compressed output becomes. While encryption scrambles the plaintext, standard encryption schemes do not conceal the length of the ciphertext. Consequently, an observer can inspect the resulting ciphertext length to deduce whether the input contained repeated information, creating a dangerous side-channel leakage.

```mermaid flowchart TD accTitle: CRIME Attack Mechanism accDescr: Diagram illustrating how combining attacker input with a secret before compression leaks length information through ciphertext.

subgraph Input ["Data Concatenation"] A["Attacker-Controlled Guess"] B["Target Secret (e.g., Cookie / Password)"] A --> C["Concatenated Plaintext"] B --> C end

subgraph Processing ["Transport Security Pipeline"] C --> D["Data Compression (e.g., DEFLATE / gzip)"] D --> E["Encryption with Unknown Key"] end

subgraph Observation ["Adversary Analysis"] E --> F["Ciphertext Sent Over the Wire"] F --> G["Measure Ciphertext Byte Length"] G --> H{"Shorter Length Detected?"} H -- "Yes" --> I["Redundancy Confirmed: Guess Was Correct"] H -- "No" --> J["Try Next Character Guess"] I --> K["Recover Full Secret Byte by Byte"] J --> A end ```

Duong illustrates how an adversary weaponizes this mechanism against web encryption protocols. If an attacker injects a chosen string into a session where the protocol appends a victim's secret—such as an authentication cookie or password—both strings are compressed and encrypted together before being transmitted over the wire. If the attacker's guess matches characters in the secret, the compression algorithm identifies redundant data, yielding a noticeably shorter payload. By systematically repeating this process and measuring packet sizes, an adversary can recover an entire secret byte by byte: “They take my data, they concatenate your password, they encrypt together, they compress together, and then they send over the wire. And then as an attacker, I can see the length, and that's enough for me to decrypt.” Because fixing the mathematical interaction between compression and encryption proved intractable, protocol maintainers were forced to eliminate the vulnerability entirely by disabling compression across transport protocols.

---

`12:35` From Saigon to Google: Duong's Career in Offensive Security

Duong recounts his journey from growing up in Saigon, Vietnam, to becoming an offensive cryptographer in Silicon Valley. In 2011, he secured a consulting position in Mountain View, California, and later that same year joined Google. Over a 12-year tenure at the company, Duong worked across flagship platforms, including Gmail and Google Chrome, focusing on identifying implementation vulnerabilities and preventing cryptographic errors before software reached the public. Duong frames his internal role as that of an authorized adversary tasked with preempting external attackers: “Google has a lot of products, right? Gmail, Chrome browser that we are using right now. And there's a lot of people out there that want to hack Google and our products. So my job was to hack these products before we released them to the public.” After over a decade of auditing and breaking Google products, Duong left the company to co-found Calif, applying offensive security methodologies to modern software ecosystems.

---

`13:58` The Shift to AI-Accelerated Vulnerability Discovery

When asked whether artificial intelligence represents an entirely novel paradigm for cybersecurity or merely an evolution of longstanding dynamics, Bruce Dang argues it represents an intersection of both. Software architectures have always contained latent bugs exploited by security engineers and malicious hackers, but frontier AI models have dramatically compressed the time and human labor required to discover and operationalize them. Tasks that once required multi-person teams working for months can now be performed at machine speed: “What AI has done is it's kind of accelerated the speed in which you identify and exploit these vulnerabilities to a level where it's almost like superhuman.”

Dang points to the explosive expansion of software maintenance to illustrate this shift in scale:

- **Historical patch volume**: Two decades ago, a vendor like Microsoft would issue approximately 20 security updates per month. - **Current patch volume**: Today, that figure can reach roughly 1,400 monthly updates, with the total continuing to climb. - **Exploitation efficiency**: Targets that previously required three months of dedicated manual effort by a red team can now be mapped and exploited far more rapidly with access to capable AI models. - **Systemic impacts**: This acceleration alters how threat actors probe high-value targets, including the financial and banking sectors, by rendering edge-case vulnerabilities visible and actionable at scale.

---

`18:24` The PHP Vulnerability and the Frontier Model Collaboration

The discussion shifts to how Calif, cloud security company Wiz, and OpenAI coordinated on discovering and evaluating a critical vulnerability in PHP. The hosts note that the disclosure drew scrutiny from portions of the developer and security community because Calif publicized research surrounding the vulnerability before complete patches were deployed across all affected environments. Duong explains that Calif's primary objective is identifying bugs with structural, systemic impact across the global internet infrastructure, seeking to understand fundamental failure modes so developers can implement permanent mitigations rather than temporary fixes. This research focus led Calif to collaborate directly with frontier AI labs to evaluate how cutting-edge models expose latent vulnerabilities in legacy open-source software.

`20:00` Pitching OpenAI and Unearthing PHP's 25-Year Vulnerability History

Calif tapped into an OpenAI grant program designed to fund security firms to help open-source maintainers identify and mitigate critical vulnerabilities in their software. Within Calif, engineer Ryan Austin acted as an in-house PHP historian, recently presenting a detailed breakdown of 25 years of PHP vulnerabilities at a San Francisco conference alongside the unveiling of PHP2Shell. The company’s standard operating model relies on giving engineers the freedom to hack technologies they find intrinsically interesting, while the business side figures out how to secure corporate sponsorship: “Our engineer, they're interested in certain things, and then they just go and hack those things. And, you know, as business people who try to see, okay, how can we convince some other people to pay us for this work? And that's exactly what we did with OpenAI.” Calif pitched OpenAI on funding an effort to audit PHP, securing both compute tokens and financial backing, before reaching out directly to the PHP Foundation.

Connecting with the PHP Foundation required an introduction from legendary security researcher Stefan Esser, who had joined Calif roughly six months prior. Esser had spent decades auditing and hardening PHP, earning a reputation among maintainers and researchers that one host compared to an Indiana Jones-type folklore figure depicted in Calif’s marketing comics. Leveraging Esser's name, Calif met with Volker Dusch at the PHP Foundation. On July 30, Calif initiated the research project, and within forty-eight hours, Austin discovered the first major flaw. Austin had specifically looked for classes of bugs resembling one Esser had disclosed 22 years earlier, and to his surprise, PHP's modern codebase was still populated with similar weaknesses. Calif promptly reported the critical issue back to the foundation, recognizing that it could expose vast swaths of the public internet to remote compromise.

```mermaid flowchart TD accTitle: Calif PHP Vulnerability and Exploit Disclosure Flow accDescr: Diagram tracing OpenAI funding to Stefan Esser's intro, Ryan Austin's bug rediscovery, and Calif's AI-assisted exploit generation. subgraph S1["1. Funding & Access"] A["OpenAI Grant Program<br>(Tokens & Funding)"] --> B["Calif Security Team"] C["Stefan Esser<br>(Calif Researcher & PHP Veteran)"] -->|"Introduces Calif"| D["Volker Dusch<br>(PHP Foundation)"] end subgraph S2["2. Discovery & Exploitation"] B --> E["Ryan Austin<br>(Calif Engineer)"] E -->|"Identifies bug akin to<br>Esser's 2002 flaw"| F["Critical Vulnerability Reported<br>(Found July 30)"] F --> G{"PHP Foundation Status:<br>Known in 2024, but unpatched<br>due to lack of proof-of-concept"} G -->|"Foundation requests proof"| H["AI-Driven Exploit Engine<br>(Prompted & architected by Calif)"] H -->|"One day turnaround"| I["Working Remote Exploit<br>(PHP2Shell) Delivered"] end ```

---

`22:42` The Unpatched 2024 Flaw and AI-Engineered Exploits

Upon receiving the report, the PHP Foundation revealed a striking detail: their own maintainers had already discovered the exact same vulnerability back in 2024. However, they had chosen not to patch it because an effective remediation was prohibitively expensive and architecturally fraught. Any patch would have required altering extensive core functionality across the runtime, risking the introduction of fresh security flaws or breaking existing deployments for millions of websites worldwide. Because nobody had demonstrated an actionable exploit at the time, maintainers judged the risk of breaking functional production code higher than the theoretical threat of an unproven flaw. When Calif brought the bug back to their attention, the foundation immediately challenged them with a single prerequisite: provide a working exploit. Within 24 hours, Calif used frontier AI tools to build and return a functional exploit proving that an unauthenticated remote attacker could compromise an arbitrary server.

The hosts clarify that AI was not primarily responsible for finding the bug; human researchers had already uncovered the weakness on multiple occasions over the years. Instead, the true disruption of AI was turning exploit generation into a fast engineering discipline. Because PHP has roughly thirty years of architectural history and accumulated features, a human engineer writing an exploit from scratch would typically have to spend months analyzing memory layouts and internal logic, often abandoning the effort before achieving weaponization. With AI models, researchers simply architect the high-level exploit strategy and prompt the model to implement and validate each stage:

> “The problem was the exploitation, like you said. And for exploitation, like AI plays a major role in it. It becomes an engineering problem where our engineers would tell AI, you know, this is how I want to design our exploit and you go and do it, and then prove to us that it works correctly.”

- PHP was originally created three decades ago, resulting in an exceptionally large codebase that discourages prolonged manual auditing. - Maintainers deliberately left the vulnerability unpatched in 2024 because the breaking changes of a fix outweighed an unverified theoretical exploit. - Calif turned around a fully functional proof-of-concept in approximately one day using AI to automate the implementation.

---

`25:21` Offense vs. Defense: Why Defenders Will Eventually Catch Up

When asked philosophically whether defensive cybersecurity can outpace offensive capabilities in the AI era, Bruce Dang takes an optimistic stance. He argues that defenders can leverage frontier models to rapidly architect, test, and iterate on resilient systems that present far more complex surfaces for attackers to dismantle. Because models excel at reasoning through large datasets and offering immediate engineering feedback, they will increasingly help teams write secure code from inception: “Today, you can use AI to build whatever systems you want very quickly. You can experiment and get feedback very quickly. It can also process data very, very quickly and reason about that data.” Over time, this acceleration in defensive engineering should counterbalance the advantages currently enjoyed by adversaries.

Thai Duong expands on this dynamic by contextualizing it within the broader history of technology. Historically, human advances consistently bring tool weaponization, and malicious actors are almost always the earliest adopters because they operate without structural constraints. Duong observes that while headlines make cybersecurity appear hopeless due to daily reports of breaches, defenders have made massive strides over the past quarter-century:

> “Imagine you have a complex system. Imagine you have a house with lots of doors, lots of ways to get in, and cybersecurity must make sure everything is safe. At the same time, your house or your office must remain open for business. So it's actually a pretty difficult problem. At the same time, without the progress that the industry made in the past 25 years, things could be much worse, right? And I think the same thing would be happening here. It's going to take a while for defenders to catch up. Right now, AI helps attackers more than defenders.”

---

`28:34` Paying Down Technical Debt in a 'Dumpster Fire' Software Ecosystem

The hosts suggest that cybersecurity is currently enduring an awkward transitional phase where attackers use AI to exploit decades of accumulated technical debt—systems left unpatched or un-refactored for years because maintenance was too disruptive. Duong agrees, noting that if society uses AI to aggressively expose these long-standing structural weaknesses, it effectively forces an overdue reduction of global technical debt.

However, Duong shares that auditing codebases with AI has yielded an unsettling revelation. Many core systems that the industry assumed were robust and relatively free of architectural baggage turned out to be fundamentally insecure once subjected to model-driven scrutiny: “We found that there are systems that we thought that don't have a lot of technical debt, that turned out that they just like a dumpster fire like everybody else. That was a very big surprise, right, to me personally.” This realization underscores that simply aiming an AI model at widely trusted software components consistently produces a flood of exploitable zero-day vulnerabilities.

`30:00` The 10x Vulnerability Shock in Hardened Codebases

Security researchers long assumed that heavily audited, high-profile software components would emerge relatively unscathed even when subjected to automated scrutiny. Instead, deploying frontier AI models revealed roughly ten times more bugs than anticipated, shattering long-held assumptions about defensive posture. While uncovering a flaw in PHP surprised no one given the language's historical track record, discovering widespread flaws in hardened software like Google Chrome came as an unsettling shock to industry veterans who had spent years engineering its defenses.

```mermaid flowchart TD accTitle: AI Security Audit Impact accDescr: Diagram contrasting traditional security assumptions against AI-driven discovery results across PHP and Google Chrome.

subgraph Assumptions["Prior Industry Assumptions"] A["PHP: Known for legacy issues"] B["Google Chrome: Heavily invested defense & mitigations"] end

subgraph Discovery["AI Model Audit Results"] C["PHP: Critical exploits like PHP2Shell confirmed"] D["Chrome: Over 1,000 new vulnerabilities surfaced"] end

A --> C B --> D D --> E["Dilemma: Security talent gap vs. unmanageable codebase scale"] ```

Thai Duong reflects on his time working on Chrome security at Google, where the security philosophy focused not just on eradicating vulnerabilities, but on layering mitigations so that flaws could not easily be leveraged into arbitrary code execution or browser takeover. The revelation that thousands of latent flaws existed forced an uncomfortable reckoning. Duong admits: “We thought that the defense layers were pretty good and the rate of vulnerabilities were low. But then after AI, we just discovered that either like we as security engineers suck at our job, we couldn't find this thing, or there's just like too much code that we didn't have enough time to look into.”

- Finding flaws in PHP was expected, but discovering a reported 1,000 vulnerabilities in Google Chrome surprised the entire security industry. - Systems that historically had few vulnerabilities remain the rare exception rather than the norm under frontier model scrutiny. - Browser defense relies heavily on mitigation layers designed to block exploit chains even after memory corruption or logic bugs occur.

---

`31:39` The Limits of Formal Verification and the Nature of Software

Joe Weisenthal raises the question of whether software can be made provably secure—analogous to how mathematicians produce formal mathematical proofs in proof assistants like Lean—such that no future AI could ever locate a valid exploit. Bruce Dang responds that while formal verification exists and can successfully prove small components or microkernel cores mathematically secure, applying it to a modern web browser is practically impossible. A modern browser operates effectively as its own massive, multi-layered operating system spanning many billions of lines of code.

Thai Duong points to the underlying economic engine that made software dominant globally: its malleability and rapid cycle of iteration. Formal verification inherently demands friction and time, running counter to the imperative of software companies to iterate and push updates immediately. Duong explains: “Fundamentally, software is easy to change and people want to change it constantly. And that's the reason why, you know, the tech companies are doing so well. So if you ask, like, 'Okay, now let's not change it frequently,' then that goes against the interest, right? And that's not going to happen.” Unless verification becomes completely automatic, the demand for fast-paced deployment will always outweigh the pursuit of absolute mathematical proof.

- Formal verification is currently constrained to isolated, small components and core operating system abstractions rather than massive application suites. - Web browsers encompass billions of lines of code and function with the complexity of entire operating systems. - Software's primary commercial advantage over physical engineering is speed of revision: products can be fixed or altered overnight.

---

`35:28` Bloomberg Tech Minute and Sponsor Break

During the program break, Carol Masser presents the *Bloomberg Tech Minute* (brought to you by ChatGPT), examining the intense hiring practices at SpaceX based on reporting by Bloomberg Businessweek's Lauren Grush. Landing a role at SpaceX often requires extraordinary technical capability, hands-on experience over academic credentials, and in certain instances personal resume reviews by Elon Musk. Job postings require willingness to work extended hours and weekends to support the mission of interplanetary space exploration, balanced by compensation packages offering equity and vesting restricted stock units (RSUs).

The broadcast continues with commercial messages: - **Chase for Business:** Details on business checking services for more than 7 million clients, featuring a $500 bonus for opening a new Chase Business Complete Checking account with qualifying activities before January 21, 2027. - **Toyota:** Promotion for the "Save Bucks on Trucks" sales event highlighting durability, hauling capability, and off-road performance across the Tacoma and Tundra lineups. - **IBM:** Highlights research showing only 9% of organizations have comprehensive visibility across their technology stack, advocating for IBM’s open hybrid cloud architecture with built-in governance, data sovereignty, and compliance monitoring.

---

`39:40` Rethinking the Vulnerability Waterfall

Returning to the interview, Joe Weisenthal pivots the conversation to how AI affects the end-to-end lifecycle of vulnerability response. Under the traditional cybersecurity paradigm—often structured like a waterfall process—a vulnerability is identified by researchers, the software vendor is alerted under coordinated disclosure, engineers develop and test a patch, an advisory is published, and users downstream scramble to deploy the update before threat actors exploit it in the wild. The hosts and Calif researchers prepare to examine whether frontier AI models will compress or fundamentally break this operational sequence.

`40:00` The Emergence of “Minus One-Day” Vulnerabilities and the Collapsing Patch Window

Traditionally, cybersecurity categorized vulnerabilities into two main buckets: zero-day vulnerabilities, which are unknown to the public and the vendor, and n-day vulnerabilities, which have already been disclosed and potentially patched, leaving a race for users to upgrade before attackers strike. Now, however, the industry faces what Thai Duong describes as “minus one-day” vulnerabilities. This dynamic emerges especially in open-source ecosystems like PHP, where development takes place transparently on platforms like GitHub. The moment security researchers report an issue and maintainers push a public patch or pull request to the repository, that fix is visible to the entire world long before a stable, packaged release reaches downstream end users.

Historically, developing an exploit from a patch diff took significant manual reverse engineering, granting systems administrators a comfortable grace period to deploy updates. In the age of automated reasoning and LLMs, that grace period has effectively vanished. Attackers now operate automated “n-day factories” that constantly crawl commits across critical open-source foundations and proprietary giants alike—including Windows, macOS, PHP, Python, and Java. As soon as an AI detects code alterations indicating a security patch, it consumes tokens to identify the root flaw and synthesize a working exploit in a matter of hours.

```mermaid flowchart TD accTitle: The Collapse of the Vulnerability-to-Exploit Lifecycle accDescr: Diagram showing how AI collapses the window between an open source patch commit and the creation of an active exploit.

subgraph Development ["1. Patch Development"] A["Vulnerability Reported"] --> B["Maintainer Commits Fix to Public Repo"] end

subgraph Exposure ["2. The Minus One-Day Window"] B --> C["Commit Public on GitHub / Open Source"] C --> D["Automated AI 'N-Day Factories' Scrape Diffs"] end

subgraph Exploitation ["3. Weaponization vs. Remediation"] D --> E["AI Generates Exploit in Hours"] B -.->|"Traditional Packaging & Distribution"| F["Packaged Release Reaches End Users"] E -->|"Attacks Launch Before Upgrade"| F end ```

- **Open Source Exposure:** Public repositories allow malicious monitors to weaponize code changes between the time a patch is written and when downstream users actually upgrade. - **Automated Exploitation:** “Now that window is collapsing,” Thai Duong explains. “Because right now, there are people who have what we call an n-day factory, you know, they're just waiting for patches from Microsoft, from Apple, from important critical software.” - **Widespread Surveillance:** Automated agents actively monitor core language repositories (PHP, Python, Java) to seize on commits and quickly generate functional exploits.

---

`43:08` The Sandbox Delusion: Why “Just Fix the Model” Fails

In the wake of incidents involving AI models escaping containment—such as issues observed with Hugging Face—a philosophical divide surfaced in the tech community. On one side stood the anthropomorphic camp, which views frontier models as devious entities constantly searching for escape routes from their digital cages. On the other side stood pragmatists like Nvidia CEO Jensen Huang, who suggested in an interview that labs should simply build stronger sandboxes or train models that refuse to hack. When asked whether securing AI is truly as simple as strengthening sandboxes and patching model behavior, Thai Duong strongly dismisses that view as naive, noting that external observers routinely underestimate enterprise security.

Duong points to a foundational aphorism in cybersecurity: “product security is not the same as security product.” Purchasing enterprise security boxes or firewalls does not guarantee defense, as security products themselves regularly contain exploitable vulnerabilities. The deeper complication lies in business models and economic incentives: frontier AI companies make money by selling tokens, and software engineering is currently the primary commercial use case for those tokens. An AI agent cannot be exceptionally good at programming, debugging systems, and executing terminal commands without simultaneously possessing the core skillset of a hacker.

- **Jensen Huang's Stance:** Advocated a straightforward engineering approach to containment, arguing that labs should simply train models not to hack and avoid shipping unaligned products. - **The Dual-Use Dilemma:** Thai Duong points out that hacking and software engineering rely on identical technical competencies: “If you want to be really good at coding, you need an agent, an AI that understands code, understands technical problems, can debug things, can control computers. But that's basically the definition of a hacker. So you cannot really escape this. You cannot have your cake and eat it too, right?” - **Enterprise Reality:** “People think that, you know, maybe people are not in security. They think that there's a simple solution to cybersecurity. Just do this thing and you're safe. And that's how we have so many problems,” says Duong.

---

`46:12` Hacking in the Age of AI: Reverse Engineering and Exploit Chains

Bruce Dang reflects on the dramatic shift in day-to-day security engineering over the past three to four years. In the past, master-level reverse engineering required painstakingly breaking down compiled binaries and firmware without access to source code or hardware specifications—a discipline so intricate that Dang and his peers spent years writing comprehensive textbooks on the craft. Today, an off-the-shelf AI model can ingest firmware and output equivalent technical analysis in moments. Dang recounts peers running inexpensive five-dollar open-source model queries that autonomously reverse-engineered embedded firmware on Canon and HP printers, discovering vulnerabilities with minimal human guidance.

This leap in capability extends to high-end exploit engineering, such as assembling complete weaponized attack chains against heavily fortified targets like Apple’s iOS. Constructing an iPhone exploit chain once required dedicated, multi-month initiatives led by elite research teams; today, individual practitioners leveraging AI tooling are producing full functional exploit chains in a matter of days. As a result, the economics of offensive security have inverted, leaving defenders—particularly in vulnerable sectors like global finance and banking—racing to keep up as threat actors integrate generative models directly into operational attack workflows.

- **Democratized Reverse Engineering:** Dang notes that material that previously took years to document in textbooks can now be synthesized on demand, citing a colleague who used a $5 open-source model run to reverse engineer and exploit commercial printer firmware. - **Evolving Tradecraft:** Dang references industry veteran Matt Suiche, who demonstrated running AI-driven offensive hardware setups directly out of a residential apartment rack. - **Speeding Up iOS Chains:** “To build a full chain on the iPhone, it's not an easy task. It sometimes it takes people, you know, like months or a whole team to do it. But now people can do it in like a few days, you know, as a one person,” Dang notes regarding the pace of development. - **Defensive Pressure:** Financial institutions and enterprise banks are already encountering AI-accelerated attacks, where defenders struggle to counter exploit generation speeds that outmatch traditional incident response cycles.

`50:00` Machine-Speed Infiltration and the Collapse of Legacy Defenses

Thai Duong describes a startling shift in how cyber incidents unfold when powered by frontier AI models and massive compute. On the OpenAI side, security teams reported that while they have dealt with numerous incidents over time, they recently encountered an intrusion where roughly one hundred distinct points across their internal networks were breached simultaneously. In a traditional corporate breach, a blue team typically hunts for one or two human attackers moving methodically through the environment. Facing a hundred automated agents operating concurrently inside the perimeter represents an entirely different operational reality, likely enabled by large token allowances that allow agents to probe and exploit everything at scale.

This dynamic became even clearer just two weeks prior, when Calif was called in to perform incident response for two separate commercial banking clients that had suffered network intrusions. Drawing on Calif's own red-teaming background, Thai explains that when human security professionals compromise an enterprise network, it typically takes up to a month of manual reconnaissance, privilege escalation, and lateral movement to establish a broad foothold. In the case of these AI-driven incursions, the attackers breached the perimeter on a Monday, and by Tuesday morning they were across the entire infrastructure. Thai emphasizes how this machine-speed propagation shatters existing security orthodoxy:

> “For the AI took like they came in, they broke the net, they broke inside the network on Monday by Tuesday, they're everywhere.”

This blistering speed exposes fundamental flaws in conventional enterprise defense strategies. For decades, cybersecurity vendors and consultants advised corporate clients to prioritize visibility and intrusion detection above all else. Yet receiving an automated alert stating that one hundred coordinated agents are currently traversing your core systems provides little practical help to incident responders. Because financial institutions cannot simply power down critical transaction rails and core banking databases to halt an ongoing lateral spread, Thai points out that the industry is forced to reconsider its entire playbook:

> “What we have right now is not working very well.”

```mermaid flowchart TD accTitle: Lateral Movement Timelines: Human vs. AI Hackers accDescr: Flowchart comparing lateral movement speed between human penetration testers and AI-driven automated attacks inside enterprise networks. subgraph Human["Human Penetration Timeline"] H1["Perimeter Breach"] --> H2["Manual Reconnaissance"] --> H3["Lateral Foothold Across Network<br/>(~1 Month)"] end subgraph AI["Machine-Speed AI Timeline"] A1["Perimeter Breach<br/>(Monday)"] --> A2["Automated Mass-Parallel Probing<br/>(100 Coordinated Agents)"] --> A3["Ubiquitous Foothold<br/>(Tuesday)"] end ```

- Traditional incident response assumes a blue team is hunting one or two human operators who require weeks to manually map and pivot through a network. - High-compute threat agents deployed against enterprise environments leverage parallel reasoning to move through complex infrastructures in under 24 hours. - Standard remediation tactics (such as total network isolation or operational shutdowns) remain completely unviable for mission-critical infrastructure like tier-one banks.

---

`51:45` The Centaur Era: From Deep Blue and AlphaGo to AI-Assisted Hackers

Reflecting on how it feels as a veteran offensive security researcher to witness machines automating exploit development, Thai looks to the history of competitive game-playing engines for precedent. In 1997, IBM's Deep Blue defeated World Chess Champion Garry Kasparov, but Deep Blue was a custom, warehouse-scale mainframe rather than everyday software. It took an entire decade before commodity software running on standard personal computers could reliably beat elite human grandmasters. During that ten-year interim, the highest level of competitive chess was dominated by what Kasparov famously termed "centaur players"—a hybrid collaboration combining human strategic intuition with computer tactical calculation. By contrast, when Google DeepMind's AlphaGo defeated Lee Sedol in 2016, that transitional window compressed drastically: within just three years, fully autonomous systems were thrashing world-class human Go champions without any human intervention whatsoever.

Thai argues that offensive cybersecurity has now entered its own transitional centaur phase. Today's frontier AI models possess immense power to find vulnerabilities and generate exploit payloads, but they still rely on elite human hackers to direct their attention, contextualize complex architectures, and bridge reasoning gaps. However, nobody knows whether this cybersecurity centaur era will last three years or collapse within three months:

> “At Calif, we think we are in the era of the centaur hackers.”

Thai rejects an outright pessimistic perspective that reduces AI's emergence to inevitable career obsolescence. Instead, he compares artificial intelligence to humanity's original discovery of fire—a foundational, inherently dangerous tool that catalyzed human evolution. While society must develop rigorous safeguards to contain and control the fire, researchers must also figure out how to harness it constructively. When Thai asks, "What should we cook?", Joe Weisenthal jokes that humanity should cook protein so our brains can grow even larger, before thanking both Thai Duong and Bruce Dang for detailing their research on the front lines of machine-speed vulnerabilities.

- Garry Kasparov's defeat by IBM Deep Blue in 1997 kicked off a ten-year era of human-computer "centaur" chess superiority before standalone desktop engines took over entirely. - AlphaGo's 2016 victory over Lee Sedol compressed that cycle down to three years, after which purely automated systems surpassed all human-in-the-loop play. - Calif assesses that current state-of-the-art offensive capability sits squarely in this hybrid centaur zone, where top human researchers leveraging LLMs vastly outperform either humans or autonomous models working in isolation.

---

`54:40` Post-Interview Debrief: The Fleeting Window and the Coding Paradox

Following the interview, hosts Joe Weisenthal and Tracy Alloway break down the sobering implications of Calif's discoveries. Tracy notes that the conversation was far from uplifting. She had originally assumed the current wave of vulnerability discovery was simply an awkward, temporary phase: AI models uncovering latent legacy bugs from the past thirty years, which would soon be remedied once AI was deployed to architect new, mathematically provable, and resilient codebases. However, the sheer gargantuan scale of modern software—such as web browsers containing tens of millions of lines of interconnected code—makes complete automated formal verification largely impractical for anything beyond tiny, isolated programs.

Joe focuses on the brevity of the current technological window and the fundamental paradox at the heart of AI alignment. While the concept of a hybrid "centaur" hacker acting as an interim balance of power is intellectually appealing, the historical trajectory from chess to Go suggests that the hybrid window could shut in a matter of months or a single year. Furthermore, Joe dismantles the common naive reaction that model developers should simply "teach AI not to hack":

> “If coding is going to be big business, which it is, you're going to be building a lot of good hackers.”

Because software engineering and autonomous coding assistants represent one of the most lucrative commercial verticals in the entire AI industry, frontier model builders are heavily incentivized to train models that excel at deep syntax analysis, logical troubleshooting, and execution flow tracing. By training models to understand software at that fundamental level, developers inherently and unavoidably build world-class vulnerability research engines, guaranteeing that offensive cyber capabilities will proliferate alongside everyday developer tools.

- Massive legacy consumer software targets—such as web browsers—remain far too expansive and complex for automated formal verification to guarantee end-to-end security. - The dual-use nature of machine intelligence means that commercially optimizing LLMs for general programming directly creates proficient, machine-speed offensive hackers. - The hosts close the episode by highlighting Odd Lots production credits (Carmen Rodriguez, Dashiell Bennett, Kale Brooks, and Kevin Lozano), inviting listeners to join the 24/7 discussion on the Odd Lots Discord community, and recommending the daily Bloomberg newsletter.

## Notable quotes > `25:21` It's going to take a while for defenders to catch up. Right now, AI helps attackers more than defenders. — Thai Duong

> `54:40` If coding is going to be big business, which it is, you're going to be building a lot of good hackers. — Joe Weisenthal

## Mentioned PHP2Shell, PHP, Calif, Thai Duong, Bruce Dang, Ryan Austin, Stefan Esser, Volker Dusch, Tracy Alloway, Joe Weisenthal, Carol Masser, Lauren Grush, Elon Musk, SpaceX, Anthropic, Mythos, Project Glasswing, Wiz, OpenAI, Microsoft, MSRC, Apple, iOS, Google, Google Chrome, Gmail, Netscape, Jensen Huang, Nvidia, Hugging Face, Canon, HP, Matt Suiche, IBM, Deep Blue, Garry Kasparov, Google DeepMind, AlphaGo, Lee Sedol, Chase for Business, Toyota, Barclays, Delta SkyMiles, American Express, Python, Java, Lean, Odd Lots

## Video description <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true" data-pm-slice="1 1 []">Earlier this year, cybersecurity researchers discovered a vulnerability in PHP, an open-source coding language used in roughly 70% of the world's websites, that had been lying dormant for a long time, and if exploited, could have led to disaster. And the researchers only understood the extent of this bug through the use of frontier AI models. Today, we talk to two staffers at Calif (CEO Thai Duong and engineer Bruce Dang), the cybersecurity firm that was among the first to discover the PHP vulnerability. Their firm partners with the major AI labs and neoclouds, and they help these companies test models and look for vulnerabilities in their infrastructure. Duong and Dang tell us how Calif uncovered the PHP hack, what the firm exactly sells, and what the future of cybersecurity looks like in the age of AI.</p> <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true">Read more:<br data-prosemirror-content-type="node" data-prosemirror-node-name="hardBreak" data-prosemirror-node-inline="true"><a href="https://www.bloomberg.com/news/articles/2026-10-29/ai-and-cybersecurity-why-cyberattacks-are-getting-harder-to-stop?utm_medium=referral&utm_source=podcast&utm_campaign=odd_lots&utm_content=article" data-prosemirror-content-type="mark" data-prosemirror-mark-name="link">How AI Is Making Cyberattacks a Bigger Threat</a><br data-prosemirror-content-type="node" data-prosemirror-node-name="hardBreak" data-prosemirror-node-inline="true"><a href="https://www.bloomberg.com/news/articles/2026-10-29/japan-s-cyberattack-surge-tests-its-push-to-strengthen-defenses?utm_medium=referral&utm_source=podcast&utm_campaign=odd_lots&utm_content=article" data-prosemirror-content-type="mark" data-prosemirror-mark-name="link">Japan&rsquo;s Cyberattack Surge Tests Its Push to Strengthen Defenses</a></p> <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true">Only <a href="http://Bloomberg.com" data-inline-card="" data-card-data="">http://Bloomberg.com</a> subscribers can get the Odd Lots newsletter in their inbox each week, plus unlimited access to the site and app. Subscribe at&nbsp; <a href="https://www.bloomberg.com/subscriptions/oddlots?in_source=oddlotspodcast" data-prosemirror-content-type="mark" data-prosemirror-mark-name="link">bloomberg.com/subscriptions/oddlots</a></p> <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true"><a href="http://bloomberg.com/subscriptions/oddlots" data-prosemirror-content-type="mark" data-prosemirror-mark-name="link">Subscribe to the Odd Lots Newsletter</a><br data-prosemirror-content-type="node" data-prosemirror-node-name="hardBreak" data-prosemirror-node-inline="true"><strong data-prosemirror-content-type="mark" data-prosemirror-mark-name="strong">Join the conversation:</strong> <a href="https://discord.gg/oddlots" data-prosemirror-content-type="mark" data-prosemirror-mark-name="link">discord.gg/oddlots</a></p><p>See <a href="https://omnystudio.com/listener">omnystudio.com/listener</a> for privacy information.</p>

[Source](https://podtrac.com/pts/redirect.mp3/tracking.swap.fm/track/UVBrz8bN8aM2Xe47PEPu/traffic.omny.fm/d/clips/e73c998e-6e60-432f-8610-ae210140c5b1/8a94442e-5a74-4fa2-8b8d-ae27003a8d6b/cbaad2bb-14e3-4e9e-98cf-b4f2015679b2/audio.mp3?in_playlist=982f5071-765c-403d-969d-ae27003a8d83)

中文简报

Calif警告AI编程模型数小时内即可自动化网络利用 在软件工程领域训练前沿AI的商业激励,不可避免地会催生机器速度的进攻性黑客工具,从而大幅压缩补丁修复窗口并超越企业防御能力。 Calif安全研究人员Thai Duong和Bruce Dang详细分析了其团队如何利用OpenAI支持的前沿模型,在24小时内挖掘出PHP中的遗留缺陷并生成类似PHP2Shell的武器化利用程序。他们解释了AI工具如何压缩传统安全生命周期,使自动化“n-day工厂”能够在下游用户升级之前,将公开补丁逆向工程为可用的利用程序。讨论还透露,即使像Google Chrome这样经过强化的代码库也潜藏着数千个潜在缺陷,而现实中的威胁行为者如今已开始部署协同式AI智能体集群,能够在夜间攻破整个企业银行网络。两位嘉宾最终认为,网络安全已进入短暂且动荡的“半人马黑客”时代,并警告称,出于商业目的训练AI编写代码,本质上就是在培养世界顶尖的进攻性黑客。 Calif的网络安全研究人员利用前沿AI模型,在24小时内将PHP中一个休眠未修补的漏洞转化为功能完备的远程利用程序(PHP2Shell)。 (20:00) 自动化推理工具催生了“负一日”(minus one-day)漏洞窗口,AI“n-day工厂”通过监控开源代码提交差异(commit diffs),赶在下游用户打包或部署官方补丁之前合成利用程序。 (40:00) 软件领域的两用性困境使选择性限制AI变得不切实际:训练前沿模型擅长代码合成与调试,本质上也赋予了它们高级的进攻性漏洞利用技能。 (43:08) AI加速的入侵正将安全失陷时间线从数周缩短至数小时,近期银行事件响应便证明了这一点,自主智能体在夜间建立了广泛的横向网络立足点。 (50:00)

Reading summary

Frontier artificial intelligence models are fundamentally shifting cybersecurity by automating exploit generation, shattering legacy assumptions about software defenses, and rendering traditional patch-and-response windows obsolete. AI-Accelerated Exploitation and the PHP Vulnerability (20:00) The intersection of frontier AI models and legacy software reached a turning point during what cybersecurity researchers termed "Black October." While studying PHP—an open-source language powering roughly 70% of the web—cybersecurity firm Calif uncovered critical flaws akin to issues documented over two decades prior. The true disruption was not bug discovery itself, but weaponization speed: while PHP maintainers had identified a structural flaw in 2024 but deferred fixing it because developing an exploit seemed prohibitively difficult, Calif used frontier AI tools to build a functional, remote proof-of-concept exploit within 24 hours. The Shattered Assumption of Hardened Software (30:00) Security researchers long presumed that heavily scrutinized enterprise software would withstand automated auditing better than legacy tools. However, deploying frontier AI models to audit codebases revealed roughly ten times more vulnerabilities than anticipated. Calif co-founder Thai Duong noted that while zero-day flaws in PHP were expected, AI audits uncovered a reported 1,000 new vulnerabilities in Google Chrome, surprising engineers who had spent years hardening its defense and mitigation layers. Simultaneously, alternative defensive avenues like formal verification remain commercially and technically impractical for large platforms. While mathematical proofs can secure microkernels or small, isolated components, modern browsers and operating systems encompass billions of lines of code. Because the software economy depends on rapid iteration and constant code changes, the friction required for formal mathematical proof conflicts with commercial incentives. The Collapse of Response Windows and Minus One-Day Exploits (40:00) The traditional coordinated disclosure lifecycle is disintegrating under automated surveillance. In open-source ecosystems, security patches pushed to public repositories such as GitHub create what Duong terms "minus one-day" vulnerabilities. Malicious threat actors deploy automated "n-day factories" to ingest commit diffs across Microsoft, Apple, PHP, Python, and Java codebases, synthesizing functional exploits in hours before packaged updates reach downstream system administrators. Inside enterprise perimeters, the pace of lateral movement has decoupled from human capability. Calif observed recent commercial banking intrusions where automated agents breached perimeters on a Monday and achieved widespread infrastructure penetration by Tuesday morning, executing lateral spread across 100 concurrent points. Conventional enterprise playbooks prioritizing visibility and human detection fail when attacks propagate at machine speed across mission-critical rails that cannot simply be powered down. The Dual-Use Dilemma and the Centaur Phase (51:45) Calls from industry figures to simply sandbag models or train AI not to write exploits overlook the economic engine driving AI development. Because the primary commercial use case for AI tokens is software engineering, models must excel at syntax analysis, logic troubleshooting, and code execution—the exact competencies required for hacking. As Duong emphasizes, an agent capable of debugging complex systems is inherently equipped to exploit them. Calif characterizes the current defensive posture as an interim "centaur" era, drawing parallels to the period between IBM's Deep Blue in 1997 and DeepMind's AlphaGo in 2016. In this hybrid stage, elite human engineers guiding AI models maintain an edge over autonomous attackers. However, given how rapidly game-playing engines progressed from centaur teams to total autonomous dominance, researchers remain uncertain whether this defensive window will last several years or close within months. The escalation of AI-driven cybersecurity exposes an unresolved trade-off: as commercial incentives accelerate the training of frontier models for everyday coding, they unavoidably mass-produce sophisticated offensive tooling. With defenders currently lagging behind machine-speed propagation, the industry faces an unresolved challenge in protecting global digital infrastructure against automated exploitation.

精炼阅读摘要

网络安全机构Calif专家指出,前沿人工智能模型正在根本性重构网络攻防的动态平衡:AI不仅揭示了开源软件中长达数十年未被修复的深层缺陷,更将高难度漏洞利用程序(Exploit)的研发转变为数小时即可完成的自动化工程任务,使传统的补丁管理与应急响应体系面临失效风险。 PHP2Shell与漏洞利用研发的工程化跃迁 (20:00) 在OpenAI资助的开源安全审计项目中,Calif工程师Ryan Austin重新挖掘出PHP代码库中一个类似22年前旧漏洞的严重缺陷。PHP基金会维护者坦言,他们在2024年就已知晓该问题,但由于彻底修复需要重构核心运行时架构、极易破坏全球数百万现有网站的正常运行,且当时并无可用的实证攻击代码,因此权衡后未予修复。当基金会要求提供概念验证(PoC)时,Calif利用前沿AI模型在24小时内构建出名为PHP2Shell的端到端远程攻击工具。 Calif首席执行官Thai Duong与工程师Bruce Dang强调,AI在此次事件中的革命性突破不在于“发现”漏洞,而在于自动化实现“武器化利用”。传统上针对累积30年复杂架构的PHP编写内存破坏或利用链往往需要人类研究员耗费数月分析,通常因工程难度过高而放弃;而在AI辅助下,研究员仅需制定顶层设计策略并分步提示模型编写与验证代码,使高门槛的漏洞利用演化为标准化的快速工程流程。 “负一日”漏洞涌现与传统补丁窗口瓦解 (40:00) 开源软件在GitHub等平台的透明化开发机制,在AI时代催生了Thai Duong所称的“负一日”(Minus One-Day)漏洞风险。传统漏洞响应遵循“发现—通报—闭门修复—发布补丁—下游更新”的瀑布流周期,管理员在补丁公布后通常拥有一段测试与升级的缓冲期。然而,恶意行为者现已建立起被称为“n-day工厂”的自动化流水线,利用AI模型全天候抓取Microsoft、Apple、PHP、Python和Java等核心代码库的公开提交记录(Git Diffs)。 一旦模型检测到涉及安全修复的代码变动,即可消耗计算Token在数小时内逆向推导出底层逻辑缺陷并合成可运行的攻击程序。这意味着当下游最终用户尚未获取到稳定的打包发行版时,攻击代码已经在公网就绪,导致传统安全维护的时间差被彻底抹平。 机器级横向渗透重创传统企业检测体系 (50:00) 当AI赋能的自主代理获得充裕算力支撑时,企业网络入侵的扩散速度出现了数量级跃升。根据Thai Duong披露的实战案例,OpenAI内部曾遭遇多达100个自动化节点协同并发攻击的入侵事件;在Calif近期协助响应的两家商业银行网络渗透案中,攻击者周一攻破外围边界,到周二早晨便已在全内网建立起广泛驻留。相比人类红队通常需要长达约一个月的手工侦察、权限提升与横向移动,AI攻击展现出了“机器速度”。 这种极速传播打破了过去数十年安全行业推崇的“重可见性与被动检测”范式。对于支撑核心交易轨道的商业银行而言,即便检测系统发出上百个并发代理漫游内网的警报,机构也无法直接切断关键业务数据库与网络连接,暴露出既有被动响应方案在机器级进攻面前的根本性缺陷。 代码商业化悖论与形式化验证的现实瓶颈 (43:08) 针对部分科技界高管(如Nvidia首席执行官黄仁勋)提出强化AI沙箱或通过训练让模型“拒绝参与黑客攻击”的主张,Thai Duong反驳称该观点忽视了企业安全的底层逻辑。由于AI实验室目前最核心的商业变现路径之一是出售编程辅助Token,优秀的代码生成模型必须具备代码分析、故障调试和系统控制的深度推理能力,而这些能力在技术底层与高阶黑客的技能集完全等同,形成无法切割的双重用途悖论。 与此同时,形式化验证(Formal Verification)虽在微内核等小规模组件上证明了数学层面的绝对安全,却无法推广至现代软件生态。现代Web浏览器等基础设施包含数十亿行代码且功能层级庞杂,加之商业软件依赖高频敏捷迭代以驱动收益,严格数学证明所需的摩擦成本与开发节奏截然相悖。甚至在Google Chrome等历经重度审计的代码库中,AI审计也曾一次性挖出上千个潜在漏洞,打破了防御层足够稳固的行业共识。 “半人马黑客”过渡期与不对称技术债务清算 (51:45) Thai Duong借用棋类历史类比当前网络安全所处的阶段:1997年IBM Deep Blue击败人类棋王卡斯帕罗夫后,人机协作的“半人马”(Centaur)模式主导了长达十年的过渡期;而2016年AlphaGo问世后,完全自主系统在短短三年内便彻底淘汰了人类介入。目前网络攻防正处于由顶尖人类专家规划策略、AI负责实现战术执行的“半人马黑客”时代,但这一过渡窗口可能在数月至数年内加速终结。 当前AI在进攻端的增益明显大于防御端,这实际上是对全球软件几十年来累积的技术债务进行强制清算。过去因重构成本过高或业务影响过大而被搁置的核心缺陷,在AI的规模化扫描与自动化利用面前全面暴露,迫使整个数字化基础设施直面遗留代码的安全代价。 来源对话表明,软件行业追求快速迭代的商业引擎使其难以实现绝对的数学安全,而AI工具的普及首先降低了攻击武器化的门槛。在半人马黑客过渡期可能迅速闭合的背景下,防御方如何赶在自主攻击代理全面普及之前建立起匹配机器速度的软件更新与纵深防御机制,是当前未决的核心挑战。

Detailed notes — zh

## Background 本期节目由彭博社(Bloomberg)旗下的播客《Odd Lots》于 2026 年 10 月 30 日在 RSS/Web 平台发布。节目简介指出,网络安全研究人员今年借助前沿 AI 模型,在驱动全球约 70% 网站的开源语言 PHP 中发现了潜伏已久的严重漏洞,本期专访率先发现该漏洞的网络安全公司 Calif 的 CEO Thai Duong 与工程师 Bruce Dang,深入剖析漏洞挖掘始末、公司业务以及 AI 时代网络安全的未来图景。 ## TL;DR 节目围绕震动业界的“PHP2Shell”漏洞展开,揭示了前沿 AI 模型如何打破传统攻防平衡,将原本需要耗费数月的代码逆向与 Exploit 编写压缩至几小时乃至瞬间。嘉宾结合其在微软、谷歌对抗顶级威胁(如逆向 Stuxnet 蠕虫与终结 SSL 3.0)的丰富经历,指出 AI 使得漏洞挖掘效率呈指数级爆发,不仅在 Chrome 等高防系统内扫出远超预期的巨量漏洞,更促生了补丁尚未落地便被自动化逆向武器化的“负1-day”风险。访谈深入探讨了形式化验证在敏捷软件商业现实下的局限性,并指出顶尖编程能力与黑客攻击能力在本质上是一体两面,企业目前正处于由人类专家与高算力模型结合的“半人马黑客”时代,防御体系面临从单点修补向全面重构的巨大压力。 ## Atmosphere & style 整场对话在轻松风趣的引言与技术极客的硬核拆解中层层递进,伴随深层技术现实的揭开,氛围逐渐转入令人窒息的沉重与紧迫感。主持人 Joe 与 Tracy 保持着清醒且敏锐的提问节奏,而两位深谙底层密码学与逆向工程的顶尖白帽黑客则以平实甚至略带自嘲的口吻,道出了行业看似坚固实则形同“垃圾场大火”的残酷真相。听者能切身体会到在“机器速度”与并发侵入面前,传统防御理念分崩离析的无力感与危机感,引发对数字世界底层脆弱性的深刻反思。 ## Bulletin - `19:00` 驱动全球约70%网站的开源语言PHP曝出潜伏数十年的严重远程代码执行漏洞PHP2Shell,研究团队在OpenAI资助与前沿大模型辅助下,仅用一天便生成了此前被认为无法实现的完整利用程序(Exploit)。 - `40:00` 前沿AI模型彻底打破攻防反应时间,使原本耗时数月的逆向工程与漏洞武器化被压缩至数小时,导致开源仓库提交补丁时直接演变为攻击者快速利用的“负1-day(-1 day)”安全危机。 - `30:00` 在以往被视为防御标杆的谷歌Chrome浏览器中,研究人员借助AI单次排查便挖出上千个潜在漏洞,远超业界预期的十倍以上,粉碎了过去过度依赖多层沙箱与防御缓解措施的稳固假设。 - `43:00` 大模型商业模式依赖编程与调试代码变现,而高超的底层Debug能力与黑客攻击能力在本质上完全同构,这意味着厂商无法在保留顶尖编程能力的同时单方面剥离其黑客攻击属性。 ## Key takeaways - `03:00` 网络安全界进入“黑色十月”,安全公司Calif与Wiz借助前沿AI模型揭示了PHP底层潜伏数十年的系统性漏洞,凸显AI在底层软件审计中的颠覆性能力。 - `10:00` 传统的密码学假设存在盲区,例如历史上权威推崇的“先压缩后加密”策略因暴露密文长度变化,易被CRIME和BREACH等侧信道攻击逆向提取出明文凭证。 - `14:00` AI模型将漏洞挖掘与武器化利用的门槛大幅拉低,单兵攻击者仅需耗费极低的模型Token成本,便能以“超人级”速度实现过去顶尖黑客团队数月才能完成的渗透测试。 - `22:45` PHP基金会早在两年前就知晓漏洞存在,但因架构重构成本高昂且缺乏可实际触发的PoC而搁置;Calif工程师借助AI指导,次日便生成了无条件远程利用链,证明了现实破坏力。 - `28:00` 现代大型复杂软件在AI深度检测面前暴露出远超预期的脆弱性,即便原本被认为技术债务较少、架构稳健的现代化系统,底层实际状态同样混乱不堪。 - `32:15` 通过“形式化验证”实现绝对安全在商业上难以落地,因为软件行业主导全球经济的核心优势在于快速修改与敏捷迭代,严格验证的冗长时间与商业生存诉求产生冲突。 - `40:00` 攻击窗口正急剧坍塌并催生“负1-day漏洞”:开源社区在GitHub公开提交补丁的瞬间,AI自动化“N-day工厂”便能在数小时内逆向完成针对未升级受害者的武器化开发。 - `43:00` 主张“造个坚固沙箱或直接修复模型禁止黑客攻击”是不切实际的幻想,“产品安全并不等同于安全产品”,且优秀的编程理解力天然具备漏洞逆向攻击能力。 - `45:30` 硬件固件与移动端全链条利用门槛发生断崖式下跌,逆向工程原本需耗费数月心血,如今调用几美元的开源模型即可在数天内拼接出针对打印机或iPhone的完整攻击链。 - `50:00` AI赋予攻击者令人胆寒的“机器速度”,受陷网络从边界突破到横向渗透成百上千个节点的时间从人类时期的数周压缩至一天之内,传统依赖人工响应的入侵检测体系近乎失效。 - `50:00` 当前网络安全正处于“半人马黑客”时代,最强攻击形态是顶级人类专家与高算力AI的结合体;但随着纯自主智能演进周期的缩短,人机过渡窗口正以超乎预期的速度闭合。 ## Detailed walkthrough ### `00:00` 节目赞助与彭博科技快讯:SpaceX 的招聘与企业文化 Carol Masser 带来了本期彭博科技快讯。根据《彭博商业周刊》(Bloomberg Businessweek)记者 Lauren Grush 的报道,想要入职 SpaceX 必须展现出极其出众的个人能力,甚至可能需要让埃隆·马斯克(Elon Musk)亲自过目简历。报道指出,SpaceX 的企业文化完全由马斯克定义,求职者必须明确理解:选择加入 SpaceX 就意味着必须顺应这种文化,并对马斯克保持忠诚。公司在招聘时看重候选人过去的实际成就与学位背景,致力于寻找具有纯粹、与生俱来天赋的人才。 尽管 SpaceX 的发言人并未就招聘规范置评,但据多位招聘顾问及面试过的人士透露,真正吸引人们涌向这家公司的正是“太空探索”的宏大梦想,马斯克也经常以此鼓舞员工。然而,应聘者从一开始就会被告知这项工作极度消耗体力与精力,甚至招聘启事中就明确写道需要根据情况在夜间和周末加班。作为如此高强度工作的关键回报,员工可以获得股权激励——包括认购公司股份的权利,或是按时间分期归属的受限股票单位(RSU)。 ### `03:00` “黑色十月”与 AI 时代的网络安全焦虑 录音时间是 10 月 29 日,主持人 Tracy Allaway 提到网络安全界正在流传所谓“黑色十月”(Black October)的说法。Joe Weisenthal 第一反应联想到的是股市下跌,但 Tracy 指出,这个称呼源于近期接连爆发的多起重大网络安全事件,其中最引人注目的,莫过于在驱动全球约 70% 网站的开源编程语言 PHP 中所发现的一系列深层漏洞。 更让业界震动的是,研究人员是借助前沿 AI 模型才得以彻底理解并挖掘出这些漏洞的严重程度。这一事件将一个核心问题推向风口浪尖:AI 究竟是让互联网更安全,还是变得更危险? ```mermaid flowchart TD accTitle: AI 与网络安全攻防的双刃剑 accDescr: 展示防守方与攻击方同时利用前沿 AI 模型挖掘与利用底层系统漏洞的对抗结构 subgraph Defense["防守方(善意力量)"] D1["利用 AI 挖掘系统隐秘漏洞"] --> D2["提前发布安全补丁与防护方案"] end subgraph Offense["攻击方(恶意力量)"] A1["利用 AI 加速武器化利用"] --> A2["对关键基础设施发起自动化攻击"] end PHP["底层关键基础设施(如 PHP、网络协议)"] -.-> Defense PHP -.-> Offense ``` Joe 谈到,自从 Anthropic 宣布推出其安全研究模型 Mythos(以及随后向部分企业开放用于防御性目的的 Project Glasswing 计划)以来,整个科技界对 AI 带来的网络安全风险意识大幅提升。针对“AI 会让网络更危险吗”,Joe 打趣说“毫无疑问会更危险,不,其实我也不知道”,但他坦白自己对网络安全产业内部的实际运作所知甚少: > “我不知道比如一家网络安全公司到底卖的是什么。如果由我去采购网络安全服务,我根本不知道要怎么去判断它到底有没有起作用,还是说单纯只是根本没人来黑我而已。” Joe 补充道,最近几周普通技术用户收到“服务受到波及,请重置密钥”的警报邮件数量明显激增,这表明黑客攻击的频率正在大幅上升。在华尔街和宏观风险讨论中,网络风险也一直被视为不容忽视的黑天鹅潜在来源。 ### `05:00` 顶级黑客的履历:从 Stuxnet 逆向到终结 SSL 3.0 本期节目的受访嘉宾来自网络安全公司 Calif——正是 Calif 与安全公司 Wiz 一起率先发现了前述震惊业界的 PHP 漏洞。两位嘉宾分别是 Calif 的 CEO Thai Duong 以及工程师 Bruce Dang。在切入严肃技术之前,主持人邀请他们分享各自职业生涯中最酷的代表作。 Bruce Dang 的安全生涯始于近二十年前的微软安全响应中心(MSRC),也就是每月第二个星期二负责推送“补丁星期二”(Patch Tuesday)更新的核心团队: - **Stuxnet(震网病毒)逆向工程**:Bruce 参与逆向分析了被公认为世界上第一款真正的数字化网络武器——专门用于破坏伊朗核计划离心机的 Stuxnet 蠕虫病毒。 - **iOS 核心安全**:在与朋友联合创业后,Bruce 加入了苹果公司,专注于 iPhone 的 iOS 系统安全架构,直到 Thai 花了整整四年时间,终于说服他加入 Calif,投身所谓的“AI 教派”。 Thai Duong 则长年深耕底层密码学与传输层安全协议(SSL/TLS)。日常生活中,浏览器与服务器之间交换的数据会经过路由器、ISP 运营商等无数节点,必须依赖 SSL/TLS 协议进行端到端加密保护。Thai 的里程碑成果包括: - **终结过时的 SSL 3.0 协议**:网景(Netscape)在三十年前发明了 SSL 3.0。尽管早已暴露出设计缺陷,但互联网生态因为惯性依旧普遍沿用。Thai 和他的朋友们找到了一系列攻破该协议并解密流量的方法,迫使整个互联网生态彻底废弃并移除对 SSL 3.0 的支持。 - **攻破“压缩与加密”的传统组合假说**:Thai 回忆自己在斯坦福大学攻读密码学课程时的经历,当时教授在作业中提出了经典难题:在处理数据时,究竟是应该“先压缩后加密”,还是“先加密后压缩”?当时的直觉逻辑是:绝不能先加密后压缩,因为强加密会使数据呈现高度随机化,破坏冗余度,导致后续压缩失效。然而,先压缩再加密的做法同样隐藏着致命的安全侧信道攻击风险,这也成为他日后深入攻破多项协议的突破口。 ### `10:00` 先压缩还是先加密:CRIME 攻击背后的密码学盲区 Thai Duong 回忆起他在 2011 年攻读密码学课程时的一道经典课后作业题:数据传输时究竟应该“先压缩再加密”还是“先加密再压缩”?当时的权威标准答案是“先压缩再加密”,理由是压缩可以去除冗余,减少加密的数据量,从而提升效率。然而仅仅三年后,安全学界就发现这个公认的“正确答案”存在致命漏洞——只要采取先压缩后加密的机制,攻击者甚至无需破解密钥,就能逐步还原出被加密的明文数据。 Thai 详细拆解了这一机制的底层逻辑: 1. **压缩算法的特性**:数据压缩之所以有效,是因为它消除了内容中的冗余重复信息。压缩后体积越小,说明原始数据与拼接内容之间的重复度越高; 2. **加密算法的盲区**:常规加密算法仅隐藏数据内容,却不会掩盖密文的长度。外部观察者依然能够精准获知密文的实际字节大小; 3. **侧信道泄漏(Side-Channel Leak)**:假设受害者的敏感信息(如网页 Session 密码或身份凭证)与一段攻击者注入的恶意可控内容被拼接到一起,随后经历“先压缩后加密”,并在网络线缆中传输。攻击者通过构造猜测字符并观察密文长度的变化,就能判断自己的猜测是否命中了真实密码中的字符(命中时出现冗余,压缩率变高,密文变短)。通过反复迭代测试,攻击者便能逆向推导并完整提取受害者的敏感凭据。 这种利用长度信息进行逆向推导的攻击方式(如历史上著名的 CRIME 与 BREACH 攻击),彻底颠覆了当时的主流网络加密协议。荒谬而现实的是,业界最终发现该缺陷在密码学层面上几乎无法通过数学修补,唯一的应对方案只能是在 Web 加密协议中彻底关闭 HTTP 压缩功能。 ```mermaid flowchart TD accTitle: 先压缩后加密的安全漏洞原理 accDescr: 攻击者通过向明文注入已知内容,观察压缩加密后的密文长度变化,反向推导未知密码 subgraph Input["1. 数据构造与拼接"] A["受害者机密 (如 Cookie / 密码)"] B["攻击者注入的可控猜测数据"] A --> C["明文合并拼接"] B --> C end subgraph Processing["2. 脆弱的处理链路"] C --> D["先压缩 (产生冗余消除)"] D --> E["后加密 (保留密文真实长度)"] end subgraph Leakage["3. 侧信道窃听与逆向推导"] E --> F["网络线缆中传输的密文"] F --> G["攻击者观察密文字节长度变化"] G -->|"命中字符 -> 长度缩短"| H["逐字节还原真实密码"] end ``` - 面对历史协议缺陷,Thai Duong 感叹道:“And the solution was really interesting because they decided to turn off like compression. There's no solution.”(“解决方案非常有意思,因为他们最终决定直接关闭压缩。根本没有别的解决办法。”) --- ### `12:00` 从谷歌内网“白帽黑客”到创立 Calif Thai Duong 随后分享了自己的生平轨迹与职业背景。他出生并成长于越南胡志明市(西贡),后来前往美国加州山景城的一家网络安全咨询公司工作。2011 年底,Thai 正式入职谷歌担任应用密码学安全专家,这一干就是 12 年之久。 在谷歌期间,Thai 的核心职责就是指导并协助工程师正确实施密码学规范,规避常见的架构性设计错误。谷歌拥有庞大的产品矩阵,包括 Gmail、Chrome 浏览器等日活极高的核心应用,而全球无数黑客日夜都在试图寻找突破口攻击谷歌的基础设施。Thai 的日常工作就是充当内部红队,“在产品向公众发布之前,先一步攻破这些产品”。积累了十余年对抗顶尖黑客的实战经验后,Thai 最终选择离开谷歌,联合创立了专注于前沿安全与 AI 基础设施评估的公司 Calif。 - Thai Duong 强调防御团队必须赶在黑客之前行动:“And there's a lot of people out there that want to hack Google and our products. So my job was to hack these products before we released them to the public.”(“外头有大量的人想要黑进谷歌和我们的产品。因此我的工作就是在我们把产品公开发布之前,先把它攻破。”) --- ### `14:00` AI 赋予攻防对抗的“超人级”速度与规模裂变 播客主持人提出疑问:在座两位嘉宾的职业履历都远远早于当前爆发的生成式 AI 浪潮,那么在应对网络安全风险时,AI 究竟只是一个被放大了的渐进式工具,还是一个颠覆性的全新风险范畴? Calif 工程师 Bruce Dang 明确指出,答案是两者的结合。系统从被创造出来的那一刻起就不可避免地存在漏洞,人类安全工程师与黑客多年来一直在进行漏洞发掘与利用的博弈。然而,前沿 AI 模型(如 frontier AI models)的介入,彻底打破了攻防对抗的反应时间曲线: - **漏洞发现速度的指数级跃迁**:AI 将系统漏洞的挖掘、武器化利用脚本的生成从原本以“月”为单位的人力消耗,压缩到了近乎瞬间完成,达到了前所未有的“超人级别(superhuman)”效率; - **系统更新与漏洞规模的膨胀**:回顾 20 年前的软件生态,微软可能一个月仅需要向外部推送大约 20 个安全补丁;而到了今天,企业每月必须面对多达 1,400 个更新,并且该数字仍在持续飙升; - **攻击门槛与攻防格局的剧变**:过去要攻破特定系统(例如防守森严的银行核心金融系统),往往需要由顶尖黑客组成的多人团队耗时整整三个月;如今,借助高能力的 AI 模型,单兵作战的攻击者也能快速达成同样深度的渗透。这不仅改变了黑客的入侵手法,也让银行等受保护领域的防御态势面临巨大挑战。 Bruce Dang 总结道,系统的脆弱性从来都在,只是“What AI has done is it's kind of accelerated the speed in which you identify and exploit these vulnerabilities to a level where it's almost like superhuman.”(“AI 所做的是将你发现并利用这些漏洞的速度,加速到了几乎如同超人一般的水平。”) --- ### `19:00` PHP2Shell:Calif、Wiz 与 OpenAI 联合发掘史诗级漏洞的始末 主持人将话题引向 2024 年震动安全圈的重大事件——PHP 远程代码执行(RCE)漏洞 PHP2Shell 的发掘。PHP 作为世界上最老牌且普及最广的开源 Web 编程语言之一,驱动着全球约 70% 的网站。该漏洞是一项由 Calif、知名云安全独角兽 Wiz 以及前沿大模型研发机构 OpenAI 联合推进的协同研究成果。主持人特别问及,该团队在发掘过程中的决策逻辑,以及为何在修复尚未完全铺开前向公众发出预警时遭遇了争议。 Thai Duong 解释了 Calif 团队接手这一课题的核心初衷:团队并不是为了挖掘细枝末节的小缺陷,而是专门追踪具有深远全球影响力的基础底层漏洞。唯有深入理解这些潜伏数十年之久的核心漏洞的机理,才能为防御方提供科学的决策支持,从而在系统根底上将其“一劳永逸地彻底修复并防御”(fix and mitigate them for once and forever)。正是基于这样的防护使命,Calif 团队决定加入 OpenAI 的安全前沿探索项目,利用前沿大语言模型对庞大的历史遗留开源代码库进行深度排查。 - Thai Duong 明确了安全研究的战略定位:“We're really interested in finding vulnerabilities that have a wide impact. And we want to understand these vulnerabilities to help inform decisions, defense decisions, how to fix and how to mitigate them for once and forever.”(“我们真正感兴趣的是发现具有广泛影响力的漏洞。我们希望理解这些漏洞,从而为防御决策提供依据,彻底、一劳永逸地修复并缓解它们。”) ### `20:00` OpenAI 资助与挖掘 PHP 历史遗留漏洞 Calif 参与了 OpenAI 的资助计划,该项目出资扶持像 Calif 这样的安全公司,帮助开源软件的维护团队识别并修复软件中的安全隐患。Calif 内部有一位名叫 Ryan Austin 的工程师,Thai Duong 形容他就像一名“PHP 历史学家”。在前一天于旧金山举行的一场安全会议上,团队刚刚展示了“PHP2Shell”项目,Ryan 当场向观众梳理了 PHP 过去 25 年间的漏洞演进史。Thai Duong 解释说,Calif 的运作方式非常纯粹:“我们的工程师对某些技术感兴趣,就会直接动手去攻破它”,而商务团队的职责则是去寻找愿意为此买单的出资方。在这一项目中,他们成功说服了 OpenAI 提供资金与模型 Token 支持,随后便主动找上 PHP 背后的组织——PHP Foundation(PHP 基金会)寻求合作。 由于 PHP 拥有 25 年的漫长漏洞史,要在该圈子里建立信任并不容易。半年前加入 Calif 的资深安全专家 Stefan Esser 扮演了关键桥梁的角色。Stefan 曾是早期 PHP 安全领域声名显赫的黑客,主持过多项安全加固工作,在圈内宛如“印第安纳·琼斯(Indiana Jones)”般的传奇人物。正是通过 Stefan 的引荐,Calif 团队与 PHP Foundation 的 Volker Dusch 取得了联系,并于 2024 年 7 月 30 日正式启动合作。令人震惊的是,项目启动仅一两天,Ryan 便挖出了第一个关键漏洞——他的思路是去排查是否存在与 Stefan 22 年前披露过的漏洞类似的缺陷,结果出人意料地发现当前的 PHP 代码库中依然潜伏着一批同类漏洞。 ```mermaid flowchart TD accTitle: PHP 漏洞挖掘与验证流程 accDescr: 展示从 OpenAI 资助到 Calif 发现漏洞并利用 AI 编写利用程序的过程 subgraph Fund["项目发起与对接"] A["OpenAI 资助计划<br/>(提供资金与 Token)"] --> B["Calif 团队介入"] B --> C["Stefan Esser 引荐<br/>对接 PHP Foundation"] end subgraph Discovery["漏洞复现与博弈"] C --> D["Ryan Austin 检索历史同类缺陷<br/>(启动 1-2 天内定位漏洞)"] D --> E["PHP Foundation 承认 2 年前曾发现<br/>(因修复代价高且无 Exploit 而搁置)"] end subgraph Exploit["AI 赋能 Exploit"] E -->|"索要 PoC / Exploit"| F["工程师指导 AI 设计利用路径"] F --> G["次日生成完整 Exploit<br/>(证明远程无条件攻击可行)"] end ``` - **OpenAI 资助**:OpenAI 向 Calif 提供资金与模型调用 Token,鼓励其去挖掘并修复关键开源基础设施的漏洞。 - **安全元老的引荐**:Stefan Esser 曾是 PHP 安全领域最具影响力的开拓者,其业内声望帮助 Calif 迅速获得了 PHP Foundation 维护者 Volker Dusch 的信任。 - **22 年前的影子**:Ryan 仅耗时一到两天便根据 22 年前的漏洞模式,在当下的 PHP 代码中重新找到了未被彻底根绝的同类型高危缺陷。 --- ### `22:45` 为何陈年漏洞未修?从“纸上 Bug”到 AI 生成真实 Exploit 当 Calif 意识到该漏洞影响巨大、可能波及全球大部分互联网网站并立即上报时,PHP Foundation 却透露了一个惊人事实:他们早在两年前就发现了完全相同的漏洞。然而,当时维护团队最终放弃了修复,因为该漏洞的修补代价极其高昂——社区仅有的几种修复方案均需要对 PHP 内部的大量核心功能进行彻底重构,而这类大手术极可能引入全新的 Bug、安全隐患或稳定性问题;一旦用户升级 PHP 导致网站崩溃,势必引发公愤。更关键的是,2024 年当时根本没有任何已知的漏洞利用程序(Exploit),维护团队无法证实该漏洞在现实环境中能够真正被攻击者利用。 因此,PHP Foundation 收到报告后向 Calif 提出的核心问题便是:“你们有实际的 Exploit 吗?”次日,Calif 团队便向他们提交了一份完整的漏洞利用代码,明确证明了攻击者即便在对目标网站内部结构一无所知的情况下,也能实施完全的远程入侵。主持人由此指出,AI 在这次事件中的核心价值,并不在于凭空寻找漏洞,而是在于针对已知缺陷快速构建现实的攻击武器。Thai Duong 对此完全认同:面对已有约 30 年历史、功能极其繁复的庞大代码库,人工摸索 Exploit 可能要耗费数月甚至半途而废,但 AI 的介入彻底改变了这一过程:“这变成了一个工程问题,我们的工程师只需指导 AI‘这就是我想设计的 Exploit 方案,你去把它做出来’,然后向我们验证其能正常工作。” > “在 2024 年,PHP 基金会最终决定不修复它,因为当时没有任何漏洞利用程序;没有人能证明这确实是一个现实问题。” —— Thai Duong --- ### `25:00` 攻防博弈的哲学:防守方能否凭借 AI 跑赢攻击方? 针对这场由 AI 引发的能力跃迁,主持人提出了一个偏哲学层面的核心议题:在网络安全领域,防守方是否真的有可能走在进攻方的前面?Bruce Dang 给出了肯定的回答。他认为,AI 赋予了防守者以极高速度构建新型系统的能力,防守方能够迅速进行实验、接收反馈,并利用 AI 强大的数据推理能力来打造令攻击者极其难以突破的系统架构。虽然这一优势短期内未必立竿见影,但从长期来看,AI 将深刻辅助人类编写出更安全的代码,并在根本上抵消甚至反超攻击方的优势。 Thai Duong 随后结合人类文明史补充了自己的视角。他指出,人类的历史本质上就是一部“把工具武器化”的历史——任何强大工具的诞生,都会不可避免地最先被改造成武器,因为攻击者往往是新技术的早期尝鲜者,而防守方的响应速度在历史上始终慢于进攻方。然而,他坚信正义的力量最终会占上风:“从根本上讲,我们相信世上的好人总是多于坏人的,最终好人会迎头赶上,打造出保护所有人抵御坏人的防御机制。” Thai Duong 坦言,外界总能在新闻中频繁看到数据泄露事件,容易觉得安全技术毫无进展,但如果回顾过去 25 年的行业轨迹,安全基础设施其实已经取得了巨大进步。面对复杂的现实系统,防守者既要确保成百上千扇门窗的安全,又必须保证业务全天候正常运转,难度极高;眼下 AI 确实给攻击者带来了更多助力,但防守方的反制也正在逐步成型。 > “如果你审视人类的历史,我们的历史就是一部将工具武器化的历史;如果你发现了一件强大的工具,就总会有人找到办法把这件工具变成武器。” —— Thai Duong --- ### `28:00` 技术债务的尴尬期与系统现实的“垃圾场火灾” 面对当前的攻防态势,主持人询问这是否意味着整个技术行业正处于一段极为尴尬的过渡期:传统网络安全中反复提及的“技术债务”(Technical Debt)——例如像 PHP 这类多年未做深层翻新的陈旧代码——如今在 AI 面前无所遁形,行业正被迫加速偿还这些历史积欠。通过利用 AI 暴露潜在缺陷,客观上也可能促使全行业大幅削减现存的技术债务。 Thai Duong 认可这是看待当前技术阵痛的一种乐观角度,但他同时分享了一个令他个人非常震惊的残酷现实:在实际检测中,团队原本以为某些系统架构规范、历史包袱较轻,应该没有积累太多的技术债务,可当他们真正将 AI 工具对准这些系统时,其内部展现出的混乱与脆弱“就像其他系统一样完全是一场垃圾场大火(dumpster fire)”。这表明不仅是那些公认存在沉疴隐患的重灾区,即便是原本被寄予厚望的现代化系统,在 AI 敏锐的检测深度面前,其底层隐患的数量也远远超出了业内专家的最初预期。 > “我们发现,有些系统原本我们以为技术债务并不多,结果却发现它们和其他所有系统一样,彻底就是一场垃圾场大火;这对我个人而言是一个巨大的意外。” —— Thai Duong ### `30:00` AI 挖掘出海量漏洞与 Chrome 的安全神话破灭 在引入 AI 进行安全审查后,安全工程师们经历了一场认知上的巨大冲击。过去,业内普遍认为一些历经多年高强度审计、备受关注的成熟软件项目应当是相对稳固的,然而 AI 却在这些地方挖出了远超预期的漏洞,数量足足比大家预想的高出十倍。虽然在 AI 出现之前漏洞就很少的极少数小型领域中,如今漏洞依然不多,但这些完全是极其罕见的例外,而非行业常态。 受访专家指出,如果是在 PHP 这种本就以安全机制薄弱著称的语言中发现严重漏洞,大家并不会觉得太意外(尽管 PHP2Shell 这种灾难级影响的漏洞仍属于极端情况)。但当研究人员在谷歌 Chrome 浏览器中利用 AI 一口气挖出上千个漏洞时,整个安全界都被震撼了。曾在谷歌任职的受访者直言,行业内过去一直对 Chrome 投入的海量安全资源深信不疑:这不仅包含消除代码漏洞的努力,还包括极为严密的防御缓解机制(mitigations)——即哪怕存在代码漏洞,多层沙箱与防护层也能确保攻击者难以利用它们来控制用户的计算机或浏览器。然而在 AI 介入后,残酷的事实摆在了眼前:“要么是我们这些安全工程师业务能力太差、找不出这些东西,要么就是代码量实在太庞大了,我们根本没有足够的时间去逐行审视。” ```mermaid flowchart TD accTitle: AI对传统软件安全认知的冲击 accDescr: 展示了传统软件安全防御假设与AI工具扫描发现海量漏洞后的对比过程。 subgraph PastAssumptions["过去的安全假设"] A["传统安全投入 (Chrome 等项目)"] A --> B["漏洞数量预期较低"] A --> C["层层防御缓解机制 (Mitigations)"] B --> D["安全共识:系统相对稳固"] C --> D end subgraph AIReality["AI 介入后的现实冲击"] E["AI 深度代码挖掘"] E --> F["发现漏洞数量暴增 10 倍以上"] E --> G["在 Chrome 中单次挖掘出上千个漏洞"] F --> H["根本困境:代码规模失控 vs 工程师审查极限"] G --> H end ``` - **漏洞激增现象**:在过去被认为重兵把守的核心软件代码库中,AI 挖掘出的漏洞数量比预期高出 10 倍左右。 - **Chrome 的 1000 个漏洞冲击**:业界原本认为防护最顶级的 Chrome 浏览器被 AI 挖掘出 1000 个漏洞,颠覆了业内关于“缓解措施足以兜底”的固有认知。 - **受访者原话**:谈及过去对防御体系的自信与现实的落差时,嘉宾直言:“We thought that the defense layers were pretty good and the rate of vulnerabilities were low. But then after AI, we just discovered that either like we as security engineers suck at our job we couldn't find this thing or they're just like too much code that we didn't have enough time to look into.” --- ### `32:15` 形式化验证的现实局限与软件吞噬世界的底层矛盾 针对 AI 挖出海量漏洞的困境,主持人提出了一个追问:未来是否可能开发出一种“可证明安全”(provably secure)的浏览器或软件系统?就像数学家使用 Lean 等形式化证明工具证明数学定理一样,只要代码发布,就能在逻辑上证明它坚不可摧,无论 AI 技术发展到何种高度都无法找出任何漏洞。 专家们直截了当地指出,这是一个高度复杂且沉重的话题(“loaded question”)。在计算机科学中,确实存在所谓的形式化验证(Formal Verification)技术,就像数学家可以用几行严格证明来确认“2 + 2 = 4”一样,科学家也能在数学层面上证明某些代码逻辑绝对安全。然而,目前这种形式化验证只能适用于规模非常微小的系统核心或独立组件(例如某些微内核操作系统)。像现代浏览器这样的系统,其复杂程度早已等同于一个完整的操作系统,涉及数十亿行代码和无数研发人员的协作,对这种庞然大物进行整体形式化验证在当前技术下根本无法实现。 更深层次的阻碍并不单单是技术瓶颈,而是整个软件产业的商业底层逻辑。受访专家引用了“软件正在吞噬世界”的论断,解释了为什么当今市值最高的公司清一色都是软件企业:其根本原因在于软件具有“极易修改”的敏捷特性。如果一个产品今天无法满足需求,团队今晚或明天就能上线补丁做出调整,这种超高速的学习与适应能力让软件行业彻底碾压了物理世界并主导全球经济。如果为了追求形式化验证而要求代码不能频繁改动,这直接违背了软件商业模式的根本利益。除非全自动化的形式化验证能在眨眼间完成,否则企业为了生存和抢占市场,永远会选择牺牲绝对安全来换取极致的迭代速度。 - **形式化验证的边界**:当前仅能应用于极小型代码组件或操作系统核心,无法扩展到现代浏览器等包含数亿乃至数十亿行代码的复杂巨型应用中。 - **商业驱动的敏捷性冲突**:软件商业成功的核心在于快速迭代和随意变更(“fundamentally, software is easy to change and people want to change it constantly”)。 - **受访者原话**:嘉宾深刻指出:“So if you ask, like, okay, now let's not change it, like, frequently, then that goes against the interest, right? And that's not going to happen. So it means that even if you have a way to formally verify everything, that would take a lot of time, automatically otherwise it's not gonna happen because people want to change their software like as quick as possible because that's how they do business.” --- ### `35:28` 赞助广告播报:SpaceX 招聘文化与企业赞助 节目随后插入了由 ChatGPT 带来的《彭博科技一分钟》(Bloomberg Tech Minute),由 Carol Masser 主播。该环节报道了《彭博商业周刊》记者 Lauren Grush 关于 SpaceX 招聘生态的深度调查。报道披露,应聘 SpaceX 不仅需要异于常人的卓越才能,候选人的简历甚至可能会被埃隆·马斯克(Elon Musk)亲自过目。在招聘理念上,SpaceX 相比名校高学历更看重应聘者的动手实操经验和与生俱来的原生智力(raw, innate intelligence)。招聘人员会明确告知求职者,加入 SpaceX 必须服从马斯克主导的企业文化,并对马斯克本人展现忠诚,岗位招聘启事中甚至白纸黑字写明员工“必须愿意在需要时加班并在周末工作”。作为对超长高压工时的回报,员工可以获得包括认股权或随时间归属的限制性股票单元(RSU)在内的股权激励。紧接着播出了大通商业银行(Chase for Business)新开户 500 美元奖励活动、丰田皮卡(Toyota Tundra & Tacoma)促销季以及 IBM 开放式混合云数据治理方案的商业广告。 - **SpaceX 招聘特质**:马斯克可能亲自介入简历筛选;比起高等学历,公司更看重过往项目实战与原生智力。 - **高压工时与报酬**:工作要求周末和长期加班,主要激励手段为公司股权与限制性股票(RSU)。 - **赞助商信息**:节目赞助商包括 Chase for Business(针对新商业支票账户提供 500 美元奖励)、Toyota(皮卡优惠)以及 IBM(混合云与数据主权合规方案)。 --- ### `38:50` AI 对传统安全漏洞修复瀑布流的颠覆性重构 商业播报结束后,话题重新回到了核心讨论。主持人抛出了一个关键问题:AI 的兴起是否正在彻底重塑软件漏洞的修复流程(waterfall of the way things get fixed)? 在过去几十年中,业界形成了一套标准的“发现-通报-补丁”瀑布流机制:安全研究人员或内部团队发现漏洞后,软件厂商编制安全警报并开发修补代码(patch),随后向公众安全披露并推动用户部署更新。然而,随着 AI 能够瞬间挖掘出天文数字级别的安全缺陷,甚至在黑客攻防前线改变游戏规则,这种传统漫长的响应模式正面临前所未有的压力与洗礼,软件行业被迫重新审视漏洞从被发现到被修复的整个生命周期。 ### `40:00` 从“0-day”、“N-day”到“负1-day”漏洞:补丁窗口的急剧坍塌 传统网络安全领域通常将漏洞分为两类:一类是除漏洞发现者外无人知晓的“0-day”(零日)漏洞;另一类是厂商已公开披露、可能已经发布修复补丁,而用户正在或尚未打补丁的“N-day”(多日)漏洞。但如今,随着前沿 AI 技术的介入,行业内出现了一种全新的威胁形态——“负1-day(-1 day)漏洞”。 以 PHP 漏洞为例,PHP 及其基金会属于开源项目,所有的代码提交与 Bug 修复都是直接在 GitHub 上公开进行的。一旦研究人员提交漏洞报告,且维护人员在 GitHub 仓库中公开打上补丁代码的那一刻起,该信息实际上就已经被全世界知晓。在此之前,黑客通常需要等待正式补丁发布,再耗费数周甚至数月去逆向工程并编写出可用的利用代码(exploit),防御方和普通用户往往拥有较充裕的系统升级时间。 然而现在的攻击时间窗口正在被 AI 急剧压缩甚至“彻底坍塌”。攻击者正在建立自动化、流水线化的“N-day 工厂”(N-day factory),专门盯紧微软、苹果以及各类关键底层软件的公开仓库。如今不仅是 PHP,Python、Java 等几乎所有主流语言和操作系统的代码库都有成群的攻击者或 AI 探针在实时监控。一旦 GitHub 出现任何修复提交,攻击者的 AI 就会立刻启动,疯狂消耗 Token 去逆向分析该修复所对应的原始漏洞,并在短短几个小时内自动拼装出针对未升级系统的武器化 Exploit。 ```mermaid flowchart TD accTitle: 漏洞生命周期演进与负1-day风险 accDescr: 描述开源补丁在GitHub提交后,AI如何在数小时内将其转化为负1-day漏洞的攻击流程 subgraph G1["GitHub开源协作环节"] A["安全人员提交漏洞报告"] --> B["维护者提交公开补丁代码"] end subgraph G2["AI加速攻击链路 (负1-day)"] B -->|"实时监控触发"| C["AI自动化N-day工厂"] C -->|"消耗Token逆向分析"| D["数小时内生成武器化Exploit"] end subgraph G3["用户端升级困境"] B -->|"官方打包发布/分发"| E["终端用户获取更新并部署"] D -->|"时间窗口坍塌"| F{"攻击发生在用户升级前"} E -.->|"往往落后于AI生成速度"| F end ``` - 传统漏洞分类:0-day(未公开、未修复)、N-day(已公开/已修复、处于补丁部署期)。 - 新兴威胁分类:负1-day(-1 day)漏洞,即在补丁处于开发/提交阶段、尚未打包正式推给终端用户时,攻击者便通过监控开源代码提交并借助 AI 逆向生成了 Exploit。 - Thai Duong 强调:“Now that window is collapsing. It is collapsing everywhere, not just in PHP, right? In Windows, in Mac OS, in anything.”(现在这个窗口正在坍塌。不仅是 PHP,在 Windows、macOS 以及所有软件中,它都在坍塌。) --- ### `43:00` 逃逸与沙箱之辩:为什么不能“直接修复模型”? 针对此前 Hugging Face 与 OpenAI 相关的安全事件,行业内形成了两种截然不同的思潮。一种是带有拟人化色彩的观点,将 AI 视作狡黠、想要“逃出笼子”的神秘生物;另一种则是务实派的技术论调,例如英伟达 CEO 黄仁勋(Jensen Huang)在接受 Ezra Klein 采访时直言不讳地表示:别整那些虚头巴脑的理论,直接造一个更坚固的沙箱,或者干脆直接修复模型,别让模型去黑客攻击不就行了。 对于黄仁勋这种“不许模型黑客攻击、直接修复它”的观点,拥有传统网络安全背景的专家们并不赞同。在安全行业,非安全专业出身的人往往误以为网络安全存在某种“银弹”——比如买一个昂贵的神奇黑盒子防火墙往网络里一放,万事大吉。然而网络安全界有一句著名的格言:“产品安全并不等同于安全产品”(product security is not the same as security product)。即便是市面上顶级的商业防火墙和安全硬件,其自身往往也布满了漏洞和代码缺陷。 更深层次的矛盾在于大模型公司的核心商业模式与激励机制。AI 巨头目前主要通过销售 API Token 变现,而绝大多数 Token 的调用场景是编程辅助、代码构建和故障排除。若想让 AI 成为顶级的编程专家,就必须赋予它理解深层底层代码、诊断极其复杂的系统 Bug 以及调用并控制计算机环境的能力——但这恰恰就是“黑客”的本质定义。两者本质上是一枚硬币的两面,模型公司根本无法在保留高超编程能力的同时彻底剥离黑客攻击能力。 - 行业思潮对立:将 AI 拟人化为“试图越狱的危险造物” vs 实用派主张“加固沙箱、修复模型、不让模型黑客化”。 - 核心商业逻辑冲突:AI 厂商依赖编程 Token 变现,优秀的编程与 Debug 能力必然等同于强大的漏洞挖掘与黑客能力。 - 业内经典定律:“Product security is not the same as security product.”(产品安全并不等同于安全产品。)安全硬件本身同样经常沦为被攻破的对象。 - Thai Duong 谈到这一死结时断言:“You cannot have a cake and eat it too, right? You need to be good at coding. Then you have an AI that is good at hacking.”(你不可能鱼与熊掌兼得。你想要 AI 擅长写代码,那你就必然会得到一个擅长搞黑客攻击的 AI。) --- ### `45:30` AI 时代的黑客日常:逆向工程门槛骤降与防御方的溃败 谈及安全专家的日常工作在近三四年来发生的翻天覆地变化,Bruce Dang 拿自己的亲身经历举例:他曾与朋友合写过一本关于逆向工程(Reverse Engineering)的权威教科书,过去理解没有源码的软件或硬件固件是一项极其艰深且耗费心血的苦工;而如今,只需将相关数据丢给前沿模型,AI 瞬间就能吐出甚至比他们当年所写教科书还要优秀的逆向分析结果。 这种生产力爆炸彻底重塑了漏洞攻防的生态。有长期从事该领域的专家仅花费 5 美元调用开源模型,就成功逆向并攻破了佳能(Canon)或惠普(HP)打印机的底层固件。知名安全专家 Matt Suiche(播客常客)甚至直接在自家公寓的服务器机架旁,一边闲聊一边借助自动化工具批量黑进目标系统。在过去,要为苹果 iPhone 构建一套完整的全链条利用(full chain exploit),往往需要顶尖黑客耗费数月甚至更久的心力;而现在,仅凭单兵作战借助 AI 工具,几天之内就能拼装出多条完整的攻击链。 这种利用代码开发周期的极端压缩,使得金融机构、传统银行等防御方完全陷入被动挨打的境地。攻击者正在成规模地利用 AI 自动化发起渗透,而传统依赖人工排查的蓝队防御体系正在面临前所未有的残酷压力。 - 技能平民化:原本门槛极高的逆向工程(无源码逆向二进制与硬件固件),现在只需几美元的开源模型调用即可自动化完成。 - iPhone 攻击链突破:过去极其复杂的 iPhone 完整漏洞链(full chain)开发往往需团队历时数月,如今单人借助 AI 数天即可拼出多套可用链条。 - 攻防失衡加剧:金融、银行等重点行业正在遭遇 AI 驱动的高频黑客攻击,防御速度远远追赶不上攻击武器的生成节奏。 - Bruce Dang 引用同行专家的反馈感叹道:“Oh, yeah, man, I spend whatever, $5 on some open source model and it reverse engineered the firmware on some Canon or HP printer. And it hacks it, Bruce.”(天啊兄弟,我就花了大概 5 美元在某个开源模型上,它就把佳能或惠普打印机的固件给逆向了,而且它直接黑进去了,Bruce。) ### `50:00` 机器速度的入侵与“半人马”黑客时代 Calif 首席执行官 Thai Duong 分享了来自 OpenAI 团队以及一线应急响应的震撼经历。在 OpenAI 方面,他们处理过无数次安全事件,但这是第一次见到整个网络中同时有大约一百个节点被攻破的情况——系统内仿佛同时存在 100 名黑客在协同作恶,而以往通常只有一到两名。这种爆炸式的并发入侵,很大程度上是因为具备海量 Token 资源的 AI Agent 能够不计成本、无休止地发起全方位渗透。就在两周前,Calif 接到了两家银行客户的求助电话。Thai 解释道,作为红队黑客,按以往人类团队的速度,攻入内网后往往需要耗费一个月左右的时间逐步向外横向扩散;然而由 AI 主导的攻击展现出令人胆寒的“机器速度”——“周一刚刚突破内网防线,到了周二就已经无孔不入”,如同癌细胞般疯狂扩散。 这种速度上的彻底倾斜粉碎了传统的防御体系。过去安全厂商习惯建议客户加大对“入侵检测”的投资,但面对 AI,单纯能看到威胁已经毫无意义:“已检测到系统内当前有 100 名黑客”对于受害者而言根本无计可施。对于银行而言,全面断网停机从来都不是可行的选项,这迫使整个行业必须推倒重来,重新构想防御蓝图。 ```mermaid flowchart TD accTitle: 人类与 AI 黑客横向移动速度对比 accDescr: 对比传统人类黑客耗时数周与 AI 仅用一天在网络中全面横向移动的效率差异。 subgraph Human["传统人类黑客攻击流程"] H1["攻入企业网络边界"] --> H2["耗时约 1 个月手动侦察"] H2 --> H3["有限渗透 1-2 个核心节点"] end subgraph AI["AI 驱动的攻击模式"] A1["周一:攻入网络边界"] --> A2["机器速度并发扩展 / 消耗 Token"] A2 --> A3["周二:侵入 100+ 节点,全面沦陷"] end ``` 谈及作为一名黑客在当下的心境,Thai 从历史发展中寻找对照。他将当前的变革与国际象棋和围棋的人机对战相比较: - **深蓝(Deep Blue)时刻(1997年)**:IBM Deep Blue 击败加里·卡斯帕罗夫(Garry Kasparov)后,最强棋手并不是计算机,因为 Deep Blue 是庞大的大型机。此后整整十年间,世界上最强的是卡斯帕罗夫所定义的“半人马选手”(Centaur player)——即人类棋手与计算机的协同组合。 - **AlphaGo 时刻(2016-2017年)**:在李世石落败后,围棋从人机协同过渡到完全自主软件(如 2019 年无需人类棋谱与输入的版本)仅用了大约三年时间。 Thai 直言安全界目前正处于这一关键过渡期:“在 Calif,我们认为我们正处于‘半人马黑客’的时代;基本上,目前最顶尖的黑客是 AI 与人类专家的结合体。”(“At Calif, we think we are in the era of the centaur hackers. Basically the best hacker right now is a combination of AI and humans.”)虽然 AI 极具破坏力,但要达到致命的精确度,现阶段依然离不开人类专家的引导。至于这个“半人马时代”会持续多久——是三个月、一年还是三年?没人能给出确切答案,可能年底前黑客就不得不被迫退休。但 Thai 拒绝陷入单纯的悲观主义,他将 AI 比作人类刚刚发现的火种:“没有火,就没有今天的我们。我们不仅要想如何控制火,更重要的一个问题是:我们该用火来烹饪什么?” - **OpenAI 事件规模**:系统内同时出现近百个受陷节点并发行动。 - **银行渗透扩散周期**:人类渗透需要 1 个月,AI 辅助攻击仅需不到 24 小时(周一至周二)。 - **人机演进窗口缩短**:国际象棋从大型机击败人类到消费级全面自主用了 10 年,围棋仅用了 3 年,网络安全领域的纯自主化窗口预计更短。 ### `55:00` 主持人复盘:无法阻止的黑客扩散与未来隐忧 在嘉宾离场后,主持人 Joe Weisenthal 与 Tracy Allaway 进行了深入的对谈复盘。Tracy 直言这期访谈的内容令人深感不安与沉重,与很多人预想的乐观叙事大相径庭。原本外界可能会以为,当前只是处于一个尴尬的过渡期,虽然老旧代码(Legacy issues)不断被 AI 挖掘出漏洞,但只要未来让 AI 重新编写并部署全新的底层架构,整个数字世界就会变得坚不可摧;然而事实表明,面对如浏览器等体量庞大、极度复杂的软件系统,根本无法做到全盘推倒重构。 两位主持人重点回味了“半人马黑客”这一隐喻。最让人担忧的现实在于,试图“训练计算机不要去黑客攻击”完全是不切实际的幻想。随着 AI 代码生成正在演变成科技巨头争夺的核心万亿级产业,为了让 AI 成为顶级程序员,各家机构必然在无形中把模型训练成具备极其恐怖黑客能力的代码拆解机器。编写代码与利用漏洞在逻辑本质上是完全同构的,这也意味着只要 AI 编程技术在前进,强大的攻击工具就会在网络空间中不可逆转地泛滥开来。 节目最后,主持人感谢了听众的收听,并提醒大家关注制作团队(Carmen Rodriguez、Dashiell Bennett、Kale Brooks 与 Kevin Lozano),欢迎大家加入彭博 Odd Lots 的官方 Discord 社群参与全天候讨论,或订阅 Bloomberg Odd Lots 的每日时事通讯。 ## Notable quotes > `43:00` You cannot have a cake and eat it too, right? You need to be good at coding. Then you have an AI that is good at hacking. — Thai Duong > `50:00` At Calif, we think we are in the era of the centaur hackers. Basically the best hacker right now is a combination of AI and humans. — Thai Duong > `03:00` 如果由我去采购网络安全服务,我根本不知道要怎么去判断它到底有没有起作用,还是说单纯只是根本没人来黑我而已。 — Joe Weisenthal ## Mentioned Thai Duong, Bruce Dang, Tracy Allaway, Joe Weisenthal, Ryan Austin, Stefan Esser, Volker Dusch, Carol Masser, Lauren Grush, Elon Musk, Jensen Huang, Matt Suiche, Calif, Wiz, OpenAI, Anthropic, PHP Foundation, SpaceX, Google, Microsoft, Apple, Chase for Business, Toyota, IBM, PHP, PHP2Shell, Mythos, Project Glasswing, Stuxnet, SSL/TLS, SSL 3.0, CRIME, BREACH, Google Chrome, iOS, Lean, GitHub, Deep Blue, AlphaGo ## Video description <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true" data-pm-slice="1 1 []">Earlier this year, cybersecurity researchers discovered a vulnerability in PHP, an open-source coding language used in roughly 70% of the world's websites, that had been lying dormant for a long time, and if exploited, could have led to disaster. And the researchers only understood the extent of this bug through the use of frontier AI models. Today, we talk to two staffers at Calif (CEO Thai Duong and engineer Bruce Dang), the cybersecurity firm that was among the first to discover the PHP vulnerability. Their firm partners with the major AI labs and neoclouds, and they help these companies test models and look for vulnerabilities in their infrastructure. Duong and Dang tell us how Calif uncovered the PHP hack, what the firm exactly sells, and what the future of cybersecurity looks like in the age of AI.</p> <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true">Read more:<br data-prosemirror-content-type="node" data-prosemirror-node-name="hardBreak" data-prosemirror-node-inline="true"><a href="https://www.bloomberg.com/news/articles/2026-10-29/ai-and-cybersecurity-why-cyberattacks-are-getting-harder-to-stop?utm_medium=referral&utm_source=podcast&utm_campaign=odd_lots&utm_content=article" data-prosemirror-content-type="mark" data-prosemirror-mark-name="link">How AI Is Making Cyberattacks a Bigger Threat</a><br data-prosemirror-content-type="node" data-prosemirror-node-name="hardBreak" data-prosemirror-node-inline="true"><a href="https://www.bloomberg.com/news/articles/2026-10-29/japan-s-cyberattack-surge-tests-its-push-to-strengthen-defenses?utm_medium=referral&utm_source=podcast&utm_campaign=odd_lots&utm_content=article" data-prosemirror-content-type="mark" data-prosemirror-mark-name="link">Japan&rsquo;s Cyberattack Surge Tests Its Push to Strengthen Defenses</a></p> <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true">Only <a href="http://Bloomberg.com" data-inline-card="" data-card-data="">http://Bloomberg.com</a> subscribers can get the Odd Lots newsletter in their inbox each week, plus unlimited access to the site and app. Subscribe at&nbsp; <a href="https://www.bloomberg.com/subscriptions/oddlots?in_source=oddlotspodcast" data-prosemirror-content-type="mark" data-prosemirror-mark-name="link">bloomberg.com/subscriptions/oddlots</a></p> <p data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true"><a href="http://bloomberg.com/subscriptions/oddlots" data-prosemirror-content-type="mark" data-prosemirror-mark-name="link">Subscribe to the Odd Lots Newsletter</a><br data-prosemirror-content-type="node" data-prosemirror-node-name="hardBreak" data-prosemirror-node-inline="true"><strong data-prosemirror-content-type="mark" data-prosemirror-mark-name="strong">Join the conversation:</strong> <a href="https://discord.gg/oddlots" data-prosemirror-content-type="mark" data-prosemirror-mark-name="link">discord.gg/oddlots</a></p><p>See <a href="https://omnystudio.com/listener">omnystudio.com/listener</a> for privacy information.</p> [Source](https://podtrac.com/pts/redirect.mp3/tracking.swap.fm/track/UVBrz8bN8aM2Xe47PEPu/traffic.omny.fm/d/clips/e73c998e-6e60-432f-8610-ae210140c5b1/8a94442e-5a74-4fa2-8b8d-ae27003a8d6b/cbaad2bb-14e3-4e9e-98cf-b4f2015679b2/audio.mp3?in_playlist=982f5071-765c-403d-969d-ae27003a8d83)

Source quotes

[43:00] Thai Duong: You cannot have a cake and eat it too, right? You need to be good at coding. Then you have an AI that is good at hacking. [50:00] Thai Duong: At Calif, we think we are in the era of the centaur hackers. Basically the best hacker right now is a combination of AI and humans. [3:00] Joe Weisenthal: 如果由我去采购网络安全服务,我根本不知道要怎么去判断它到底有没有起作用,还是说单纯只是根本没人来黑我而已。

Source quotes

[25:21] Thai Duong: It's going to take a while for defenders to catch up. Right now, AI helps attackers more than defenders. [54:40] Joe Weisenthal: If coding is going to be big business, which it is, you're going to be building a lot of good hackers.

Original transcript

[0:00] There are some market stories where you want every detail. Joe and I have made quite a few podcasts on that basis, but sometimes you've only got 10 minutes and just want to know what's moving markets fast. That's the Barclays Brief podcast. Every week, experts from Barclays Markets and Research get you up to speed on what's happening and what to watch next. Concise, focused, and brief. Search Barclays Brief wherever you get your podcasts. This is the Bloomberg Tech Minute I'm Carol Masser. Getting hired at SpaceX requires exceptional ability and may include having Elon Musk review a candidate's resume. So writes Bloomberg Businessweek's Lauren Grush. She reports that the company culture is defined by Musk and job candidates must understand that a commitment to SpaceX means adhering to this culture and exhibiting loyalty to Elon Musk. To get hired, candidates must demonstrate their achievements from past jobs degrees, with the company looking for people with raw, innate intelligence. A spokesperson for SpaceX didn't respond to a request for comment on its recruiting and hiring practices, but according to recruiters, advisors, and those who've interviewed for jobs there, it's the space exploration dream that draws people to the company, and Musk invokes that dream regularly to remind workers why they're there. Prospective hires are told that the job will require stamina, including in job ads that hours and weekends as needed. One major perk for all that hard work, employees access to equity, either the right to buy shares or payment in the form of restricted stock units that invest over time. That's the Bloomberg Tech Minute brought to you by ChachiPT. Get started at ChachiPT.com. you If you're a business owner, you need a card that can keep up. With the Delta SkyMiles Reserve Business American Express card, everyday purchases transform into miles you can use towards future travel. So business as usual can lead to a well-deserved getaway. And for a limited time, card members can earn 200,000 bonus miles, the highest miles offered this year. Whether you're traveling for business or planning your next adventure, now's a great time to make every purchase go further. Delta.com slash podcast. Offer ends November 4th. Minimum spending requirements and terms apply. Bloomberg Audio Studios. Podcasts. Radio. News. Hello and welcome to another episode of the Oddbots podcast. I'm Tracy Allaway. And I'm Joe Weisenthal. Joe, it's October. It's October. We're recording this on October 29th. Yeah. It is also Black October. Have you heard this term? Yeah. What does that mean? If stocks going down? No. Your mind immediately goes to markets. There are other worlds out there. We're going to be talking about the world of cybersecurity today because one of the reasons people are talking about Black October is we've had a number of recent security issues, the most prominent of which has been a bunch of vulnerabilities discovered in PHP, which is a coding language But the really interesting thing about this vulnerability being uncovered is that AI was used to uncover it. And so the big question coming back to AI, you know, there's a concern now that you have good actors who are maybe using AI to discover vulnerabilities and trying to fix them. But you could also have bad actors who are using AI to exploit those same vulnerabilities. So we're back to the question of whether AI makes the internet safer or more dangerous. Yeah. Makes it more dangerous. No, I have no idea. Ever since essentially Anthropic announced that they had this model called Mythos and now it's Project Glasswing, which was rolled out to companies to use for defensive purposes before it was available to the general public, there has been much more awareness of cybersecurity issues as it relates to AI. And there are many things that people debate about AI and some of these bigger existential questions. Pretty much everyone agrees cybersecurity I will say I know very little about the world of cybersecurity. I don't know what, for example, a cybersecurity company actually sells. I don't know how if I were buying cybersecurity, I would know whether it's working or whether no one had tried to hack me or not or something like that. I need to learn a lot more, but it's absolutely true about the uptick in the volume of hacks. There are hackers out there right now taking notes going, Joe doesn't know anything about cybersecurity, probably doesn't have a VPN. to build anything with an account because I don't want to have to think about that. So it's just like, I don't want to count. [5:00] information with anyone. But I have, as a user of technical products, Over the last several weeks, you get more emails saying like, our thing was compromised. You're probably fine, but maybe you should refresh some keys or whatever. This is happening. This is real. And everyone really needs to learn more. And if you think about like... black swans and Wall Street and all that stuff. You know, there's been for years a lot of talk about cyber as a major risk out there. Yeah. All right. Well, we do, in fact, have the perfect guests. We're going to be speaking to two people from the company Calif, one of the companies that actually uncovered this PHP vulnerability. The other one was a company called Wiz. We have Tai Yun. He is the CEO over at Calif, which is a hacking firm, and we can get into exactly what Bruce Deng, he is an engineer at Calif as well. So Ty and Bruce, thank you so much for coming on All Thoughts. We're glad to be here. So just to begin with, because... You know, hackers kind of, they always have cool achievements that they like to talk about. Why don't we just go ahead and start with who you are and what are the coolest things you've done in your hacking career? Yeah. So I started my career at Microsoft like almost 20 years ago in the Microsoft Security Response Center. There's the people that do Patch Tuesdays, you know, like on the second Tuesday of every month, Microsoft released an update. So I worked in that team a long time ago. talk about is I helped reverse engineer the Stuxnet virus, which is one of the one that was related to the supposedly the Iranian nuclear program was used to sabotage the Iranian nuclear program. This is the thing that people describe it as the world's first like known digital cyber weapon, right? Yeah, yeah, yeah, yeah. I'm sure there were many others before. But yeah, that's And then I left to do a startup with my friends and then I joined Apple. I worked on iOS security. And then Thay managed to convince me to follow the church of AI. And so here I am. Yeah, it took me four years to convince bros. So, you know, I'm a big fan of the world. When you go to a website or you go to Amazon, even Facebook, Instagram, your computer will share information with the server, right? Yeah. And the information would travel through many, many other servers like your ISP, your Wi-Fi routers. So you want to encrypt that information to make sure that only the server can see your data, nobody else. And there's a mechanism for that. SSL protocol. or the later version is called like TOS, like Transport Layer Security Protocol. So I love those protocols. And back in the day, together with friends, we found a bunch of ways to break the protocols, you know, to decrypt the data. And it's pretty cool. It's actually changed the Internet, how the Internet works, because we basically show that in the past there are two protocols, like SSL version 3.0 that was invented by Netscape. You know, you remember Nescape? Yeah, yeah. 30 years ago. And then people still use it because it's still working somewhat. But we show that, oh, it's not working very correctly. If you use SSL 3.0, then people can decrypt your data. So we help the internet, like, really, really remove, like, SSL 3.0. And that's one thing. The other thing that I really enjoy doing was, you know, People think that in the past, you have compression, you have some data, and you want to compress the data, and you have encryption. And both of them actually randomize your data in some way, right? If you look at a zip file, you open a zip file, look at the raw app. binaries by data in the zip file look random to you. Because all the redundant information has been removed and encoded in a way to reduce the size of the file. And so what the basic question in computer security was, would you compress data and then you encrypt? or you encrypt and compress. And I took some crypto class at Stanford University, And I remember my professor, He asked this question in one of the homework assignments. And the obvious answer back then was, you don't want to compress and then you don't want to encrypt and compress because encryption randomize you later. It means that compression would be less effective. [10:00] So the right answer is you compress. and then you encrypt. And that was the correct answer on my homework assignment. I think I took that class in 2011. And then three years later, we found out it's wrong. If you do that, then people can actually decrypt your data. And the way it works is pretty cool, I can explain to you. So compression actually reveals, if you look at a compressed file, you know how well it is compressed, right? because it's shorter. If it's smaller, the compression is very good because there's a lot of redundant information. That's why compression works well. It means that if you look at a compression alone, the size of the compression, a compressed file, you can tell whether the file has a lot of redundant information. And encryption... hide the length. So it doesn't hide the size of the encrypted data. When you encrypt the message, you can still see that this message is maybe this long or this message may be this long. Because encryption doesn't try to hide that. Some people try to do that. So it means that if you compress, And then you encrypt. It means that I can see whether your message has some redundant information, has a lot of redundant information. And that alone is a leakage already, right, that you don't want to reveal. And I give you an example. Like, let's say that you take a message, like a random message that I give you, and then you put your password together with that message. Let's just say that there's a reason for you to do that. You put your password together with the message I give you and you compress together. And then you... and equip it with a key that I don't know, and you review the ciphertext, the result, encrypted message to me. So supposedly I don't have the key, I shouldn't be able to read the message, right? But because, I give you a message and you get my message. put together with your password, you compress together. If the compression works very well, then I know whether you met my message. has some redundancy with your password. You can reverse engineer between like the two relationships. Yeah, exactly. And you do that like repeatedly. Eventually, we can recover your password. And that's exactly what we found on these platforms. web encryption protocol, like in the past. That's exactly what they did. They take my data, they concatenate your password, they encrypt together, they compress together, and then they send over the wire. And then as an attacker, I can see the length, and that's enough for me to decrypt. And the solution was really interesting because they decided to turn off like compression. There's no solution. And then eventually I was at Google back then. I was born in Saigon, Vietnam. I grew up there. Then I got a job in Maddenville. for a consultancy, like what we do. So I moved to Mountain View in 2011, and then I joined Google later that year. And I did cryptography at Google. basically help people do cryptography correctly, like try to avoid the mistakes that we found. I was there for 12 years. I work on a very large number of products. Google has a lot of products, right? Gmail, Chrome browser that we are using right now. And there's a lot of people out there that want to hack Google and our products. So my job was to hack these products before we released them to the public. And I was there for 12 years and then I left to create Caliph and That's fantastic. I'm already fascinated by this conversation. I want to get into obviously what Califf does specifically. I want to get into some of the latest vulnerabilities. But before we do that, both of you have had long careers that by and large predate what we now call AI. truly novel area for how we should we'd be thinking about cybersecurity risk. I think it's a combination of the two. We've always known that there are security vulnerabilities in systems. And so we have security engineers who are hackers who try to find and exploit these vulnerabilities. So the systems had always been vulnerable to some degree, varying degree. What AI has done is it's kind of accelerated the speed in which you identify and exploit these vulnerabilities to a level where it's almost like superhuman. [15:00] 20 years ago, Microsoft would release, let's say, maybe 20 updates every month. Now you're looking at like, you know, 1400 updates per month. You know, and then that number is going to continue to grow. It's just to give you an idea of like the scale of things. And now, you know, for example, to have certain systems, it may take you, let's say, three months with lots of people. a very capable AI model. That's the reality we're in today. It even changed the way how attackers have certain types of systems, like the banking sector, the way our customers are in. You can tell some stories about that time. But that's what I think. I think the systems have always been vulnerable to some degree. And now it's just... They are just... accelerates that and makes it much more visible. And it's also made it easier for people to identify these vulnerabilities as well. And obviously there are pros and cons to that. There are some market stories where you want every detail. Tracy and I have made quite a few podcasts on that basis, but sometimes you've only got 10 minutes and need to know what's moving markets and why. That's the Barclays Brief Podcast. Every week, experts from Barclays markets and research get you up to speed on what matters and what to watch next. About the time it takes to grab a coffee. So search Barclays Brief wherever you get your podcasts. This is the Bloomberg Tech Minute brought to you by Chachi PT. I'm Carol Masser. Getting hired at SpaceX requires exceptional ability and may include having Elon Musk review a candidate's resume. So writes Bloomberg Businessweek's Lauren Grush. Job candidates must understand that a commitment to SpaceX means adhering to this culture and exhibiting loyalty to Elon Musk. To get hired, candidates must demonstrate their achievements from past jobs. And hands-on experience matters more to recruiters than advanced degrees. With the company looking for people with raw, innate intelligence. A spokesperson for SpaceX didn't respond to a request for comment on its recruiting and hiring practices. But according to recruiters, advisors, and those who've interviewed for jobs there, It's the space exploration dream that draws people to the company, and Musk invokes that dream regularly to remind workers why they're there. Prospective hires are told that the job will require stamina, including in job ads that candidates, quote, must be willing to work extended hours and weekends as needed. One major perk for all that hard work? Employees' access to equity, either the right to buy shares or payment in the form of restricted stock units that vest over time. ChachiPT. Get started at ChachiPT.com. Affordable? Check. Stylish? Check. Quality? Check, check, and check. And before we rush into Black Friday, like some folks, Furniture Row is honoring our veterans. Shop and save on sofas, dining groups, beds, and mattresses. Plus, take an extra $100 off every $1,000 you spend. And for an additional salute to our heroes in uniform, military and first responders get an extra 5% off and no down payment. The Veterans Day Sale, on now at Furniture Row. Toyota, let's go places. Why don't we talk about discovering the PHP vulnerability then? Because I think this was a joint project between Calif, Wiz and I think it was OpenAI. How did you find this? What was the process? And then what was the decision? I know you guys have gotten a little bit of pushback about... publicizing it before it was fixed. So what was the process of actually, you know, putting out the statement saying we found this thing? We're really interested in finding vulnerabilities that have a wide impact. And we want to understand these vulnerabilities to help inform decisions, defense decisions, how to fix and how to mitigate them for once and forever. On that background, we joined the OpenAI. [20:00] I passed the Planet program. This is where OpenAI funds companies like Calif to go out and help open source maintainers to identify and fix mitigate vulnerabilities in their software and we have this engineer like ryan austin who is like a PHP historian. Yesterday, we went to a conference in San Francisco. We basically presented like, you know, PHP 2 Shell, and Ryan walked everybody over like the 25 years of history of PHP vulnerabilities. So we have this like engineer, Ryan, and this is how we work. Basically, we Our engineer, they're interested in certain things, and then they just go and hack those things. And, you know, ask business people who try to see, okay, how can we convince some other people to pay us for this work? And that's exactly what we did with OpenAI. We convinced OpenAI, okay, we're going to hack PHP. Can you fund our work? And they said yes. They gave us tokens and money. And then we go and convince like PHP Foundation. which is the organization behind PHP. Let's work together. We can help you. And it's actually pretty interesting because I mentioned like that, like a history of 25 years of like PHP vulnerabilities. And the person who, that is behind all of these hacks is like Stephen Escher. He's also a Caliph. He joined us, I think, six months ago. Back in the day, he's the best security guy. Basically, he... Hack and help like Heartland Beach Beach. So we didn't know anybody at the Beach Beach Foundation. So we asked Stefan to introduce us. And because, you know, even though Stefan stopped working on PHP security for a while now, his name still rings, you know, very, loudly in this circle of the world. - I saw the comic that you guys put up about this. It was kind of funny. - Yes. - He's like Indiana Jones type character. - Yeah. So he connected us and then we met with Volker Dutch at the PHP Foundation. And yeah, that's how we got started. I think we started in July 30, And then immediately after one or two days, you know, Ryan found The first one where they... And he was interested in finding a vulnerability similar to one vulnerability that Stephan disclosed 22 years ago. And to his surprise, There's still a bunch of them like that in the PHP software right now. And so that's how we found it. And then we reported it to the Bissery Foundation because we know immediately that is a critical vulnerability. that could affect a large part of the internet. Then the Peach Beach Foundation actually shared with us that they actually found this vulnerability, the same vulnerability, Two years ago But they didn't fix it because when they found it, they discovered that the fix is... very expensive and there's just like maybe a few options to fix it. and none of them were actually perfect because they need to change a lot of functionality within PHP. And those changes may introduce new bugs, new vulnerabilities, or new reliability issue. And people would be very upset if they operate you know, PHP and their website stopped working. So in the end, back in like 2024, The BHP Foundation decided not to fix it because there was no exploit. No one could manage to show that this is actually a real issue. And that's exactly what they asked us. They come back, they ask, like, do you have an exploit? Then the next day we share with them the first exploit that show them that, yeah, someone doesn't need to know anything can hack your website remotely. So just to be clear, the use of AI in all of this, it wasn't necessarily that important in finding the vulnerability. It was more important in developing an actual exploit for a known issue. We think like that's probably the right way to think about it. without AI, it would take a lot more time, right? So you can imagine like PHP was created like maybe 30 years ago. So it's a huge code base with a lot of [25:00] - A feature. And as a human engineer, you have to be into this code base. And it will take like months, right? And along the way, people may give up. But the fact that Beachfield Foundation found the bug, in 2024, proof that humans can actually find the bugs, right? And the problem was the exploitation, like you said. And for exploitation, like AI plays a major role in it. It becomes an engineering problem where our engineers would tell AI, you know, this is how I want to design our exploit and you go and do it. and then prove to us that it works correctly. Let me ask a philosophical question. Is there a reason to believe that defensive cybersecurity can stay ahead of offensive cybersecurity? Just generally, then we can get into some details, but philosophically, like, is there Is that something that we can reasonably hope for? I think so, yes. How come? Because you can use the AI to build certain types of systems in ways that may be very challenging for attackers to exploit. Today, you can use AI to build whatever systems you want very quickly. You can experiment and get feedback very quickly. It can also process data quickly. very, very quickly and reason about that data. And so I think it is possible. I think it may not be immediate, but over time, we're going to perhaps use AI to help us write more secure software or build more secure systems. And eventually, I think that should counterbalance the advantages do foresee this happening? I can add something there. So if you look at the history of humanity, our history is the history of like weaponized our tombs, right? If you find a powerful tool, then someone would find a way to use that tool as a weapon. And attackers always are early adapters of tools, right? New technology. Defenders move at a much slower pace than attackers. But fundamentally, we believe there are more good guys than bad guys out there. And eventually, you know, the good guys would catch up and build things that help, you know, everybody defense, fend off the bad guys. And I don't think like in general, cybersecurity, if you see the news all the time, you see like we got like data bridge. every day almost, even before AI. So you may feel like it's not working at all, but if you're in the field, you can see the progress, right? In the past, like, 25 years, there's a tremendous progress in cybersecurity. Of course, people still got hacked because this is... It's difficult. Imagine you have a very complex system. Imagine you have a house with lots of doors, lots of ways to get in, and cybersecurity must make sure everything is safe. At the same time, your house or your office must remain open for business. So it's actually a pretty difficult problem. At the same time, without the progress that we, like the industry met in the past 25 years, things could be much worse, right? And I think the same thing would be happening here. It's going to take a while. for defenders to catch up. Right now, you know, AI helps attackers more than defenders. Is the general idea that we're just in this sort of awkward phase where a lot of people in cybersecurity always refer to technical debt, right? This idea that you haven't upgraded a system for ages like the PHP vulnerability we were just discussing. And so now you have to pay back that technical debt. The idea that we're just in an awkward moment where AI is going to be able to exploit existing flaws in the system. We reduce our outstanding technical debt. We reduce the outstanding technical debt. Exactly. That's an optimistic way to look at it. Okay. You know, we found that there are systems that we thought that, okay. that don't have a lot of technical debt. that turned out that they just like a dumpster fire like everybody else. That was a very big surprise, right, to me personally. Like we know there are places there are bad problems. And we know that if we just point AI at that thing, there will be a lot of bugs coming. [30:00] But there are also places we thought that could be okay because they received a lot of attention over the years already. But now there's still a lot of bugs there as well. And a lot mean like a lot more, like 10x more than we expected. And of course, there are still like a few small places where there was fewer bugs back then before AI. Now there's still fewer bugs now. still now, but they're very small, they are the exception, not the gnomes. So that's actually a big surprise. Because I don't think anybody was surprised to find a critical vulnerability in Bish B. because PHP wasn't known for like race security. So of course at the PHP 2 shell scale, then that's a different matter. But if you find another vulnerability in PHP today, then that's not a surprise. But if you go and, you know, five vulnerabilities or maybe a hundred vulnerabilities, a thousand vulnerabilities in the Chrome browser for example. That's a surprise. And that's exactly what happened. People found 1,000 vulnerabilities in Chrome. And I was at Google, and I knew, and the entire ministry assumed that and knew that, wow, there was a lot of investment in Chrome security. and not just like eliminate vulnerabilities, but making sure that even if you have vulnerabilities, it's difficult to exploit these vulnerabilities. This is what we call mitigations. You accept that you have vulnerabilities, but then you make sure that attackers couldn't use these vulnerabilities to control your computer or your browser. We thought that the defense leaders were pretty good and the rate of vulnerabilities were low. But then after AI, we just discovered that either like we As security engineers, suck at our job we couldn't find this thing or they're just like too much code that we didn't have enough time to look into so this raises another question like is it possible to have a provably secure browser or a piece of software you ship the piece of software and you can prove maybe in the same way that mathematicians produce things and this thing called lean or whatever Unimovably secure. And we know that no matter how good AI gets, it will never find a vulnerability in this piece of software. Oh, man, this is a loaded question, Joe. I thought it was a simple question. Yeah. I don't know. To be honest, browsers are its own operating system, very, very complex operating system. And today doing formally verified software, It doesn't work at that scale. It's typically smaller software components. So there is such thing as formal verification when it comes to software. Yes. You could have small pieces of software in which you formally prove in the same way that it takes a mathematician seven lines to prove the two plus two equals four. There is some sort of equivalent for software where you can prove these lines of code are secure. Because... the scale of even something like a browser is just so enormous that's a very difficult thing to do yes yeah it's uh it's something that um i think is being researched right now because this is i think this is a of like one of the one of the paths forward to make to build more secure systems yeah there are like for example you know we've had systems where you know the corb it is formally verified right it's an offerings and it's formally verified but then there are applications you know applications that have issues. Yeah. It's complicated. These are small systems. You're talking about browser. Browser is like many billions of lines of code. And so that's... Yeah, I mean, I can tell you how big Chrome is. I mean, they have a zillion people working on it. And lots of people working on Chrome security all these years. But long story short, there are such things, but to make it work on a browser or at a very, very large system, We don't have anything like that today. - Got it. - I think there's a need-but-reason here The reason software is eating the world, you can see the biggest companies in the world are software companies. It's because software is easy to change. And imagine, you know, that allows software [35:00] and it is to adapt and to learn much quicker than the rest of the world. You have a product, if it doesn't work, then tomorrow, tonight, you can change it. And that actually allows the software world to become, to dominate the world, basically. So basically, fundamentally, software is easy to change and people want to change it constantly. And that's the reason why, you know, the tech companies are doing so well. So if you ask, like, okay, now let's not change it, like, frequently, then that goes against the interest, right? Yeah. And that's not going to happen. So it means that even if you have a way to formally verify everything, that would take a lot of time, automatically otherwise it's not gonna happen because people want to change their software like as quick as possible because that's how they do business. This is the Bloomberg Tech Minute brought to you by ChachiPT. I'm Carol Masser. Getting hired at SpaceX requires exceptional ability and may include having Elon Musk review a candidate's resume. So writes Bloomberg Businessweek's Lauren Grush. She reports that the company culture is defined by Musk and job candidates must understand that a commitment to SpaceX means adhering to this culture and exhibiting loyalty to Elon Musk. from past jobs, and hands-on experience matters more to recruiters than advanced degrees, with the company looking for people with raw, innate intelligence. A spokesperson for SpaceX didn't respond to a request for comment on its recruiting and hiring practices, but according to recruiters, advisors, and those who've interviewed for jobs there, it's the space exploration dream that draws people to the company, and Musk invokes that dream regularly to remind workers why they're there. Prospective hires are told that the job will require including in job ads that candidates, quote, must be willing to work extended hours and weekends as needed. One major perk for all that hard work? Employees' access to equity, either the right to buy shares or payment in the form of restricted stock units that vest over time. That's the Bloomberg Tech Minute brought to you by ChachiPT. Get started at ChachiPT.com. Running a small business takes everything you've got, but with Chase for Business, you're not alone. They bring together local support and a broad range of resources to more than 7 million customers. With a deep understanding of your day-to-day needs, they provide products and guidance built to help you thrive. Right now, earn $500 when you open a new Chase Business Complete Checking account for new business checking customers with qualifying activities. Offer expires January 21st, 2027. Accept payments, make deposits, and manage your finances with confidence. Learn more at chase.com slash podcast biz offer. Chase, make more of what's yours. Fees may apply to Chase Business Complete Checking Accounts. The $500 offer is available for new business checking accounts with qualifying activities through 1-21-2027. Eligibility and qualification requirements must be met. Additional restrictions may apply. Please speak with a business banker for more information. JPMorgan Chase Bank, N.A., member FDIC. Dear America, Toyota's save bucks on trucks event is on. Haul it all with a powerful tundra or play hard in the rugged Tacoma. Toyota trucks are built for weekends that don't end when the pavement does. Boat ramps, campsites, trailheads, and everything in between. So don't wait. Haul home heavy duty savings and save bucks on trucks with Toyota. Toyota, let's go places. Your business operates under pressure and you need control over your data, but IBM research shows only 9% of companies have real oversight of their technology. IBM's open hybrid cloud approach is designed to give you visibility with built-in governance tools, data sovereignty, and compliance reporting. It's another way IBM helps you stay in control of your data. Let's create smarter business. IBM. Visit ibm.com to learn more. This is sort of a related question, but does AI start to change, I guess, the way or like the waterfall of the way things get fixed? So nowadays, it's like a vulnerability is discovered. The software company issues an alert and a patch. They disclose it and then people go on. [40:00] and fix it. If exploits are coming faster, does that process start to change in any way? Yeah, it changed a lot. Basically back in the day, we have like two kinds of vulnerabilities, like zero day vulnerabilities that nobody knows about except the person who found it. And then, um, end-day vulnerabilities that vulnerabilities have been disclosed and maybe fixed by the vendors and maybe users have upgrade or not. But now we also have something we call like minus one day vulnerabilities. So these vulnerabilities happen when, you know, imagine like, let's take the PHP vulnerability as an example. Let's say that, you know, because PHP foundation and PHP itself is an open source project, everything happens on GitHub, right? And imagine, let's imagine that we've reported a bug. and PHP fixed the bug publicly on GitHub. The moment that we found a bug. And then PHP produce a patch for that bug, that very moment, that information became public. Somebody who is watching the PHP repository on GitHub, they could turn that away into an exploit within a few hours. Of course, the vulnerability that we found was more complicated than that. But you can imagine that in principle, like the window between the passwords being developed It's not ready yet for anybody and before it becomes ready for end user to upgrade. There's a window, right? Yeah. In the past, you know... the attacker has to wait until the path becomes available, and then it would take them a long time to develop and exploit. So user can have a longer time to upgrade. Now that window is collapsing. It is collapsing everywhere, not just in PHP, right? In Windows, in Mac OS, in anything. Because right now, there are people who have what we call and their factory, you know, they're just waiting for patches from Microsoft, from Apple, from important critical software. Like, I'm sure tens of people are watching PHP today. After what happened, they're watching PHP, Python, Java, all of those important languages. And if there is any sign of like, oh, there's a new vulnerability, they're going to like, you know, their AI would go pro and then, you know, running tokens to find, identify that vulnerability, produce it, be an exploit for it. So that changed the practice, right? Yeah. I'm curious what you thought after the hugging face incident, because after that moment, there were sort of two schools of thought that I thought there is or that I perceived. There's one that was like AI creature. There was this sort of I guess maybe the anthropomorphic Asian view, AI creatures. They want to escape their cages. They're devious. They're tricksters. cheat on the way that the greater, you know, all these stories. And then there are other people that were just like, Guys, build a stronger sandbox. Stop talking about all this stuff. Just build a stronger sandbox. Jensen Long is kind of in that category. I loved his interview with Ezra Klein, where he was basically like, what's your problem? Just make models that don't hack. He's like, just don't ship it. Fix your model. Don't let them hack. And I love that because it's just like, just fix it. And the AI people are like, no, no, no, we can't. You don't understand. We haven't solved alignment. It's very tricky. And he's like, just fix the model. And I'm sort people who have come out of the traditional cyber world, but are now in the AI world. Where do you land on this question? Can you just like, guys, just fix the sandbox? Or is there something deeper here? I don't think that it's simple to fix the sandbox. That's the problem. People think that, you know, maybe people are not in security. They think that there's a simple solution to cybersecurity. Just do this thing and you save. And that's how we have so many problems, this magic box and put it in your network and you'll be saved. No, it's not like that. Even that box has problems. If you look into like, there's a famous idea in security, like product security is not the same as security product. Like security products may not have product security. Even like the firewalls that you buy, they may have problems and they do. And what I mean here is, so, [45:00] So, What we found, like the hugging face and open AI incident was fascinating to watch. And it's difficult. Enterprise security is very difficult. Anybody saying like, oh, just buy this thing, just do that thing, you're going to be safe. No, it's just like very complicated. And the reason is like, and then people say, oh, just fix the model. And that's a comeback to the incentive. He's not making money as well. The AI companies, they're making money by selling tokens, and most of the tokens are used for coding today, programming, building things, right? And if you want to be really good at coding, you need an agent on AI that understands code, understands technical problems, can debug things, can control computers. But that's basically the definition of a hacker. So you cannot really escape this. You cannot have a cake and eat it too, right? You need to be good at coding. Then you have an AI that is good at hacking. So unless you don't want to spend more tokens or you don't want to get into the coding business anymore, you focus on like scientific discovery, physical AI, whatever, then maybe you can train a model that is not good at hacking anymore. than technical problems. And that's the definition of someone like Bruce. So it's unavoidable. So actually on this note, I'm curious, can you just talk about What it's like being a hacker in the age of AI versus, say, even three or four years ago, right? Like, it's crazy how quickly stuff has shifted. But how has your day to day changed? Yeah, well, I'll just use some background. So I wrote a textbook with some friends on reverse engineering. It used to be like, you know, like you try to like, reverse engineering is the practice of understanding software without any source code or hardware systems. and bam, it will generate the textbook for you. And it's even better. And it took us a long time to write. That gives you an idea. And then I talk to friends who've been doing this for decades, specialists in this area. And they tell me that, oh, yeah, man, I spend whatever, $5 on some open source model and it reverse engineered the firmware on some Canon or HP printer. And it hacks it, Bruce. figured some stuff out. You know, that's just to give you a glimpse into what's happening and how quickly things change. Well, a friend, you know, this guy, Matt Swish, he's an Eaton dude. He's a friend of the show. A long-time friend of the show, multi-time guest. Yeah, keep going. We used to hang out in Abu Dhabi a lot. Oh, okay, yeah. I'm no Matt for all the time. Now he's like, he gave a talk with our team the other day and he showed his rack, you know, like in his apartment and he's sitting there, you know, like hacking stuff like while he's sitting there talking. It's just insane. Something that we have people that, let's say, you know, for example, like we've been hacking the iPhone. To build a full chain on the iPhone, it's not an easy task. It's sometimes it takes in like a few days, you know, as a one person. And we have multiple of these chains. It really compresses the time to build exports. We see customers getting hacked by AI, in the financials, in the banks, basically. Defenders cannot, you know, actually, Tai, why don't you tell how things changed. Basically, we saw in the OpenAI and Hacking Face incident, there was one detail that That is-- I'm not sure if people noticed, but OpenAI note that the people who handle the incident [50:00] on the OpenAI side, they said that they have handled a lot of incidents, but this is the first time they saw that, you know, an incident where you have like... Like a hundred. points within your networks that were compromised at the same time. There were 100 hackers within your system. Normally, you have maybe one or two, right? Now you have 100. And I saw that I was like, wow, that was pretty interesting. But maybe because OpenAI have a lot of tokens. So their agents can just go you know, hack everything. And then just two weeks ago, we have like two clients in the banking industry and they got hacked and they called us to help them with like the incident response. We came in because we do hacking as well. We know like usually it took us like maybe a month or something once we come in a network and then took a month for us to spread out. For the AI took like they came in, they broke the net, they broke inside the network on Monday by Tuesday, they're everywhere. Everywhere and like this like cancer is spread like at a machine speed and it was like my blowing right because how could you defend against that? In the past, we were telling our clients, you know, you have to invest in detection, right? Well, how can you help yourself? If you see it, you can detect it, but there's a hundred of them. Noted. We have a hundred hackers in our system right now. It's not really helpful. Exactly. How could you do it, right? Then you have to shut down everything. But shut down is not an option because you are a bank. So that actually requires us to sit down and think about how to redesign a defense system. What we have right now is not working very well. But to come back to your question, as a hacker, How does it feel? I love history. So I always come back to history to say, like, does it happen before? It actually did happen, you know, with like just for example, you remember like in 1997, you know, IBM Deep Blue defeated Garry Kasparov. That was a big moment, right? And then 20 years later, AlphaGo defeated like Lizzie Doe in the game of Go. But those two moments are actually quite different. Like the first moment, the Deep Blue moment, after Deep Blue, the best chess player wasn't a computer. Because Deep Blue was a mainframe, right? Not something that you can run on your computer. And it took 10 years for someone to to go from Deep Blue to develop a computer software that you can run on your computer that defeated everybody. But the 10 years, It took 10 years. During that 10 years, the best chess player was a centaur player. This is a term coined by Gary Kasparov. It's a combination of computer and human. It took 10 years. For Anfago, it took like three years. After AlphaGo, in 2019, somebody came up with a computer software that defeated anybody without any human input at all. At Calif, we think we are in the era of the central hackers. basically the best hacker right now is a combination of AI and humans. And our work and our friends work as well, show that AI is powerful. It can hack anything, but it still requires a human expert. to arrive at grave. And we don't know how long this is going to last. Maybe three months. Maybe, you know, we come back here in like By the end of the year, we tell you we retire now. There's nothing else for us to do. Maybe it lasts like three years. And this is actually pretty exciting to find out. That's exactly what we want to do. And we think like... That's like pessimistic view, right? And AI is going to do everything. Let's just like retire and hate AI, right? Or you can see AI as a tool. It's like humanity just discovered fire. And without fire, we wouldn't be here today. So, of course, we have to think about how to control fire. At the same time, a very important question that we need to ask is: what should we cook? Right? That's very important and we want to find out. What can we cook with AI and how can we do it in a safe way that helps everybody? Protein that makes our brains get bigger. Yeah. All right. Well, Ty and Bruce from Calif, thank you so much for coming on All Thoughts. That was a lot of fun. You're both excellent. Thank you both. Thanks. Thanks, Joe. Thanks, Tracy. Thank you. Bye-bye. Joe, I thought that was a fantastic conversation. [55:00] Not exactly uplifting. I was surprised at Ty's response. I thought maybe people would say we're in this weird, awkward moment where a lot of legacy issues are being discovered. But once AI actually gets deployed and starts redesigning some of the architecture, it'll be a lot more resilient. Apparently, that's not the case. That's a little bit worrying. software but it's small you can't even do it for something that says the browser i love that last point about how we're in the centaur age yeah where the strongest hacker is the computer working with a human but that may not be there for much longer that's going to be three months a year we have no idea but the presumption should be that it won't last very long etc also the idea of like a computer to be not to hack. What's wrong with you? Just teach it not to hack. If coding is going to be big business, which it is, you're going to be building a lot of good hackers. Yeah. And so the hackers proliferate. On that note, shall we leave it there? Let's leave it there. This has been another episode of the All Thoughts Podcast. I'm Tracy Allaway. You can follow me at Tracy Allaway. And I'm Joe Weisenthal. You can follow me at The Stalwart. Follow our producers, Carmen Rodriguez at Carmen Armand, Dashiell Bennett at Dashpot, Kale Brooks at Kale Brooks, and Kevin Lozano. And of course, you can chat about all of these topics 24-7 in our Discord, discord.gg slash oddlots. And for more oddlots content, you can check out our daily newsletter, which you can find at bloomberg.com slash oddlots. And if you enjoyed this conversation, if you like it when we talk about hacking, then please leave us a positive review on your favorite podcast platform. And if you're watching on video, then please leave a comment or like, or better yet, subscribe. And remember, if you're a Bloomberg subscriber, you can listen to all of free. All you need to do is find the Bloomberg channel on Apple Podcasts and follow the instructions there. Thanks for joining. Thank you. Congratulations! You've built a dashboard. But now comes the follow-up question. And the follow-up to the follow-up. And the dashboard for that. Meet Hex. Give everyone the power to ask their own questions, explore data, and build with AI. All in natural language. Because every answer should spark another question. Limited only by your curiosity, not your data team's bandwidth. . With ChatGPT, you can do more than get answers. You can get things done. Whether you're leading a big project, planning an elaborate trip, or trying to balance work and life, ChatGPT can help. Give it a goal, plus things like files, notes, or project plans, develop a trip itinerary with daily updates, or create a prioritized schedule. So you can spend less energy sorting out the details and more on bringing your biggest ideas to life. Get started at ChatGPT.com. Dear America, Toyota's Save Bucks on Trucks event is on. Haul it all with a powerful Tundra, or play hard in the rugged Tacoma. Toyota trucks are built for weekends that don't end when the pavement does. Boat ramps, campsites, trailheads, and everything in between. So don't wait. Haul home heavy duty savings and save bucks on trucks with Toyota. Toyota, let's go places. This is LeVar Arrington from Two Pros and a Cup of Joe. Running a small business means keeping track of a lot, but your finances shouldn't feel complicated. Let me tell you about Xero. That's X-E-R-O. Xero brings accounting, payments, payroll, and analytics together, giving you one clear view of your business. With easy-to-read dashboards, you can see your cash flow and understand exactly what's coming in. and what's going out. Xero's AI can save you time and provide insights to help you make smarter decisions while keeping everything simple and accessible. It's powerful enough for an accountant, but simple enough for you. Xero is the all-in-one to get business done. Learn more at Xero.com.