Mandia's Armadin Nets 90 Zero-Days to Automate Enterprise Defense

Building Defense for the Agentic Era: Kevin Mandia — David George, Kevin Mandia

David George, Kevin Mandia

Retaining human analysts in detection and response workflows guarantees failure against machine-speed adversaries that probe thousands of network paths simultaneously.

AI-assisted summary of Building Defense for the Agentic Era: Kevin Mandia — original source. Check the original for full context.

Source published:

Key ideas

  • Kevin Mandia launched Armadin alongside Travis Lanham, David Slater, and Evan Pena to pioneer autonomous AI offensive testing, discovering over 90 zero-days in Fortune 500 production environments without source code access within months of operation. (0:00)
  • The advent of machine-speed adversaries probing thousands of pathways simultaneously renders human-in-the-loop Security Operations Centers (SOCs) obsolete, forcing a shift toward automated detection, instant isolation, and compensating controls. (21:51)
  • Benchmarking offensive cyber kill chains across frontier models revealed that both open-weight and closed proprietary systems successfully solved the exact same 8 out of 20 scenarios, demonstrating a significantly compressed capability gap in security tasks. (30:00)
  • Because technical intellectual property advantages in AI decay within six months, enterprise security startups must rely on rapid go-to-market scaling, high-reputation Tier-1 enterprise customer halos, and continuous product iteration to build lasting moats. (42:30)

Detailed notes

## Background Published on October 6, 2026, by hosts David George and Kevin Mandia via RSS, this episode features a16z General Partner David George interviewing Armadin founder and CEO Kevin Mandia. The discussion centers on the reality of cybersecurity in the agentic era, exploring how machine-speed attackers force defenses to become autonomous, why traditional human-in-the-loop security is obsolete, and how Armadin identified more than 90 zero-days in production enterprise environments.

## TL;DR Cybersecurity veteran Kevin Mandia explains why artificial intelligence fundamentally breaks legacy defense models, transforming targeted 'sniper round' attacks into relentless, automated 'drone swarms' that operate at machine speed. To counter this threat, Mandia's startup Armadin uses autonomous AI agents to proactively attack enterprise networks, uncovering over 90 zero-day vulnerabilities in live Fortune 500 environments to prove real exploitability. Mandia argues that because machine-speed adversaries can probe thousands of vectors simultaneously, human analysts must be removed from the detection and response loop in favor of real-time autonomous controls. Looking forward, winning in this landscape requires combining offensive-trained AI models with rigorous containment architectures and an aggressive enterprise go-to-market strategy.

## Atmosphere & style The conversation carries an urgent, frontline intensity driven by Kevin Mandia's direct, no-nonsense delivery and decades of battle-tested security leadership. The tone blends wartime pragmatism with founder energy, moving fluidly between high-level football analogies and deep technical breakdowns of red-teaming, hyperattacks, and agent containment. Listening feels like sitting inside an executive digital war room where legacy paradigms are discarded in real time, leaving the audience with an exhilarating yet sober view of an unfolding AI arms race.

## Bulletin - `00:00` Kevin Mandia launched Armadin alongside Travis Lanham, David Slater, and Evan Pena to pioneer autonomous AI offensive testing, discovering over 90 zero-days in Fortune 500 production environments without source code access within months of operation. - `21:51` The advent of machine-speed adversaries probing thousands of pathways simultaneously renders human-in-the-loop Security Operations Centers (SOCs) obsolete, forcing a shift toward automated detection, instant isolation, and compensating controls. - `30:00` Benchmarking offensive cyber kill chains across frontier models revealed that both open-weight and closed proprietary systems successfully solved the exact same 8 out of 20 scenarios, demonstrating a significantly compressed capability gap in security tasks. - `42:30` Because technical intellectual property advantages in AI decay within six months, enterprise security startups must rely on rapid go-to-market scaling, high-reputation Tier-1 enterprise customer halos, and continuous product iteration to build lasting moats.

## Key takeaways - `00:00` Defenders cannot construct effective modern security without continuous testing against an elite offensive sparring partner that operates at machine speed. - `03:41` Armadin operates a deliberate two-act architecture: Armadin Red deploys AI offensively to uncover exploitable vulnerabilities, while Armadin Blue acts as an autonomous real-time tourniquet to intercept attacks without human latency. - `05:00` AI fundamentally alters attack economics by shifting from linear human penetration attempts to parallel, token-burning drone swarms that exhaust defensive resources. - `05:00` The primary gating constraint holding back large-scale criminal AI attacks today is anonymous GPU access and compute attribution rather than model capability. - `07:46` National cyber engagement doctrines are pivoting from disciplined, low-noise 'sniper rounds' toward brute-force, token-burning automated drone swarms where attribution collapses. - `10:00` Rather than continuously bombarding networks, Armadin maps an enterprise metadata twin using agent swarms and runs cheap heartbeat polling to trigger intense exploit attempts only when infrastructure changes or new threats drop. - `15:00` Legacy vulnerability scanners produce unmanageable noise by cataloging hypothetical CVEs, whereas autonomous offensive AI isolates and verifies genuine remote code execution with zero false positives. - `20:00` CISOs will be forced to accept imperfect automated 'field dressings' and patches because leaving humans in the detect-and-respond loop results in catastrophic network collapse against machine-speed intrusions. - `25:00` The industry's 'Mythos moment' established machine-driven offense as an undeniable reality, creating mutual urgency where hostile states rush to exploit weaknesses before enterprise war rooms permanently harden perimeters. - `27:30` Deploying offensive AI agents safely requires deterministic hard rules, hypervisor isolation, and passive prompt monitoring to eliminate wild goose chases and runaway compute waste without extinguishing model creativity. - `35:00` While human red teamers historically guided exploit discovery, offensive AI agents have crossed the threshold into fully autonomous zero-day discovery without human intervention. - `37:15` Threat intelligence has evolved through three distinct waves: reactive antivirus signatures, post-breach detection and incident response, and continuous proactive AI self-discovery. - `40:00` Surviving hyper-growth in enterprise AI security requires moving beyond intuition to industrialized processes, continuous weekly sales training, and shielding engineering teams from organizational chaos. - `45:00` Winning in cybersecurity demands earning the validation halo of Tier-1 institutions like money center banks and global airlines, backed by co-located engineering teams built for extreme iteration velocity.

## Detailed walkthrough ### `00:00` The 2000 Ravens Defense, 90 Zero-Days, and Getting Back on the Field

Drawing an analogy to legendary NFL units, Kevin Mandia frames the emerging reality of modern security around the principle that iron sharpens iron: “You don't have a defense unless you have a great offense to go up against.” Just as the historic 2000 Baltimore Ravens defense needed a relentless practice offense pushing them daily to reach greatness, Mandia explains that his new company, Armadin, exists to serve as that elite sparring partner—an all-star offensive unit that continuously hammers organizational perimeters so defenders can prepare for what is inevitably coming. The stakes could not be higher; since January of that year alone, Armadin’s automated platform uncovered over 90 zero-day vulnerabilities inside live production networks belonging to Fortune 500 enterprises, proving that the threat landscape has already outpaced conventional security testing.

Mandia spent three decades building cybersecurity institutions, most notably founding Mandiant and navigating its storied path through public markets and its ultimate acquisition by Google. When host David George asks why he decided to dive back into the startup arena rather than staying comfortable, Mandia admits he felt virtually compelled by the magnitude of the moment: “I don't want to sit out the AI shift change when I've done 30 years in security and the whole damn thing's about to change.” Meeting his co-founders—Travis Lanham, whom he calls a “generational talent,” David Slater, whom he describes admiringly as a “freak of nature,” and Evan Pena, an exceptional operator he had worked with previously—convinced him to return. Mandia was in his mid-50s and working in venture capital; he was not looking to start another company simply for the romantic thrill of being an entrepreneur or operational executive. Listening to their pitch, however, he realized that every enterprise on earth immediately requires what this team envisioned, and his decades of executive trust could accelerate its adoption.

The transition from human-driven security to artificial intelligence fundamentally rewrites the playbook. In Mandia’s blunt assessment, the past three decades of manual incident response, log triaging, and human penetration testing have been completely upended: “Everything I did is dead and everything else is new.” The sheer computational disparity is staggering—tasks that would take an army of 70 elite human analysts working in tandem can now be executed by AI in a single microsecond, rendering traditional defense models obsolete overnight.

- **Mandiant Pedigree**: Kevin Mandia built Mandiant into the premier breach-investigation firm before its eventual acquisition by Google. - **Founding Team**: Armadin was conceived and launched by Travis Lanham, David Slater, and Evan Pena, with Mandia joining as CEO to accelerate go-to-market and enterprise adoption. - **Zero-Day Discovery**: Armadin surfaced more than 90 previously unknown zero-days in active, live production environments of Fortune 500 corporations within its first few months of operation.

---

`03:41` Armadin's Two Acts: The Offensive Cyber Cannon and Autonomous Defense

Armadin’s core architecture is split into a deliberate two-act roadmap designed to meet the adversary on equal technological footing. Act One, known as Armadin Red, deploys frontier artificial intelligence models exclusively on offense to discover whether an organization possesses truly exploitable risk. Mandia emphasizes that the good guys cannot afford to be passive observers while adversaries operationalize frontier models. Defending modern networks requires proactively building the most sophisticated offensive tooling available and firing it directly at enterprise infrastructure to uncover structural flaws before malicious actors find them.

```mermaid flowchart LR accTitle: Armadin Two-Act Architecture accDescr: Visual representation of Armadin Red offensive cannon testing risk and feeding into Armadin Blue autonomous defense force field.

subgraph Act1["Act One: Armadin Red"] A["Frontier AI Models"] --> B["Offensive Cyber Cannon"] B --> C["Continuous Exploitable<br/>Risk Discovery"] end

subgraph Act2["Act Two: Armadin Blue"] D["Autonomous Tourniquet"] --> E["Real-Time Interception"] E --> F["Protective Force Field"] end

C -->|"Feeds telemetry & exploit data"| D ```

Mandia argues that the only viable defensive posture is maintaining a technological lead over the adversary: “The good guys have to build the offensive cyber cannon and shoot it at networks to make sure those networks can withstand these attacks because they're the ones that are coming.” If Armadin can stay even five minutes ahead of nation-states, organized cybercriminal syndicates, and opportunistic attackers, that offensive intelligence can be channeled into Act Two: Armadin Blue. Blue represents an autonomous, real-time defensive tourniquet—a machine-speed force field that intercepts attacks, contains damage instantly, and isolates compromised assets without waiting for human intervention.

- **Armadin Red (Act One)**: Focuses entirely on offense, leveraging frontier models to discover exploitable vulnerabilities across enterprise surfaces. - **Armadin Blue (Act Two)**: Translates offensive discoveries into an autonomous defense system designed to act as an instantaneous tourniquet against machine-driven intrusions. - **Competitive Margin**: The stated objective is maintaining at least a five-minute discovery advantage over external threat actors.

---

`05:00` Machine-Speed Adversaries: 25,000 Agents, Anonymous GPUs, and Structured Code

While AI-driven attacks are in their earliest phases, the capabilities under development are unprecedented. Mandia reveals that Armadin has already orchestrated systems with 25,000 autonomous agents operating in concert, performing complex reconnaissance and penetration routines without drifting off into bizarre dead ends or hallucinations. Having spent decades investigating intrusions, Mandia notes that human and synthetic attacks leave entirely distinct behavioral footprints. A human attacker moves methodically along a logical chain—breaking into system A, pivoting laterally to system B, and then targeting system C. Early machine-driven attacks, by contrast, act more like uncoordinated swarms: an agent might breach system A, hop to system B, and immediately loop back to attempt an exploit against system A again.

Despite these early tactical quirks, AI possesses decisive structural advantages over human operators: scale and velocity. Human attackers are constrained by scarce cognitive resources and must select a single high-probability path into an enterprise. Machine-speed adversaries face no such bandwidth limits; they can probe thousands of potential penetration vectors simultaneously at near-instantaneous speed. Dismissing the argument that AI models lack the creative spark needed for novel hacking, Mandia explains that identifying software vulnerabilities does not require human-style creativity or polyglot fluency: code is a structured language driven by formal deterministic processes, making it an ideal domain for large language models to master.

Mandia also pushes back forcefully against calls to artificially throttle AI development in the name of cybersecurity safety. Publicly available open-weights models have already crossed the threshold of offensive utility: “The open models are already good enough.” The primary bottleneck holding back a massive wave of criminal AI campaigns is not model sophistication, but compute attribution. Until bad actors can access top-tier GPU clusters anonymously without leaving financial or identity trails, sophisticated attacks will remain constrained. Mandia quips that cybercriminals naturally prefer anonymity over working out in the open: “If you can commit a crime anonymously, that's a lot smarter than doing it with your jersey on, with your name on it.”

- **Agent Orchestration**: Armadin runs up to 25,000 autonomous software agents simultaneously in tight coordination without operational breakdown. - **Tactical Signatures**: Human intrusions are linear (A to B to C); current AI intrusions display swarm-like, parallel, and occasionally repetitive lateral movement patterns. - **Speed Mismatch**: Operations that would require 70 human engineers can be executed by autonomous models within a microsecond. - **Code Advantage**: Because software and exploits operate within structured, deterministic syntax rather than messy conversational contexts, AI finds vulnerabilities with high efficiency. - **The Attribution Bottleneck**: The primary gating factor limiting large-scale criminal AI attacks today is the lack of anonymous GPU infrastructure.

---

`07:46` Cyber Doctrine at the Crossroads: Sniper Rounds vs. AI Drone Swarms

Drawing on his background investigating state-sponsored espionage campaigns on a daily basis, Mandia contrasts the historical doctrine of nation-state actors with the emerging capabilities of AI. Historically, elite military and intelligence agencies never utilized “spray and pray” tactics. Instead, espionage was characterized by extreme discipline and precision targeting: “Nations on offense have never, in my opinion, they've never really been, when you're hacking for espionage and for security reasons, you hack with what I would call kind of a sniper round.” State operators would quietly focus their limited resources on a narrow cluster of high-value targets—such as thirty critical defense contractors or specific military networks—and deploy tailored exploits designed to remain undetected for months or years.

The rise of generative models and autonomous agents upends this doctrine entirely, turning surgical strikes into brute-force computational assaults: “With AI, I think it becomes more like a drone swarm.” Rather than relying on a solitary operator quietly working through a perimeter, nations can now launch thousands of autonomous probes against an enterprise, burning compute tokens to exhaust defensive resources. While this swarm approach is noisier, more chaotic, and less surreptitious than a traditional sniper round, it is exponentially more comprehensive and difficult to repel.

This technological shift forces military strategists and national defense commands worldwide to rewrite their cyber engagement doctrines from scratch. Nations must now determine when the mission requires the stealth of a sniper round versus the sheer overwhelming power of a token-burning drone swarm. Defensive teams, in turn, are left facing anomalous, highly accelerated intrusions where attribution is completely obscured, making it impossible to immediately discern whether an incoming swarm is backed by a rival foreign superpower, an opportunistic cybercriminal group, or an automated script running on open models.

- **Sniper Round Doctrine**: Traditional nation-state cyber espionage focused on highly selective, low-noise targeting against narrow sectors (such as.mil domains or top defense contractors). - **Drone Swarm Doctrine**: AI-enabled offensive cyber doctrine utilizes parallel automated agents to exhaustively assault enterprise networks by burning raw compute tokens. - **Tactical Trade-offs**: Drone swarms trade stealth and elegance for speed, volume, and overwhelming exploit coverage. - **Attribution Collapse**: Defending against machine-speed swarms makes identifying the underlying perpetrator—whether a nation-state, criminal group, or rogue actor—nearly impossible in real time.

`10:00` The Democratization of Attacks and the Necessity of an Elite Offense

The advent of AI fundamentally changes the economics and distribution of offensive cyber capabilities. While a simplistic prompt like "hack abc.com" will not yield an effective, surreptitious attack without extensive training and expert human guidance, AI serves as an equalizer across the board. Lower-tier, less technical, and historically less successful threat actors will suddenly appear far more capable simply because of the sheer volume and automated scaling AI affords. Defenders will find themselves under assault by advanced models where true attribution becomes increasingly murky: is the adversary a hostile nation-state or a lone actor using an automated agent? Kevin Mandia emphasizes that “in the AI age, it does democratize far greater expertise.”

```mermaid flowchart TD accTitle: The Armadin Hyperattack and Continuous Polling Loop accDescr: Visual representation of how Armadin maps an enterprise, creates a metadata twin, polls for changes, and executes verified attacks.

subgraph Discovery ["1. Reconnaissance"] A["Drone Swarm of Agents"] -->|"Hyperattack"| B["Network Metadata Twin<br>(Services, Routes, Assets)"] end

subgraph Polling ["2. Heartbeat Polling"] B --> C{"Heartbeat Trigger?<br>(App update, route change,<br>new asset, or CVE drop)"} C -- "No Change" --> D["Cheap Background Polling"] D --> C end

subgraph Exploitation ["3. Autonomous Action"] C -- "Change Detected" --> E["AI Offensive Model Attack"] E --> F["Verified Remote Code Execution<br>(Zero False Positives)"] F --> G["Compensating Controls<br>(Armadin Blue Orchestration)"] end ```

To counter this shift, Mandia argues that an enterprise cannot build a functional defense without continuously testing against an elite offense. Drawing an analogy to the 2000 Baltimore Ravens, he notes that an all-time great defense needs a practice offense that relentlessly pushes them to their limits. In the AI era, human operators can no longer sit inside the tactical loop because machines execute too rapidly; defense must automatically "tourniquet the wounds" the moment an intrusion begins.

Armadin operationalizes this through what Mandia calls a **hyperattack**: - **Agent Drone Swarms:** Armadin deploys a coordinated swarm of agents to aggressively light up an enterprise's external perimeter, mapping every service, route, and system to construct a complete "metadata twin" of terabytes of network data from the attacker’s perspective. - **Cheap Heartbeat Polling:** Because blasting an entire network constantly with offensive models is cost-prohibitive and noisy, Armadin uses the metadata twin to poll cheaply on a regular heartbeat, probing specifically for structural alterations: an updated web application, an altered network route, a reconfigured service, or a newly spun-up machine. - **Triggered Offense:** High-intensity model testing is deployed selectively: (1) when network infrastructure changes, (2) when the external threat landscape shifts (e.g., fresh threat intelligence or a newly disclosed zero-day drops over a weekend), or (3) prior to high-stakes internal milestones like board meetings. - **Verified Exploitability:** Rather than flooding security teams with standard Common Vulnerabilities and Exposures (CVE) alerts, the system isolates whether a flaw genuinely yields remote command execution (RCE) or stable access, eliminating panic over harmless bugs.

`15:00` Moving Beyond Legacy Pen Testing to Production Zero-Days

Legacy penetration testing and vulnerability scanning—historically dominated by tools from vendors like Tenable, Rapid7, and Qualys—primarily catalog known vulnerabilities and check whether external service banners match published CVEs. Kevin Mandia contrasts this with the paradigm shift pioneered by CrowdStrike, which redefined traditional antivirus (AV) into Endpoint Detection and Response (EDR) through fundamental architecture changes. Mandia asserts that autonomous AI offense will become as ubiquitous as AV once was, because static pen testing merely produces an unmanageable list of vulnerabilities that do not matter while failing to verify real exploitability.

Traditional tools rely on brute-force checks rather than a learning system that memorizes and navigates unique enterprise topography. By contrast, Armadin trains and post-trains its models with elite human red teamers and professional exploit developers. This enables the AI agents to uncover complex logic flaws in custom-built applications rather than simple code misconfigurations, exhausting every reachable route black-box from the public internet.

The practical results of this approach reveal a critical divergence between internal source-code audits and real-world attack surfaces: - **Over 90 Production Zero-Days Found:** Since January 2026, Armadin’s external black-box agents have discovered more than 90 zero-days in production environments belonging to major software and Fortune 500 enterprises—without ever having access to source code or internal application logins. - **Actionable Findings vs. Source Noise:** Scanning tools like Mythos that parse source code generate thousands of hypothetical issues, resulting in noise. Mandia stresses that Armadin delivers confirmed exploitation: “We are black box coming from the internet over 90 zero days in major software companies.” - **Immediate Incident Response:** When Armadin discovers exploitable access, the team alerts the target company's CISO—typically within 48 hours—to demonstrate verified remote code execution in their DMZ, prompting organizations to enter active incident response mode rather than treating the alert as routine hygiene.

`18:00` Autonomous Defense: Introducing Armadin Blue

Pinpointing remote vulnerabilities is only the initial half of the problem. Mandia explains that the platform is intentionally split into two coordinated capabilities: **Armadin Red** (the offensive agent swarm) and **Armadin Blue** (the automated defensive response layer). It is insufficient to merely drop an alert on a CISO's desk and walk away; security operations require closing the exposure window in lockstep with discovery.

Kevin Mandia outlines the ultimate goal of modern security leadership: “The true north for every CISO should be effective autonomous response.” To achieve this, Armadin Blue uses real-time telemetry from exploitable risks discovered by Armadin Red and interfaces directly with the customer’s defensive enforcement plane—such as endpoint detection agents (EDR) and perimeter firewalls. By pushing automated compensating controls at machine speed, Armadin Blue neutralizes an attack path within minutes of discovery, cutting off external adversaries before their own automated models can locate and exploit the same opening.

`20:00` The Inevitability of Autonomous Defense and the “Field Dressing” Reality

Kevin Mandia argues that autonomous defense is rapidly transitioning from a theoretical ambition to an inescapable reality. Even if initial safeguards deployed over the coming months are rudimentary, the sheer operational tempo of modern adversaries will force enterprises to adopt autonomous countermeasures within the next year. Facing the harsh trade-offs of modern network security, Mandia is unequivocal about prioritizing imperfect automated interventions over an active compromise: “I'd rather have a bad patch stopping a bad guy from getting in than have an intrusion.” The paramount objective remains denying an unknown actor arbitrary access inside an enterprise environment, leading legacy defense giants—such as CrowdStrike, Palo Alto Networks, and Fortinet—to aggressively pivot toward autonomous capabilities.

Mandia draws a vivid parallel between these initial autonomous responses and emergency battlefield medicine:

> “And I likened it to, you know, kind of field dressing in war. Someone gets shot, you patch it up, but that's not the hospital, you know. That's a, hey, we kind of stopped the bleeding. But then you've got to maybe do something else with more time in humans, potentially, or even, you know, a genic approach to it down the road.”

Consequently, Chief Information Security Officers (CISOs) will find autonomous defense operationalized across their environments regardless of whether they actively seek it out, simply because the major security platforms they have already purchased are building these reflexes directly into their stacks.

`21:51` Redefining the SOC: Why Humans Cannot Remain in the Loop

Addressing David George’s question about the future of the Security Operations Center (SOC) and whether his thirty years of security experience have become irrelevant, Mandia emphasizes that a CISO’s true north must now be effective autonomous security. While retaining high-caliber talent remains critical, organizations are fundamentally evaluating which legacy workflows survive in the AI age. Mandia warns that keeping people in operational workflows where adversaries move at machine speed is an untenable liability:

> “If you have humans in the detect and respond loop, you're going to be too slow.”

Cybersecurity has historically cleaved into prevent, detect, and respond. AI is rapidly dominating prevention while taking over detection and response, compressing the response window to near zero. Mandia describes this using a stark analogy:

```mermaid flowchart TD accTitle: The Collapse of Human Response Windows accDescr: Diagram illustrating how machine-speed intrusions bypass traditional human SOC detection and response loops.

subgraph Offense["Autonomous Adversary"] A["AI Exploit Discovery"] --> B["Agentic Command & Control"] B --> C["Machine-Speed Lateral Proliferation<br/>(1,000 parallel paths)"] end

subgraph Defense["Traditional vs Autonomous Defense"] C --> D{"Defensive Posture"} D -->|"Human-in-the-Loop SOC"| E["Pop the Balloon:<br/>Instant Network Collapse"] D -->|"Autonomous Defense"| F["Automated Prevent & Lockdown Traps"] end ```

When Armadin executes internal red-team simulations using agentic command-and-control, the contrast with human operators is striking. A human analyst moves slowly, typing individual passphrases and executing single lateral movements one machine at a time. An agentic exploit, by contrast, probes and executes across a thousand targets simultaneously. Once an adversary of that nature gains a foothold, Mandia explains, “it's like the balloon popped”—the entire defensive perimeter bursts instantly. As automated detection and response compress into sub-second timelines, the boundary between prevention and response blurs entirely.

- **Obsolescence of SOC routines:** Entire workflows currently being automated inside SOCs will soon be eliminated altogether rather than merely streamlined. - **Defense in depth:** Even with proactive shields, Mandia notes that organizations must maintain layered fallback systems and automated traps, assuming that adversaries will eventually discover zero-day vulnerabilities in unassessed production applications. - **CISO workforce evaluation:** Enterprise security leaders are systematically reviewing their headcounts, organizational structures, and core processes to determine what a modern security team looks like, even though definitive answers have not yet settled across the industry.

`25:00` The Window of Exposure, Mutual Desperation, and the Mythos Moment

Discussing the exposure of Fortune 500 enterprises, Mandia explains that while vulnerabilities are shrinking rapidly, both attackers and defenders are operating under profound urgency. Hostile nation-states like Russia and Iran sense a closing window of opportunity to exploit existing structural weaknesses before automated defenses harden. Concurrently, defenders recognize that although the current transitional phase heavily advantages offensive AI, autonomous defense trained on offensive methodologies will eventually prove far more diligent and capable than human analysts manually inspecting network packets.

Mandia characterizes the present enterprise environment as an all-hands-on-deck digital war room:

> “There's no way to make the next year pretty. That's the best way to say it. You know what I mean? It's a cocktail party out there right now, a digital cocktail party. And everybody's in a race.”

Every major Tier-1 enterprise is actively scanning for perimeter exposures in real time, fostering unprecedented collaboration where CIOs, CISOs, business unit leaders, and product engineers assemble in dedicated war rooms to remediate vulnerabilities immediately. David George notes that premier tech organizations have reassigned substantial portions of their engineering and research divisions solely to fortify internal perimeters. According to Mandia, this urgency was catalyzed by the "Mythos moment." While security pioneers recognized the shift long before, Mythos acted as an inescapable proof point for the reality of machine-driven offense, compelling software vendors to perform rigorous code attestations and permanently resetting industry expectations.

`27:30` Caging the Beast: Model Vulnerabilities and Armadin’s Safety Architecture

When evaluating the incident at Hugging Face and broader vulnerabilities in AI labs, Mandia observes an enduring industry pattern: in every fundamental technological shift, organizations systematically underestimate both adversary capabilities and the autonomous potential of the models themselves. In the high-stakes race to develop cutting-edge foundation models—resembling a modern lunar landing race—frontier AI labs prioritize velocity, sometimes moving so fast that leadership appeals to government intervention because internal innovation outpaces internal controls. The core friction arises because machine learning researchers often lack deep defensive security tradecraft, while seasoned security experts do not fully understand the inner mechanics of generative models.

Mandia reveals that Armadin intentionally engineered the very offensive capabilities the security community fears, but surrounded their agents with strict, multi-layered containment:

> “Assume every layer of your security will fail, and you have to have deterministic rules that eliminate certain activities.”

```mermaid flowchart LR accTitle: Armadin Multi-Layered Agent Defense Architecture accDescr: Structural diagram of the layered controls used by Armadin to cage autonomous offensive AI agents.

subgraph Isolation["Isolation Layer"] A["Hypervisor Isolation"] B["Host-Based Lockdown"] C["Proxy Awareness & Filtering"] end

subgraph Inspection["Behavioral Governance"] D["Passive Prompt Inspection"] E["Deterministic Hard Rules"] end

subgraph Control["Agent Runtime"] F["Agent Activity"] --> D D -->|Waste or Drift| G["Immediate Process Kill"] D -->|Verified Safe| H["Target Execution"] F --> E E -->|Rule Violation| G end

Isolation --> Control ```

To govern these offensive agents, Armadin implemented a robust containment architecture: - **Host-level isolation:** Enforcing strict hypervisor boundaries, host lockdowns, and dedicated proxy configurations that constrain network communications. - **Passive prompt inspection:** Surreptitiously monitoring every prompt generated by autonomous agents in real time to detect unexpected drift or unsafe instructions. - **Cost-driven intervention:** Mandia notes that when Armadin terminates an active agent, the root cause is rarely an imminent safety breach; more frequently, the agent has diverged into an unproductive loop or a repetitive "wild goose chase" that squanders compute budget. - **Deterministic guardrails:** Operating under the assumption that heuristic or probabilistic safeguards will inevitably fail, requiring rigid, non-negotiable deterministic rules to forbid unsafe operational behaviors entirely.

`30:00` Pairing Red Teamers with AI and Benchmarking Open vs. Closed Models

Domain expertise in offensive security cannot be simulated by pure AI theory alone. Kevin Mandia explains that building effective evaluations for autonomous agents requires people who have spent years breaking into enterprise environments, which is why Armadin pairs seasoned red teamers and exploit developers directly with AI researchers. Without practical field experience, engineers run tests and inevitably miss critical edge cases that a seasoned hacker would anticipate immediately. To test model capabilities, Armadin benchmarked both open-weight and frontier closed models against historical kill chains observed across actual victim sites and real-world network penetrations.

Interestingly, both open and frontier closed models topped out at completing the exact same number of kill chains: 8 out of 20. Kevin notes that while closed models reached exploitable risk faster and with lower latency, open-weight models ultimately achieved the identical end state when permitted to run longer. On metrics of overall effectiveness and attack creativity, the performance curves hit diminishing returns at the exact same threshold, meaning the capability gap between open and closed models in cybersecurity offensive tasks is significantly narrower than in other modalities.

```mermaid flowchart LR accTitle: AI Model Offensive Evaluation Pipeline accDescr: Real-world attack scenarios run through open and closed models reaching identical 8 of 20 kill chain completion. subgraph Input["Attack Scenarios"] K["20 Real-World Kill Chains"] end subgraph Models["Model Execution"] C["Closed Frontier Models<br/>(Faster, higher initial cost)"] O["Open-Weight Models<br/>(Slower run time, catch up)"] end subgraph Outcome["Benchmark Result"] R["Diminishing Returns Plateau<br/>(Both solve 8 of 20)"] end K --> C K --> O C --> R O --> R ```

- Kevin Mandia points out the necessity of cross-disciplinary pairing: “So that's why Armadin, we combine the exploit developer types and red teamers with the AI folks because our evals most of the time are made by the red teamers.” - Assessing model performance across open versus proprietary ecosystems, Kevin observes: “So in the cyber world, the differentiation between closed and open is not as great as in other domains probably.” - David George agrees with the findings, noting that across the industry the capability gap between open-weight and closed models continues to compress.

---

`32:30` Forensics of the AI Era and "Caging the Beast"

Kevin draws a direct parallel between the early transition to cloud infrastructure and the current emergence of autonomous AI agents. During the cloud revolution, incident responders at Mandiant had to redefine what an intrusion looked like and uncover what telemetry cloud providers failed to record. Today, security teams face the same challenge with AI breaches: understanding how attackers exploit models from labs like OpenAI and Anthropic, figuring out what data those providers should log, and establishing detailed audit trails so investigators do not spend two weeks conducting post-mortem forensics. Armadin addresses this on the offensive side by recording absolute accountability for its own systems, capturing the source IP address, exact timestamp, and specific command for every single agent action so operations can be replayed frame by frame.

Navigating AI safety on the offensive side requires balancing intelligent autonomy with deterministic guardrails—an art form Kevin calls caging the beast. If defensive engineers make an offensive agent entirely deterministic and overly restricted, they strangle the model’s creativity and fail to discover novel attack paths. Conversely, leaving an agent unchecked risks unintended collateral damage. Armadin solves this by building inbound and outbound classification layers trained by human feedback to inspect inputs and outputs in real time. Whenever an agent encounters an ambiguous or unexpected payload, the system automatically pauses operations and routes the decision to a human operator.

- Kevin Mandia emphasizes the necessity of complete auditability for AI actions: “Like we log every single thing our agent does. Source IP address, time and date, and what it did.” - Reflecting on how security leaders continually misjudge the capabilities of high-end adversaries and emerging tech, Kevin warns: “My whole career, everybody underestimates the top tier of what you're up against.” - Explaining the governance balance required when deploying AI on offense, Kevin remarks: “Got to cage the beast, David.” - When an automated classifier hits an unresolvable situation, the operational doctrine is strict: “pause, escalate, judge.”

---

`35:00` High-End Operators and Crossing the Autonomous Zero-Day Threshold

The human talent guiding Armadin’s autonomous agents brings elite offensive pedigrees, typically averaging 15 years of dedicated red teaming and vulnerability research. Kevin shares that over the course of their careers, Armadin’s core team has red-teamed 99 of the Fortune 100 companies—with Kevin joking that there is only one company left on the list that has continually eluded them despite his admiration for their products. This deep institutional knowledge is used to train and supervise the agents, removing the tedious low-level labor that historically consumed a penetration tester's day.

While the majority of the 90+ zero-day vulnerabilities Armadin discovered over the past year were ultimately validated and closed out by human operators, AI was responsible for taking over 90% or more of the repetitive attack surface discovery and web application probing. However, Kevin reveals a profound recent turning point: the most recent zero-days were discovered entirely by the technology itself without human direction.

- The team possesses immense enterprise testing background: “15 years on offense, 15 years of red teaming. I think we've red teamed literally 99 of the Fortune 100 throughout our careers.” - Automated systems now carry the overwhelming majority of offensive workloads: “...we're leveraging AI to do 90 plus percent of the tedial work, which is pen testing, done, automated.” - Announcing the arrival of fully autonomous discovery, Kevin Mandia states: “The last few zero days, tech found it.” - Kevin emphasizes that the offensive landscape has fundamentally shifted: “So we've made the turn. And most people already have made the turn if you on offense leveraging AI your AI agents are finding zero days.”

---

`37:15` Company Building: Mandiant’s Origins and the Three Waves of Threat Intelligence

Reflecting on the evolution of cybersecurity company building, Kevin looks back to February 2004 when he launched Mandiant as a self-funded, profitable startup. At the time, Mandiant operated on an unconventional thesis that contradicted traditional security marketing. Their original, slightly dry website copy ran with the premise that organizations could not rely solely on preventive measures, which eventually evolved into the blunt motto: *“Security breaches are inevitable.”* The business model was straightforward: respond to every major breach in the world to gain proprietary first-mover intelligence on attacker tactics, and use that insight to build better defenses.

```mermaid flowchart TD accTitle: The Three Waves of Threat Intelligence accDescr: Evolution from reactive Antivirus signatures to breach response EDR to Armadin's continuous AI offensive self-discovery. subgraph Wave1["Wave 1: Antivirus (AV)"] W1["Signature-based prevention<br/>Relied on victims submitting malware"] end subgraph Wave2["Wave 2: Post-Breach Detection (EDR / Mandiant)"] W2["Incident response & telemetry<br/>Learn TTPs after major victim compromise"] end subgraph Wave3["Wave 3: Continuous AI Probing (Armadin)"] W3["Autonomous red teaming<br/>Find exploitable zero-days before attackers"] end Wave1 -->|"Easily evaded"| Wave2 Wave2 -->|"Too reactive / machine speed gap"| Wave3 ```

Kevin frames Armadin as the third great wave of threat intelligence. The first wave was traditional antivirus (AV), a flawed reactive model reliant on malware signatures that depended on ordinary victims discovering and submitting malware. The second wave, embodied by Mandiant and endpoint detection players like George Kurtz's CrowdStrike, added a second layer by learning attacker techniques directly from live incident investigations. However, waiting for a defense contractor or enterprise peer to be compromised before sharing threat indicators is no longer sufficient against machine-speed adversaries. Armadin represents the third wave: proactive, continuous AI-driven offensive testing that uncovers an enterprise's vulnerabilities internally before an adversary ever identifies them.

- Mandiant’s foundational business thesis rested on frontline engagement: “And the premise was that let's respond to every breach that matters so we have first mover intelligence on how to prevent it happening again.” - Kevin highlights the absurdity of outdated threat-sharing loops: “Like, why are we waiting for a victim and learn from that? That's ridiculous. You've got to find your own problems first.” - Mandiant built an elite, high-compensation culture centered on dense talent: “When I started Mandiant, it was, hey, this is what we do for a living. Let's make enough money to do it for a living. That's it. I mean, so we hired the best people and we had a philosophy of we're going to pay you more than our competition, but you're going to work harder.” - Kevin notes the enduring industry-wide footprint of that talent pool: a colleague texted him pointing out that approximately 43% of the RSA Conference main stage keynote speakers were Mandiant alumni, tracing a lineage that runs back through Foundstone in 2000 alongside George Kurtz.

`40:00` Scaling at Hyperspeed and Institutionalizing Process

Kevin Mandia outlines the immense pressures and opportunities facing Armadin, remarking that while the company enjoys an “80 mile an hour tailwind,” they must urgently build their sales force, go-to-market engine, and international presence. In today's market, surviving and beating legacy incumbents requires nailing the right technology at the right moment while already preparing subsequent acts: “And you better already have your act two ready, and your Act 3 behind that ready because you don't want to get boxed into a corner.” While consumer AI startups have seen revenue skyrocket overnight, Mandia notes that enterprise security sales operate differently, even if compression is occurring. Looking at Wiz reaching over $100 million in ARR within 18 months of their first release, Mandia states, “We're going to try to beat that.” Achieving that pace without allowing the wheels on the bus to get wobbly demands raising capital early and establishing disciplined, scalable leadership.

Reflecting on his past, Mandia contrasts Armadin’s reality with the early days of Mandiant, which was self-funded, profitable, and faced minimal competition because the broader industry did not yet believe in the premise of inevitable breaches. At extreme growth speeds, founders cannot rely purely on grit and intuition: “You can't win with grit, gut and moxie. You actually have to proceduralize, almost industrialize the Armadin way.” Compounding this challenge is the sheer velocity of AI development. In the past, companies could conduct sales training once a year at an annual January kickoff. Now, with products updating dramatically every two weeks, sales teams must be continuously re-educated. Mandia underscores that despite AI's rise, enterprise security sales still fundamentally rely on human relationships: “When I look at AI's influence on sales, the reality in enterprise security sales, people still buy from people.” Therefore, companies must build institutionalized processes to train sales reps weekly so customers are never burdened with deciphering rapid product shifts.

```mermaid flowchart TD accTitle: The Armadin Velocity and Execution Loop accDescr: A cyclical feedback and execution loop showing continuous customer feedback directly driving engineering and sales enablement.

subgraph ProductLoop ["Product & Customer Engine"] Cust["Enterprise Customers"] -->|"Direct Feedback Loop"| Eng["Engineering Team (In One Room)"] Eng -->|"Bi-weekly Product Advancements"| GoToMarket["Sales & GTM Engine"] end

subgraph ScaleOps ["Operational Foundation"] GoToMarket -->|"Continuous Weekly Training"| Cust Leadership["Scalable Leadership & Process"] -->|"Eliminate Internal Chaos"| Eng Leadership -->|"Industrialized Playbooks"| GoToMarket end ```

`42:30` Competitive Mindset, Hiding Chaos, and Transient IP

Mandia stresses that Armadin does not aspire to settle for second place in its domain: “I'm involved in, we are not ever aiming to be, let's be number two in our space. That sounds fun. It is be the best in the world at what you do.” Drawing analogies to Tom Brady and LeBron James, he explains that world-class performers work harder to stay on top, constantly testing their standing through customer feedback. For an engineering organization, establishing a tight, unfiltered feedback loop directly from the customer into the engineers is essential to maintain this standard.

Internally, high-velocity execution requires shielding the team from disorder. Mandia argues that a CEO's primary obligation is to absorb and manage organizational turbulence: “A CEO's job is to absolutely hide chaos at a company from the employees.” Employees should never feel that operations are loose or directionless; they must have clear, designated leaders and institutionalized procedures to follow. Mandia also warns that technical intellectual property is inherently ephemeral in the AI era. A company must assume that whatever differentiated feature it possesses today will be replicated within six months. Because IP advantages expire so quickly, building a recognizable brand and a relentless go-to-market execution engine becomes the true moat. Mandia synthesizes the four essential pillars required to win today into funding, speed, branding, and an accelerated go-to-market buildup.

`45:00` Winning the Enterprise Halo and the Generational Market Shift

David George points out that Wiz succeeded not only through category creation, but because it met an immediate, burning demand that struck CISOs like a ton of bricks. Mandia agrees that Wiz executed brilliantly, highlighting the necessity of capturing a respected “halo effect” within enterprise cybersecurity. That halo cannot be earned through trivial accounts; it is won by solving the hardest problems for Tier-1 institutions: “You don't get the halo if you make them happy in cybersecurity, right. But the money center banks do. The best retail does. The airlines do.” For that reason, Armadin is rigorously focused on enterprise accounts from day one.

Addressing how the current landscape differs from previous eras, Mandia observes that an influx of founders and venture capital means virtually every segment is crowded. No modern security company will enjoy an uncontested market. Consequently, the only sustainable differentiator is flawless customer satisfaction: “There is nothing else that will differentiate you other than your customer base raving about you.” Armadin complements this philosophy by keeping all of its engineers co-located in a single physical room to maximize decision-making speed and eliminate the overhead of distributed teams. Mandia and George conclude that cybersecurity is experiencing the tailwind of a lifetime, as AI will force organizations to completely tear down and revamp their entire security tech stacks over the next two years.

- **Enterprise Validation**: High-stakes customers such as global money center banks, critical retail brands, and major airlines confer the necessary security halo that smaller accounts cannot provide. - **Differentiated Execution**: In an oversaturated market, viral marketing cannot replace the foundational playbook: “Get customer, make customer happy, repeat.” - **Co-located Engineering**: Keeping technical talent in a single room prevents communication drag, allowing engineers to stand up and resolve problems across twenty people instantly. - **Tech Stack Overhaul**: The next two years will see sweeping rip-and-replace cycles across legacy cybersecurity infrastructure as autonomous and AI-driven solutions take over.

## Notable quotes > `21:51` If you have humans in the detect and respond loop, you're going to be too slow. — Kevin Mandia

> `18:00` The true north for every CISO should be effective autonomous response. — Kevin Mandia

> `00:00` You don't have a defense unless you have a great offense to go up against. — Kevin Mandia

> `20:00` I'd rather have a bad patch stopping a bad guy from getting in than have an intrusion. — Kevin Mandia

> `27:30` Assume every layer of your security will fail, and you have to have deterministic rules that eliminate certain activities. — Kevin Mandia

> `42:30` A CEO's job is to absolutely hide chaos at a company from the employees. — Kevin Mandia

> `45:00` There is nothing else that will differentiate you other than your customer base raving about you. — Kevin Mandia

> `32:30` My whole career, everybody underestimates the top tier of what you're up against. — Kevin Mandia

## Mentioned Kevin Mandia, David George, Travis Lanham, David Slater, Evan Pena, George Kurtz, Armadin, Armadin Red, Armadin Blue, Mandiant, Google, CrowdStrike, Palo Alto Networks, Fortinet, Tenable, Rapid7, Qualys, Mythos, OpenAI, Anthropic, Hugging Face, Wiz, Foundstone, Baltimore Ravens

## Video description a16z General Partner David George sits down with Armadin founder and CEO Kevin Mandia to discuss what happens to cybersecurity when attackers can operate at machine speed. After 30 years in security and building Mandiant, Kevin says AI convinced him to get back on the field. He explains how AI changes the economics of cyberattacks, allowing attackers to probe thousands of paths simultaneously, and why that means defense will ultimately need to become autonomous too. They also unpack Armadin’s approach: continuously attacking customers’ systems with AI to find exploitable vulnerabilities before adversaries do, then building toward autonomous defenses that can respond in real time. Kevin shares what Armadin has learned from finding more than 90 zero-days in production environments this year, why humans can’t remain in the detect-and-respond loop, and how the entire security stack could change over the next few years.

[Source](https://mgln.ai/e/1344/afp-848985-injected.calisto.simplecastaudio.com/3f86df7b-51c6-4101-88a2-550dba782de8/episodes/24f18a48-5a9a-44ed-905a-34359aaf1190/audio/128/default.mp3?aid=rss_feed&awCollectionId=3f86df7b-51c6-4101-88a2-550dba782de8&awEpisodeId=24f18a48-5a9a-44ed-905a-34359aaf1190&feed=JGE3yC0V)

中文简报

Mandia创立的Armadin发现90个零日漏洞以推进企业防御自动化 面对同时探测数千条网络路径的机器速度对手,在检测和响应工作流中保留人类分析师注定会失败。 网络安全资深人士Kevin Mandia解释了人工智能为何从根本上打破了传统的防御模型,将针对性的“狙击手”攻击转变为以机器速度运行的无情、自动化的“无人机蜂群”。为了应对这一威胁,Mandia创立的初创公司Armadin利用自主AI智能体主动攻击企业网络,在财富500强企业的生产环境中发现了90多个零日漏洞,以此证明实际的可利用性。Mandia认为,由于机器速度的对手能够同时探测数千个向量,检测和响应环节必须剔除人类分析师,转而采用实时的自主控制。展望未来,在这一格局中取胜需要将经过攻防训练的AI模型与严格的遏制架构以及积极的企业级市场拓展战略相结合。 Kevin Mandia与Travis Lanham、David Slater以及Evan Pena共同创立了Armadin以开创自主AI攻击性测试,在运营数月内且未获取源代码访问权限的情况下,就在财富500强企业的生产环境中发现了90多个零日漏洞。 (0:00) 能够同时探测数千条路径的机器速度对手的出现,使依赖“人在回路”的安全运营中心(SOC)过时,迫使行业转向自动化检测、即时隔离以及补偿性控制。 (21:51) 在前沿模型间对攻击性网络杀伤链进行基准测试显示,开源权重模型和闭源专有系统成功解决的场景完全相同,均为20个中的8个,这表明安全任务中的能力差距已显著缩小。 (30:00) 由于AI领域的专有技术优势会在六个月内衰减,企业安全初创公司必须依靠快速的市场拓展规模化、声誉卓著的顶级企业客户光环以及持续的产品迭代来构筑持久护城河。 (42:30)

Reading summary

Kevin Mandia argues that the emergence of machine-speed artificial intelligence renders traditional, human-in-the-loop security operations centers obsolete. Defending enterprise perimeters now requires autonomous offensive testing paired with automated, real-time response systems. Obsolescence of Human-Paced SOC Workflows (0:00) Mandia asserts that conventional penetration testing, log triaging, and manual incident response cannot withstand AI-driven threats. Tasks requiring 70 human analysts can now be carried out by models in a single microsecond, while autonomous swarms can probe thousands of vectors simultaneously. Unlike human intrusions that follow a linear path from system to system, synthetic attacks display parallel, swarm-like patterns that burn compute tokens across targets. Mandia argues that keeping people in operational detection and response loops introduces untenable latency, warning that perimeters collapse entirely once agentic intrusions achieve initial entry. Proactive Discovery via Continuous Hyperattacks (10:00) Mandia states that a competent defense cannot exist without continuous testing against an elite offense, comparing the dynamic to the 2000 Baltimore Ravens practicing against a top-tier offense. Armadin operationalizes this through 'hyperattacks' by deploying agent swarms that map external enterprise infrastructure to generate a metadata digital twin. Instead of relying on static banner matching or code audits that generate noisy alerts, the platform uses low-cost heartbeat polling to detect route, code, or asset changes, launching targeted offensive models to verify remote command execution. Mandia reports that this approach surfaced more than 90 production zero-day vulnerabilities across Fortune 500 networks since January, with the most recent zero-days identified autonomously without human guidance. The Rise of Autonomous Real-Time Tourniquets (18:00) Finding exploitable flaws represents only the first half of the architectural shift; enterprises must automate the response layer to close exposure windows. Through Armadin Blue, telemetry from offensive discoveries connects directly into endpoint detection and perimeter firewalls to deploy machine-speed compensating controls. Mandia describes these early interventions as emergency battlefield 'field dressings'—imperfect stopgaps that arrest lateral spread and deny unauthorized access until permanent remediations occur. Mandia forecasts that enterprises will be forced to adopt autonomous countermeasures within the next year, largely because incumbent defense platforms are embedding automated controls directly into existing stacks. Model Containment and Evaluation Realities (27:30) Governing autonomous offensive agents requires balancing operational autonomy with deterministic constraints. Armadin isolates its agents using hypervisor boundaries, host lockdowns, dedicated proxy filtering, and passive prompt inspection, while deterministic rules shut down agents that deviate into repetitive loops or compute waste. In empirical evaluations running 20 real-world kill chains, Mandia found that open-weight and closed frontier models completed the exact same number of intrusions (8 out of 20). While proprietary models operated with lower latency, open-weight models reached identical outcomes over time, showing a much narrower capability gap in offensive cyber tasks than in other domains. The Third Wave of Threat Intelligence and Enterprise Scaling (37:15) Mandia frames cybersecurity as having evolved through three distinct eras: first-wave antivirus based on reactive malware signatures, second-wave endpoint detection (EDR) learning from victim breach telemetry, and the emerging third wave of continuous AI offensive self-discovery. Because technical intellectual property in AI is easily replicated within months, Mandia argues that enduring competitive advantage rests on execution speed, co-located engineering teams, rigorous sales enablement, and serving Tier-1 enterprise accounts like global banks and airlines to build institutional trust. Mandia anticipates that the next two years will bring sweeping rip-and-replace cycles across enterprise security tech stacks. However, this transition is constrained in the near term by threat actors' access to anonymous high-end GPU infrastructure, and by the defensive necessity of establishing rigorous auditability before organizations fully cede control to autonomous response systems.

精炼阅读摘要

网络安全专家、Mandiant 创始人 Kevin Mandia 认为,人工智能技术的演进已使传统的被动式渗透测试与依赖人工响应的安全运营中心(SOC)彻底过时;唯有构建具备自主攻防能力的智能体平台,在对抗中持续检验防御韧性,才能应对机器速度下的新型网络威胁。 机器速度攻防重构安全范式 (0:00) Mandia 直言其从业三十年来建立的传统安全检测与事件响应模式已不复存在。以往 70 名专业分析师协同处理的任务,现代 AI 模型可以在单微秒内完成。防守方正面临前所未有的战术转变:国家级黑客以往依赖高精度的“狙击枪”式定向潜伏,如今则转向由海量自主智能体构成的“无人机蜂群”,通过大规模消耗计算 Token 对目标网络发起并行暴力探测。这种机制不仅在战术上打破了传统的单路径横向移动,也使得针对入侵源头的实时溯源几乎不可能实现。 尽管自主智能体的代码利用尚未具备人类的抽象创造力,但软件与网络协议高度确定性的语法结构,天然契合大型语言模型的逻辑推理能力。Mandia 指出,开源权重模型目前在漏洞利用方面的能力已十分充沛,限制恶意攻击全面爆发的核心瓶颈并非模型能力本身,而是黑客能否获取完全匿名且无痕迹的高性能 GPU 算力资源。 自主渗透测试与零日漏洞挖掘 (10:00) 传统漏洞扫描工具(如 Tenable、Rapid7、Qualys)长期以来仅依据静态版本比对来罗列 CVE 列表,导致企业安全团队淹没在大量无法被实际利用的虚假告警中。Armadin 则采用“超量攻击”架构,首先调动包含多达 25,000 个智能体的集群,从外部黑盒视角对目标网络进行全量服务与路由测绘,构建数字元数据孪生体;随后仅在基础设施出现变更、新漏洞披露或重大业务节点时,触发高强度攻击模型验证真实的可利用性,直接验证远程代码执行(RCE)。 自 2026 年 1 月以来,该系统在未获取源代码和内部权限的前提下,已在《财富》500 强企业的真实生产环境中挖掘出超过 90 个零日漏洞。在发展初期,超过 90% 的繁琐侦察由 AI 承担并交由资深红队专家验证,但最新一批零日漏洞已完全由 AI 自主发现。这一现实迫使收到通告的企业 CISO 必须在 48 小时内直接启动最高级别的应急响应,而非将其视为普通的日常补丁维护。 告别工单:自主止血与防御落地 (18:00) 面对机器速度发起的入侵渗透,Mandia 认为若在检测与响应闭环中继续保留人工审批环节,防守方将因反应迟缓而不可避免地崩溃。一旦攻击智能体打开突破口并展开千条路径的并行横向渗透,传统的防御边界就会像被刺破的气球般瞬间瓦解。因此,防御体系的重心必须从单纯的事后追查转向实时的自主阻断,安全防护层必须能在攻击发生的数分钟甚至数秒内自动施加止血带措施。 Armadin 规划了进攻与防御协同的两阶段架构:第一阶段(Armadin Red)作为进攻性火炮持续轰击自身资产以获取威胁情报;第二阶段(Armadin Blue)则直接与企业现有的 EDR 终端防御及边界防火墙对接,下发自动补偿控制策略。Mandia 坦言,这种前线应急包扎机制或许不如精细化的人工修补完美,但面对全面失陷的风险,宁可承受一个不甚完美的自动化热补丁,也绝不能让外部未授权攻击者在内网建立持久立足点。 智能体风险约束与开源闭源评测 (27:30) 部署高自主度的进攻型智能体伴随着巨大的失控风险。Mandia 强调,前沿 AI 实验室的研究人员往往缺乏严谨的攻防对抗防御经验,安全建设必须确立“假定所有概率性安全护栏都会失效”的原则。为此,系统在底层构建了由虚拟机监控程序(Hypervisor)强隔离、主机锁定和网络代理构成的运行时容器,并辅以无感提示词审查与确定性硬编码规则,在智能体出现逻辑漂移或无效空转消耗算力时执行硬性终止,并遵循“暂停、升级、人工裁决”的底线控制标准。 在模型效能对比方面,Armadin 将闭源商业前沿模型与开源权重模型接入由真实入侵案例构建的 20 条攻击链进行基准评测。评测结果显示,两者最终均在完成 8 条攻击链的节点触碰到了效能收益递减的平台期。虽然闭源模型在执行速度和延迟表现上更优,但开源模型在给予充分运行时间的前提下能够达成完全相同的利用深度,这表明在网络安全攻防任务中,开源与闭源模型的能力差距远比其他领域更为狭窄。 威胁情报演进与企业软件构建 (37:15) 回顾安全产业的演化路径,Mandia 将其划分为三个时代:第一代是以被动特征库匹配为核心的防病毒软件(AV),高度依赖受害者上报恶意代码;第二代是以 Mandiant 和 CrowdStrike 为代表的端点检测与响应(EDR),通过一线入侵事故调查获取攻击者战术技战术(TTP);第三代则是以 Armadin 为代表的持续性自主 AI 进攻测试,企业不再被动等待友邻机构受害后共享情报,而是通过对自身资产的主动推演抢先排除风险。 在商业落地层面,Mandia 认为 AI 时代的技术功能壁垒高度脆弱,任何专有软件优势都可能在六个月内被行业复刻。因此,企业长期的竞争护城河在于高强度的融资、敏捷的工程协同、品牌声誉以及针对超大型企业(如大型商业银行、顶级零售与航空枢纽)的标杆交付能力。为了维持极高迭代节奏并消除跨组织协作摩擦,Armadin 采取了将所有工程技术团队集中在同一物理办公室内的高密度工作机制。 Kevin Mandia 预测,随着自主智能体攻防对抗的全面展开,未来两年内全球企业的网络安全技术栈将迎来彻底的推倒重构。然而,在防御性补偿控制大规模实现完全自主化之前,整个产业仍将在脆弱的过渡期内直面技术代差带来的严峻冲击。

Detailed notes — zh

## Background 本期播客于 2026 年 10 月 6 日由 a16z 投资合伙人 David George 与网络安全传奇人物、Armadin 创始人兼 CEO Kevin Mandia 联合发布在 RSS/音频平台。节目围绕当攻击者以机器速度行动时网络防御将面临何种巨变展开,探讨了 AI 如何从根本上重塑网络攻击的经济学,以及为什么整个安全技术栈必须在未来几年内演进为由 AI 驱动的自主防御体系。 ## TL;DR 在经历了三十年安全生涯并打造出 Mandiant 之后,Kevin Mandia 携新创公司 Armadin 重返一线,旨在以 AI 对抗 AI。Armadin 采用“两幕战略”,首先通过模拟实战的 AI 攻击蜂群(Armadin Red)主动探测真实网络,今年已在企业生产环境中发现了超过 90 个零日漏洞;进而以此反哺并构建自适应的自主防御体系(Armadin Blue)。Kevin Mandia 深刻指出,在微秒级并发的机器速度面前,“人类在回路中”的检测与响应机制必然失效,开源模型的成熟使得攻击门槛大幅降低,安全团队唯有通过制度化流程、极致集中的协作以及攻克标杆客户赢得信任,才能在即将到来的技术栈大洗牌中构筑真正的护城河。 ## Atmosphere & style 对谈散发着一种沙场老将重披战袍的宿命感与紧迫感,兼具战略远见与实战硝烟味。Kevin Mandia 谈吐坦诚犀利、充满自信与激情,用巴尔的摩乌鸦队、战地止血带和勒布朗·詹姆斯等生动比喻,将晦涩的攻防攻坚战解释得直击本质。David George 的提问精准而富有节奏,双方的互动张弛有度,让整场播客既像是一场直面技术范式剧变的紧急作战推演,又是一堂关于极速扩张与创业心法的深刻大师课。 ## Bulletin - `00:00` Mandiant 创始人 Kevin Mandia 复出创立 Armadin,主张面对机器速度的攻击必须研发同等级别的 AI 进攻武器,以此倒逼并构建自主防御力场。 - `35:00` Armadin 自 2026 年初以来,仅凭纯外网黑盒攻击就在财富 500 强生产环境中发现了超过 90 个零日漏洞,且近期已实现由 AI 独立挖掘出 0-Day。 - `30:00` 攻防基准测试显示,开源权重模型与顶尖闭源模型在完整实战攻击链上的能力上限高度重合(均攻破 8/20 条链),核心差距仅在于推理速度与前期收敛成本。 - `20:00` Kevin Mandia 预测未来 24 个月内企业安全技术栈将被全面推倒重来,且必须将人类彻底移出“检测与响应”循环,由自主防御系统接管。 ## Key takeaways - `00:00` 网络安全底层逻辑已被连根拔起,人类在微秒级机器速度面前彻底失效,防御方必须先拥有顶级的 AI 假想敌进行持续施压。 - `03:47` Armadin 采用“两幕战略”:第一幕 Armadin Red 扮演进攻组主动出击探测可利用风险,第二幕 Armadin Blue 转化为自主实时防护力场。 - `05:41` 代码的高度结构化属性让 AI 能够并行探测数千条入侵路径,目前限制恶意黑客大规模使用自主 AI 的唯一瓶颈是匿名 GPU 算力资源的获取。 - `08:08` 国家级网络战军事学说正发生剧变,行动战术从极度隐秘克制的“单发狙击枪”转向不计 Token 消耗的饱和压制型“无人机蜂群”。 - `15:00` 传统渗透测试仅停留在已知 CVE 规则与虚警噪音,真正的 AI 渗透能够从黑盒视角挖掘专有系统中的深层业务逻辑缺陷,并完成完整漏洞利用链。 - `20:00` 在检测与响应环节保留人类会导致防线被瞬间击穿崩溃,CISO 必须以“有效的自主防御”为终极目标,容忍早期紧急补丁的粗糙以换取即时止血。 - `25:00` Armadin 对内部攻击 Agent 设置了虚拟机隔离、被动 Prompt 审查和确定性硬规则,绝大多数强制关停操作是为了防止模型陷入无效循环浪费算力资金。 - `30:00` 实战攻防测试表明开源模型与闭源模型在攻击上限上持平,网络安全领域的开源与闭源能力鸿沟远比其他垂直领域狭窄。 - `36:34` 威胁情报正在经历由“病毒库签名”(第一波)和“应急响应反哺”(第二波)向“AI 主动自查脆弱面”(第三波)的历史性跨越。 - `42:30` 技术每两周剧烈迭代一次,但企业安全销售的本质依然是“人向人买单”,企业必须通过每周系统化赋能确保销售团队紧跟前沿认知。 - `45:00` 安全初创企业必须瞄准货币中心银行、大型航司等最高难度客户,借助攻克极端场景所建立的“光环效应”在全行业树立不可动摇的信誉背书。 - `47:00` 在充满营销噪音的拥挤赛道中,唯一不变的护城河是“获取客户并让其狂喜”,Armadin 坚持工程师全员物理同室办公以保证超光速协同开发。 ## Detailed walkthrough ### `00:00` 序言与重返战场:AI 浪潮颠覆三十年安全认知 网络防御的本质在于必须拥有极其强大的假想敌进行对抗演练。正如 2000 年那支名垂青史的巴尔的摩乌鸦队(Baltimore Ravens)顶级防线一样,若想打磨出无懈可击的防守,在训练场上就必须有一支倾尽全力施压的进攻组。在经历三十年的网络安全生涯并打造出顶尖安全公司 Mandiant(后被谷歌收购)之后,Kevin Mandia 决定在五十多岁的高龄重返一线,出任新创公司 Armadin 的创始人兼 CEO。促使他复出的核心催化剂并非风险投资的诱惑,也不是单纯的“创业成瘾”,而是眼前这场由前沿 AI 模型引发的、在安全领域前所未见的滔天巨浪。 在接触到 Travis Lanham、David Slater 以及 Evan Pena 这几位联合创始人时,Kevin Mandia 被他们所展现出的技术能力彻底震撼。他用“一代难遇的天才”(generational talent)形容 Travis,用褒义的“怪胎”(freak of nature)来评价 David Slater,并赞扬 Evan Pena 在其专业领域的顶尖水平。当听到他们构思的产品蓝图时,Kevin Mandia 深刻意识到整个网络安全世界的底层逻辑正在被连根拔起。对于这场突如其来的范式转移,Kevin Mandia 直言:“我不想在安全领域干了 30 年后,眼睁睁看着这整个该死的行业即将发生剧变,自己却在 AI 时代更迭的场边袖手旁观。” 在与 a16z 普通合伙人 David George 的对谈中,Kevin Mandia 强调,攻击方一旦掌握机器速度,传统的防御手段将彻底失效。AI 在微秒之内完成的操作,可能需要 70 名人类专家协作甚至人类根本无法企及。面对这种不可逆的技术质变,他清醒地意识到过往的经验正在失效,而 Armadin 的成立正是为了应对这一紧迫危机: > “我过去做的一切都已经死了,除此以外的一切全都是全新的。” —— Kevin Mandia - **联合创始人团队**:Travis Lanham(技术天才)、David Slater、Evan Pena。 - **复出动机**:目睹 AI 变革不可逆转,传统安全范式失效,利用自身 30 年行业声誉与人脉加速新一代安全方案落地。 - **核心论点**:面对即将到来的 AI 进攻浪潮,必须由正向力量率先研发同等甚至更强的 AI 进攻武器进行实战演练。 --- ### `03:47` Armadin 的两幕战略:以 AI 进攻淬炼自适应防御 讨论深入到 Armadin 正在研发的技术方案与商业构想。Armadin 的底层逻辑是利用前沿模型和 AI 作为进攻武器,主动且持续地向企业网络发起测试,探测系统中是否存在可被真实利用的高危漏洞(exploitable risk)。公司将当前的业务阶段定义为“第一幕:Armadin Red”(进攻组),而终极目标是构建“第二幕:Armadin Blue”(防御组)。这种由己方 AI 充当顶级假想敌、持续朝系统开火的机制,是为了在国家级黑客组织或网络犯罪分子动手前哪怕抢先五分钟排查出隐患。 Kevin Mandia 解释道,当前安全市场上的各类扫描器往往停留在理论风险上,而 Armadin 追求的是实打实的攻防实效。截至今年 1 月以来,Armadin 已经在财富 500 强等大型企业客户的真实生产环境中累计发现了超过 90 个零日漏洞(zero-days)。这一惊人战果印证了其进攻模型的穿透力。进攻端与防御端绝非割裂,只有白帽阵营先打造出杀伤力最强的“AI 赛博重炮”并朝内部网络射击,才能检验防线能否抵御同级别的威胁;紧接着,再让进攻 AI 与防御 AI 展开高频的相互训练与协同对抗。 ```mermaid flowchart LR accTitle: Armadin 的两幕对抗防御架构 accDescr: 展示进攻端 Armadin Red 与防御端 Armadin Blue 形成的闭环训练机制。 subgraph Offense["第一幕:Armadin Red(进攻端)"] A["前沿基础模型"] --> B["25,000 协同协作 Agent 蜂群"] B --> C["高频实战渗透攻击"] end subgraph Production["客户生产环境"] D["企业生产网络 / 关键资产"] end subgraph Defense["第二幕:Armadin Blue(防御端)"] E["实时止血 / 动态止血带机制"] F["自主实时防护力场"] end C -->|"先于对手发现可利用风险"| D D -->|"反馈攻击轨迹与漏洞数据"| E E --> F F -.->|"强化防御标准,反向倒逼进攻进化"| B ``` 面对未来几年内必将出现的机器级自主攻击,传统的“人类在回路中”(human-in-the-loop)的检测响应流程在时间尺度上完全无法立足。Kevin Mandia 强调,防御体系必须从被动修补升级为自动化实时阻断。他在描述 Armadin 的终极愿景时表示:“我们正在打造你在 AI 时代自卫所需的能量护盾,用来抵御来自 AI 的攻击。” - **Armadin Red**:利用前沿模型探测可利用风险,今年已在生产环境中揪出超 90 个零日漏洞。 - **Armadin Blue**:即时压制、动态控制与自主防御力场,形成自动化响应的闭环。 - **攻防辩证法**:防守水平受限于陪练的进攻水准,缺乏顶级假想敌就谈不上真正拥有防御。 --- ### `05:41` 机器速度与开源模型:不对称攻防经济学 关于当前 AI 攻击能力的真实水平,Kevin Mandia 指出业内正处于一个极为奇特的“时间窗口”:虽然市面上尚未出现攻击力堪比 Armadin 自研系统的野生黑客工具(Armadin 能同时驱动 25,000 个智能体协同作战且不会陷入毫无意义的盲目试探),但 AI 攻击所展现出的核心特征与人类入侵者已截然不同。人类黑客在渗透时往往遵循由 A 点到 B 点、再到 C 点的高度线性路径,且必须谨慎分配极其有限的人工精力;而现阶段的 AI 则呈现出蜂群式的非线性试探,甚至会出现攻破 A 点横向移动到 B 点后、又反过头来再次尝试攻入 A 点等略显混乱但在广度上极其骇人的操作。 这种差异在规模和速度层面带来了颠覆性的非对称优势。人类受制于生物精力,一次只能探索一条狭窄的入侵路径;而 AI 在微秒级别内完成的并发计算,换算成人工可能需要 70 名专家协同工作才能达到同等覆盖面,两者完全不是一个量级的产物。更为关键的是,网络攻防的核心介质是代码,而代码本质上是结构化语言与结构化逻辑,这恰恰是 AI 模型最擅长的核心阵地。Kevin Mandia 对此表示:“在进攻端寻找漏洞与可利用风险,本质就是面对代码,而代码是结构化语言和结构化流程;正因为它是结构化的,AI 必然会在这上面大放异彩。” 针对业内试图通过放缓前沿模型演进以降低网络安全风险的声音,Kevin Mandia 认为这纯属不切实际的幻想。如今市面上的开源模型能力早已越过了武器化的临界阈值: > “那些所谓的‘让我们放慢模型速度,我们不想承担网络安全风险’的论调,已经太迟了;开源模型现在已经足够优秀了。” —— Kevin Mandia 目前之所以尚未爆发大规模针对普通企业的全自主 AI 勒索犯罪,唯一的制约因素在于算力资源的匿名性。网络犯罪分子极度依赖匿名身份,而租用大规模高端 GPU 往往涉及实名信息与支付追踪。一旦未来市场上出现完全匿名的去中心化 GPU 算力供应,犯罪分子无需“穿着印有自己名字的球衣去犯案”,AI 主导的恶意攻击必将呈现井喷式爆发。当前行业仍处于 AI 恶意攻击风暴来临前的“第一局上半”(first inning)。 - **规模与速度的不对称**:AI 可以在微秒内并行探查数千条入侵路径,彻底打破人类黑客一对一、点对点渗透的资源瓶颈。 - **任务匹配度**:代码的强结构化属性使得前沿模型无需具备多语言百科通识,即可在漏洞挖掘上展现出超越人类的速度。 - **犯罪经济学门槛**:制约 AI 犯罪泛滥的唯一瓶颈是 GPU 访问的匿名性,而非大模型本身的破解能力。 --- ### `08:08` 从“狙击步枪”到“无人机蜂群”:国家级对抗的范式转移 结合自己在 Mandiant 期间长达数十天乃至数年应对国家级网络攻击(Nation-State Attacks)的丰富经验,Kevin Mandia 深入剖析了传统顶尖黑客行动与未来 AI 战争在战术哲学上的根本裂变。在传统的网络间谍活动与地缘对抗中,主权国家的网军行动极其讲究隐蔽性与精准度,其战术形态如同“狙击步枪”(sniper round)——他们绝不盲目四处扫射(spray and pray),而是将顶级资源高度聚焦于极狭窄的战略目标,例如仅针对 30 家关键国防承包商或军方专属网络(.mil)实施潜伏式单点深挖。 AI 的全面介入正在彻底重塑国家级网络行动的军事学说(doctrine)。网络空间攻防正从精准暗杀式的“狙击战”转变为高压压制型的“无人机蜂群”(drone swarm)。攻击方不再需要像过去那样为了避免惊动防线而步步为营、极度克制,而是可以直接在目标网络上大规模“燃烧 Token”(burn tokens),驱动数万个智能体实施全覆盖式的饱和攻击。尽管这种打法在痕迹上可能更嘈杂、更混乱,但其对防御纵深的穿透效率和全面性却是人类单兵作战完全无法比拟的。 主权国家的网军正在重新评估自身的行动协议:究竟在何种风险场景下应当继续使用无声无息的“狙击弹”,在何种情境下应当启动 Token 饱和的“无人机蜂群”攻势。网络空间的交锋维度正被彻底拓宽,攻击手段与目标重要性、潜伏隐蔽需求之间的权衡逻辑也面临全面改写。由于缺乏专门针对极度隐蔽场景的深度后训练(post-training),纯自主 AI 现阶段在执行过程中可能仍需人类保持监控,但其向战术体系核心演进的大势已然不可逆转。 > “在 AI 的加持下,它在网络空间中将变得更像是一群无人机蜂群。” —— Kevin Mandia - **战术形态演变**:传统国家级间谍活动依赖高度克制、精准深潜的“单发狙击”,而 AI 攻击演进为消耗算力与 Token 的“饱和式蜂群压制”。 - **行动特征对比**:传统攻击静默隐蔽、步步为营;AI 蜂群攻击噪音更大、痕迹更杂,但对资产死角的探查效率与整体杀伤力远超人类。 - **国家军事学说重构**:各大主权实体正被迫重新设计网络战协议,重新划定低痕迹潜伏与高并发 AI 饱和突防的应用边界。 ### `10:00` AI 赋能的攻击与“超攻击”:以元数据映射持续防御 Kevin Mandia 指出,如果只是给 AI 输入一个粗浅的指令(例如直接发送提示词“hackabc.com”),AI 根本不可能以一种隐秘且聪明的方式完成入侵。没有经过深度训练和人类专业知识注入的模型,还无法胜任高级黑客的工作。然而,AI 带来了一个颠覆性的改变——它极大地拉平了攻防双方的技术门槛。那些原本能力较弱、缺乏深厚技术背景的攻击者,在海量自动化模型和并发能力的加持下,表现出的攻击效能会大幅跃升。这就导致溯源(Attribution)变得极度困难:在防御端,人们只看到持续不断的模型在发起冲击,却很难立刻分辨背后究竟是一个国家级黑客组织还是一个普通攻击者。 面对这种攻击民主化的现实,Kevin Mandia 提出了核心逻辑:“必须用卓越的进攻来锤炼防守”。他打了个生动的体育比喻:就像 2000 年那支传奇的巴尔的摩乌鸦队(Baltimore Ravens)防守组一样,一支顶尖的防守队伍必须在日常训练中面对最强悍的陪练进攻组,才能明确自身的极限与短板。在 AI 时代,战术层面的自主防御绝不可能继续依赖人工逐一审核,防御系统必须像给伤口快速绑上止血带一样,在几秒钟内做出响应。 ```mermaid flowchart TD accTitle: Armadin 的超攻击与持续防御流程 accDescr: 展示从无人机蜂群扫描、元数据数字孪生,到持续心跳轮询与自主攻击变更的闭环机制。 subgraph Phase1["第 1 阶段:超攻击与孪生构建"] A["无人机蜂群 Agent 扫描"] --> B["全面资产/路由/服务测绘"] B --> C["沉淀 TB 级元数据数字孪生"] end subgraph Phase2["第 2 阶段:低成本心跳轮询"] C --> D{"心跳轮询监测网络变更"} D -->|"无变更"| E["保持低成本监控"] D -->|"检测到应用更新/新资产/路由变化"| F["锁定变动暴露面"] end subgraph Phase3["第 3 阶段:自适应靶向验证"] F --> G["针对性模型并发攻击"] G --> H["先于对手验证是否具备可利用性 (Exploitability)"] end ``` 为了兼顾有效性与成本效益,Armadin 采取了被称为“超攻击(Hyperattack)”的技术路径: - **无人机蜂群(Drone Swarm)测绘**:向目标网络发射大量智能代理,超高速抓取所有服务、路由与网络资产,在短时间内生成数百 GB 乃至数 TB 的网络元数据。 - **构建元数据数字孪生(Metadata Twin)**:从攻击者的第一视角完全绘制企业边界及内部架构。 - **低成本心跳式轮询(Heartbeat Polling)**:由于常态化对全部模型进行全量攻击不仅成本极其昂贵而且毫无必要,Armadin 采用类似心跳的机制持续监测“何处发生了变化”。一旦发现应用更新、路由漂移、新机器上线,或者市场上出现了新的漏洞情报与外部模型,系统才会精准触发定向攻击,测试新增资产的抗打击能力。 Kevin Mandia 总结道,防守方其实早就暴露在未知的威胁之下,互联网上时刻充斥着黑客无差别的自动化扫描;与其被动承受恶意的试探,不如让“白帽”构建的正义 AI 力量持续对自己的防线施加压力。 > “You don't have a defense unless you have a great offense to go up against.” —— Kevin Mandia --- ### `15:00` 重新定义渗透测试:从规则扫描到黑盒挖掘 90+ 零日漏洞 David George 将 Armadin 的演进与历史上 CrowdStrike 将杀毒软件(AV)重构为终端检测与响应(EDR)的历程相提并论。针对传统渗透测试(Pen Testing)的局限,Kevin Mandia 直言不讳地指出,传统的 Tenable、Rapid7、Qualys 等产品本质上只是在对照已知的 CVE 列表进行表层扫描,只能罗列出一堆无关紧要、无法真正被利用的漏洞清单,制造了大量的虚假告警与噪音。 真正的 AI 攻击代理具备自主学习和长期记忆能力,能够跳出已知 CVE 的死记硬背,在 custom applications(定制化业务应用)中穷尽所有可能的访问路径,去挖掘深层的业务逻辑缺陷(Logic Flaws),而不仅仅是简单的代码表面错误。更关键的是,Armadin 的代理能够一步步完成漏洞利用全流程,实现远程代码执行(RCE)或成功提取目标数据,从根本上消除了“误报”。 | 对比维度 | 传统渗透测试 (Legacy Pen Testing) | Armadin AI 红队 (Autonomous Red Teaming) | |:--- |:--- |:--- | | **工作原理** | 基于已知 CVE 规则库的比对与端口开放扫描 | 具备推理与记忆能力的 AI 代理穷举全路径 | | **漏洞类型** | 侧重已知代码缺陷与通用中间件配置失误 | 擅长挖掘专有系统的复杂业务逻辑缺陷(Logic Flaws) | | **验证机制** | 仅给出“潜在风险”报告,存在大量误报噪音 | 自动完成 Exploit 链条,以 RCE 或取数验证可利用性 | | **测试视角** | 多依赖静态源码审计(如 Mythos 等工具)或内网白盒权限 | 纯粹的互联网外网黑盒视角,完全无源码审查 | | **常态化能力** | 依赖高昂的人工红队成本,只能阶段性、抽样进行 | 自动化代理全天候运作,成本可控,成为常态化防御机制 | Kevin Mandia 分享了 Armadin 取得的震撼战绩:自 2026 年 1 月到录制播客时,Armadin 在财富 500 强等大型软件与企业客户的生产环境中,以纯外网黑盒攻击方式发现了超过 **90 个零日漏洞(Zero-days)**。他们完全没有读取目标客户的源代码,也没有任何预先配置的应用登录凭证,纯粹凭借 AI 代理从公网发起穿透。当他们致电客户的 CISO 通知“我们在你们的 DMZ 区拿到了远程代码执行权限”时,对方无一例外立即启动了最高等级的真实安全事件应急响应(Incident Mode)。 随后谈及产品矩阵,Kevin 强调了 Armadin 的全貌。光有负责攻击的“Armadin Red”远远不够,仅告诉客户“你被攻破了”是不负责任的;因此他们正在打造“Armadin Blue”自主防御引擎。该引擎能够把红队发现的可利用风险实时输入给现有的防御控制平面(包括 EDR 和防火墙),并在几分钟内自动生成针对性的补偿性安全控制(Compensating Controls),赶在黑客的模型发现相同漏洞前,将防御护栏彻底合拢。 > “And the true north for every CISO should be effective autonomous response.” —— Kevin Mandia ### `20:00` 自主防御的必然性与 SOC 传统架构的重构 Kevin Mandia 指出,面对以机器速度推进的攻击,防御必须走向自主化。在未来几个月内,这类防御措施或许还很简陋,但一年之后它们将无处不在。他强调:“面对两害相权取其轻,我宁愿要一个能阻止坏人潜入的坏补丁,也不愿承受一次入侵。”(“I'd rather have a bad patch stopping a bad guy from getting in than have an intrusion.”)目前,Armadin 正在与 CrowdStrike、Palo Alto Networks(PAN)、Fortinet 等安全巨头展开合作。这些主流安全平台都清楚自主防御必须存在,并致力于在 AI 时代实现这一跨越。 Kevin 将当前的应急补丁比作战场上的“野战包扎”——有人中弹了,先包扎止血,但这并不是送入医院彻底救治;后续仍需投入更多时间,依靠人类专家或智能体(Agent)方式进行深层修复。即使首席信息安全官(CISO)没有主动要求,由于现有安全平台的演变,自主防御也会不可避免地进入企业。 谈及安全运营中心(SOC)的未来,Kevin 表示,CISO 的最终目标(True North)必须是“有效的自主安全”。传统的“预防、检测、响应”体系正发生剧烈变动: - **预防环节(Prevent):** 逐步由 AI 接管主导。 - **检测与响应(Detect & Respond):** 必须转交给 AI 执行。 ```mermaid flowchart TD accTitle: AI时代安全运营流水线演进 accDescr: 展示人类在检测和响应环节被AI全面替代的过程 subgraph Legacy["传统模式:人机混合(速度过慢)"] L1["机器告警"] --> L2["人类分析师研判"] L2 --> L3["人工键盘操作排查/阻断"] end subgraph Autonomous["AI 时代:自主防御闭环"] A1["AI 智能体主动预防与加固"] --> A2["AI 极速入侵检测"] A2 -->|"毫秒级触发"| A3["AI 自主网络封锁与修复"] end ``` Kevin 尖锐地指出:“如果你在‘检测和响应’循环中保留人类,你的速度就会太慢。”(“If you have humans in the detect and respond loop, you're going to be too slow.”)当攻击者突破防线,传统防御体系会像气球被戳破一样瞬间崩溃。人类黑客在键盘前一次只能敲一条命令进行横向移动,速度极慢;而具备环境感知的内部 Agent 控制系统则能瞬间并发执行数千项操作,迅速蔓延至全网。因此,检测与响应的窗口期正在被极限压缩,甚至快到与“预防”融为一体。 - 行业现状:各个企业与安全厂商都在重构人员配置、员工规模以及运营流程。 - 纵深防御:即使 Armadin 能为客户构筑防御力场,也必须假设某处终将失效,必须在后方布设免受人为干预的自动化陷阱。 --- ### `25:00` 攻防窗口期、全员作战与遏制失控模型 针对当前财富 500 强企业的安全暴露状态,Kevin 认为虽然暴露面在快速收缩,但双方都笼罩在一种极度紧迫的危机感中。像来自伊朗或俄罗斯等地的攻击方有一种“趁现在能进赶紧进”的紧迫感;而防守方同样充满焦虑。在 AI 时代的初期阶段,优势暂时倒向进攻方,企业防线面临短期剧痛;但长期来看,AI 赋能的自主防御无论在效率还是严密性上,都会远超盯着数据包看的人类分析师。 面对敞开的风险敞口,各大企业已进入高强度的“全员作战”(Team ball)状态:CIO、CISO、产品团队和各业务线负责人坐进作战室,实时发现漏洞并现场抢修。Kevin 形象地将当前局势形容为一场疯狂的“数字鸡尾酒会”,所有人都在争分夺秒。David George 也补充道,他们接触的一家极具技术实力的顶级公司,前不久将研发与工程团队的大比例人员抽调出来,全力加固企业自身的安全壁垒。 对于近期技术界关注的安全事件,Kevin 做出了深刻剖析: - **Mythos 冲击:** 虽然业内早有预判,但这一里程碑事件在市场层面向所有人敲响了警钟,证实了“AI 攻击时代已经到来”,促使各大厂商纷纷展开软件安全认证与漏洞自查。 - **Hugging Face 等模型安全事件:** 这暴露出技术范式转移过程中的历史通病。Kevin 直言:“在每一次技术范式转变中,我们总是低估对手的能力;而在这次事件中,我们低估了模型自身的能力。”(“In every technical modality shift, we underestimate the adversary's capability. And in this case, we underestimated the model's capability.”) ```mermaid flowchart LR accTitle: Armadin 攻击 Agent 安全防护与成本控制机制 accDescr: 展示Armadin如何通过多层护栏与被动审查监控攻击模型的运行 Agent["攻击性 Agent (AI)"] --> Hyper["Hypervisor 隔离层"] Hyper --> HostLock["主机级安全锁定"] HostLock --> Proxy["代理感知层 (Proxy-Aware)"] Proxy --> Inspect["被动实时审查 Prompt"] Inspect -->|"发现偏离目标 / 浪费算力"| Kill["即刻终止 Agent 进程"] Inspect -->|"符合预设确定性规则"| Exec["允许安全测试验证"] ``` Kevin 透露,Armadin 自身打造了令人敬畏的攻击模型,但为了确保安全可控,团队设计了极为严密的防御层级: 1. **基础设施隔离:** 采用 Hypervisor 虚拟机管理系统,结合主机级加固与具备代理感知的网络代理(Proxy-aware)。 2. **被动审查机制:** 对发出的每一个 Prompt 进行静默、隐蔽的实时审查。Kevin 提到,绝大多数杀掉 Agent 的操作其实与安全越界无关,而是“因为那个 Agent 在浪费钱”(“it's that the agent's wasting money”),陷入了无意义的无效搜索。 3. **确定性规则:** 必须假设系统每一层防御都会失效,因此必须设置不依赖概率判断的硬性、确定性规则,彻底封死高危活动。安全专家与 AI 研发人员之间往往存在认知鸿沟,只有将实战安全经验真正嵌入模型管控中,才能给技术创新的“猛兽”套上可靠的笼子。 ### `30:00` 领域专长与 AI 的结合:开源与闭源模型的攻防基准测试 在网络安全中应用 AI Agent 时,纯粹的 AI 背景是远远不够的。缺乏网络安全实战背景的团队在设计测试用例(evals)时,往往难以预料攻击链路中可能出现的变数。Kevin Mandia 解释说,Armadin 将漏洞利用开发人员(exploit developers)、红队成员与 AI 工程师深度绑定在一起,正是因为最有效的评估体系必须由深入理解攻击逻辑的红队专家来制定:“So that's why Armadin, we combine the exploit developer types and red teamers with the AI folks because our evals most of the time are made by the red teamers.” 为了检验前沿模型的能力,团队将红队操作员在真实受害者网络中执行过的多阶段攻击链提取为测试基准。在包含 20 个完整攻击链的测试中,无论接入何种模型,最多都只能跑通其中的 8 条。更出乎意料的是开源权重模型(open-weight models)与最先进的闭源商业模型之间的对比: - **能力上限高度重合**:无论是顶尖闭源模型还是开源模型,最终成功攻破的攻击链数量均为 8 个,有效性与攻击创造力的曲线上限完全一致。 - **效率与成本的权衡**:闭源模型在寻找可利用风险时的收敛速度明显更快;但如果让开源模型运行更长时间,它们最终能达到完全相同的效果。在安全攻防领域,开源与闭源之间的能力差距远比其他垂直领域要窄,核心差异主要体现在推理速度和计算成本上。 ```mermaid flowchart LR accTitle: AI模型网络渗透基准测试表现对比 accDescr: 展示开源模型与闭源模型在完整攻击链中的表现路径及最终收敛效果 subgraph Evaluation ["20条实战攻击链评估"] A["多阶段攻击链测试集<br/>(20条典型路径)"] end subgraph Models ["模型运行对比"] B["闭源模型<br/>(Frontier Labs)"] C["开源权重模型<br/>(Open-Weight)"] end subgraph Outcomes ["测试收敛结果"] D["快速命中可利用风险<br/>(时间短,单次成本较高)"] E["延长时间深度搜索<br/>(速度慢,但最终能力对齐)"] F["共同上限:打通 8/20 条链<br/>(边际效益递减点相同)"] end A --> B A --> C B --> D C --> E D --> F E --> F ``` - 测试数据显示,开源与闭源模型在实战红队评估中均停留在 8/20 的突破率,表明当前 AI 在复杂多步渗透中的瓶颈具有一致性。 - 闭源模型的核心优势在于初期命中漏洞的时间窗口,而开源模型通过更长的推理时长拉平了能力鸿沟。 --- ### `32:38` AI 时代的安全审计与“关住猛兽”的边界艺术 随着架构向 AI 模式转移,整个安全生态必须经历类似当年“云转型(cloud transition)”的剧烈阵痛。当年 Mandiant 必须在应急响应中重新摸索云上泄露(cloud breach)的形态与取证方法;如今面对 AI 时代的安全事件,行业急需明确:前沿实验室的模型究竟记录了多少关键日志,以及攻击发生后如何追溯责任。Kevin Mandia 强调,调查 AI 失控事件绝不能耗费长达两周的取证时间,Armadin 对旗下 Agent 的每一次动作都进行颗粒度极细的审计追溯:记录源 IP 地址、精确时间戳以及执行的具体动作,从而确保整个攻击行为能够被完全回溯与重放。 各大模型实验室(如 OpenAI、Anthropic 等)在过去几个月中已经吸取了惨痛教训。过去行业总是低估顶级威胁对手的能力,而在 AI 时代,人们同样在初期低估了前沿模型被恶意利用的破坏力。Kevin Mandia 形象地用“笼中猛兽”来比喻防守方对 AI 模型的管控逻辑:“Got to cage the beast, David.” 如果过度限制、使用完全确定性的规则把模型束缚得过死,就会抹杀大模型的创造力;而若完全放开,模型就可能做出不可挽回的越界行为。 解决这一灰色地带的核心工程架构在于构建出入双向的多层分类器(classifiers): - **出入流量审查**:对发往大模型实验室的请求以及模型返回的所有 Payload 和命令进行实时双向拦截与评估。 - **人类专家仲裁**:通过大量红队专家对模型的具体输出进行标注和分类训练。一旦遇到分类器无法判别的未定义行为(“We don't know what the hell just happened”),系统立即自动暂停(pause)、向上升级(escalate),并由人工操作员介入做出最终裁决,确保在探索未知攻击面的同时守住系统安全底线。 --- ### `35:00` 顶级红队专家的经验沉淀与 AI 独立发现 0-Day 的转折点 Armadin 内部顶尖安全操作员的背景堪称豪华。团队核心大多拥有 15 年以上的一线攻防对抗和红队实战经验。Kevin Mandia 透露,在他们的整个职业生涯中,这支团队几乎对《财富》100 强(Fortune 100)中的 99 家企业做过合法的红队实战测试,仅有一家企业从未聘请过他们。 在这种高浓度实战经验的加持下,AI 自动化与人类专家的分工正在经历深刻的质变: - **自动化代劳 90% 以上的基础工作**:原本极度繁琐耗时的渗透测试(pen testing),以及处于前 1% 到 2% 水平的 Web 应用逻辑渗透,现在已全部交由 AI 自动化、创造性地执行完毕。 - **历史上的 90 多个 0-Day**:在此前发现的 90 多个生产环境 0-Day 漏洞中,大部分是由人类专家最终锁定的,但这是因为 AI 为专家扫清了绝大多数杂务,让专家能够专注于关键攻击面。 - **跨越技术拐点**:就在最近,整个范式迎来了分水岭。Kevin Mandia 兴奋地证实:“The last few zero days, tech found it.” 这标志着技术本身已正式跨过临界点——进攻端的 AI Agent 已经能够独立发现未知的 0-Day 漏洞,而不再仅仅充当人类辅助工具。 --- ### `36:34` 安全威胁情报的三次浪潮与 Mandiant 到 Armadin 的创业演变 话题转向创办公司的理念演变。回顾 2004 年 2 月创办 Mandiant 的经历,Kevin Mandia 坦言当时公司采用全自筹资金(self-funded)并且从一开始就保持盈利。当时 Mandiant 提出了一个在 2004 年几乎没人相信的核心假设:“安全漏洞不可避免(Security breaches are inevitable)”。最初简陋的官网标语甚至写成了乏味的“不能仅依赖防范性措施”,其底层逻辑是一致的——任何企业都不可能仅凭防御高墙独善其身。 基于对攻击态势的理解,Kevin 梳理了网络安全威胁情报(Threat Intelligence)的三次演进浪潮: | 演进阶段 | 核心机制 | 运作瓶颈与局限 | 代表形态 | |:--- |:--- |:--- |:--- | | **第一波浪潮** | 依靠特征码检测恶意软件(Antivirus / AV) | 依赖受害者(甚至终端普通用户)踩坑后提取样本并上传签名,滞后严重且极易被免杀绕过。 | 传统杀毒软件(AV) | | **第二波浪潮** | 基于事件响应驱动的第二层主动防御 | 不再被动等样本,而是深入最关键的真实入侵事件现场进行取证,反哺检测规则与战术感知。 | Mandiant、EDR 等端点安全 | | **第三波浪潮** | 依托自主 AI 主动发现自身脆弱面 | 彻底抛弃“等待某家国防承包商先被黑客拿下再去共享 IOC”的旧模式,在对手利用前由 AI 自行挖出系统盲点。 | Armadin 的前置化 Agent 体系 | Kevin Mandia 总结道,等待受害者被黑再去总结教训在如今的攻防节奏下已经跟不上时代:“Like, why are we waiting for a victim and learn from that? That's ridiculous. You've got to find your own problems first.” 谈及组织哲学,过去 Mandiant 依靠自身业务造血滚动发展,秉持精简团队、支付高于同行的薪资并要求更高工作强度的用人策略。这一策略为行业输送了大量领军人才。Kevin 提到曾有人发短信告诉他,某一届 RSA 大会主舞台演讲者中有高达 43% 都曾是 Mandiant 的校友;追溯更早之前与 George Kurtz 在 Foundstone 共事的时期,那批人同样孕育出了当今安全行业的半壁江山。而如今在 AI 时代创立 Armadin,面对以机器速度演进的威胁,追求极致的开发与反应速度已经取代了早年慢慢滚雪球式的自筹资金模式,成为决定安全初创企业生死的核心要素。 ### `40:00` 融资节奏、极速扩张与拒绝“车轮摇晃”的制度化流程 在谈到当前市场的残酷竞争时,Kevin Mandia 指出,初创企业必须获得充足的资本支持才能抢占先机。他感觉 Armadin 如今迎来了时速 80 英里的强劲顺风,但面临的现实是没有现成的销售队伍、缺乏成熟的 Go-To-Market(GTM)体系,也没有国际化拓展,而这些能力必须迅速建立起来。在当今的经济环境下,击败行业巨头的唯一路径就是在最恰当的时机以精准的技术迅速建立市场通路。更关键的是,企业必须早已规划好自己的第二幕(Act 2)乃至第三幕(Act 3),以防被逼入死角。谈及行业增长标杆时,Kevin Mandia 提到了安全独角兽 Wiz 在首款产品发布后仅用 18 个月就突破了 1 亿美元 ARR,并立下雄心:“Wiz got to over $100 million in ARR in 18 months from their first release, right? We're going to try to beat that.” 为了支撑这一惊人速度,创始人必须思考如何在极速狂飙的同时不让“大巴车的车轮散架摇晃”(wheels on the bus get wobbly)。Kevin Mandia 回忆,当年创办 Mandiant 时,由于没人相信其前提假设,公司完全依靠自筹资金且持续盈利,没有真正意义上的竞争对手,凭借强大的领导力和纪律性就能平稳推进。然而,如今以这种速度扩张,根本无法单靠勇气、直觉和拼劲(grit, gut, and moxie)取胜,必须立即招募懂得制度化流程的规模化领导者,将运作机制工业化与程序化,形成不可动摇的“Armadin 模式”。 - **资本与前置布局**:企业安全软件无法像消费级 AI 公司那样出现爆炸性自然爆发,必须提前融资以超前搭建 GTM 架构。 - **防止组织失控**:从自给自足的 Mandiant 模式转向超速扩张模式,核心在于迅速引入能推行制度化流程的成熟管理层,规避运营混乱。 ```mermaid flowchart TD accTitle: 极速扩张下的流程与 GTM 飞轮 accDescr: 展示了从融资前置到制度化流程、每周赋能与客户光环效应的业务闭环。 subgraph ScaleEngine ["规模化引擎"] A["前置充足融资"] --> B["构建 GTM 架构与招聘规模化领袖"] B --> C["工业化流程与每周销售赋能"] end subgraph GrowthLoop ["增长与光环飞轮"] C --> D["锁定顶级核心企业客户"] D --> E["交付极致体验并形成光环"] E --> F["解锁 Act 2 与 Act 3 长期产品线"] F --> D end ``` --- ### `42:30` 销售演变:技术每两周剧变,但“人依然向人买单” 随着 AI 时代的到来,软件开发的速度彻底改变了商业协作节奏。David George 调侃道,过去软件公司只需在每年一月份的销售启动会(Sales Kickoff)上对销售进行一次培训,就能管够一整年。但 Kevin Mandia 强调,现在的技术栈每两周就会脱胎换骨一次。面对这种极端的技术变化,很多 CEO 都在焦虑 AI 是否会替代人力,但 Kevin Mandia 坚信,在企业级安全软件销售中,这一逻辑并不适用。 “When I look at AI's influence on sales, the reality in enterprise security sales: People still buy from people.” Kevin Mandia 坚定地指出,客户根本没有精力和义务去研究技术供应商每两周更新了什么。因此,企业绝不能把理解产品变化的负担甩给客户,反而必须建立极其严密的内部制度,每周对销售团队进行全员培训与赋能,确保销售人员始终站在认知最前沿。 谈及企业的文化与追求,Kevin Mandia 直言自己绝不甘心做一个只拿第二名的公司。他以勒布朗·詹姆斯(LeBron James)和汤姆·布雷迪(Tom Brady)等顶级运动员为例,指出强者在走上赛场的那一刻就必须确信自己是最优秀的,并且必须通过更刻苦的训练来维持顶尖水平。同时,CEO 的根本职责是向员工隐藏混乱:“A CEO's job is, to absolutely hide chaos at a company from the employees.” 在知识产权(IP)生命周期被大幅压缩至半年的今天,单纯依赖技术领先是守不住阵地的,唯有将产品与强大的市场能力绑定,成为业界公认的“品质认证标志”(seal of approval),才能在六个月的窗口期内确立绝对优势。 - **每周销售赋能**:为了应对每两周一次的产品迭代,销售团队必须每周进行一次系统化培训与对齐。 - **消除组织内部震荡**:员工不需要理解复杂的组织混沌,只需要清晰明确的对接人和标准作业程序。 - **四大核心差异点**:融资规模、迭代速度、品牌信任背书以及超前布局的 GTM 体系。 --- ### `45:00` 攻克顶级企业:通过高难度客户获取“光环效应” 谈到当下的安全市场,David George 指出,AI 带来的冲击是一场在网络安全领域前所未见的海啸。早期的 CrowdStrike 经历的是“开辟全新赛道”的漫长过程,而 Wiz 的爆发式增长则是因为它精准击中了企业云安全痛点,如重锤落地般成为迫在眉睫的刚需。 Kevin Mandia 对此表示认同,但他进一步揭示了企业安全领域的商业秘诀——获取“光环效应”(Halo Effect)。他幽默地打趣道:“No offense if there's a place called, I don't know, Susie's Cupcakes. They don't get you the halo if you make them happy in cybersecurity.” 换言之,就算你让街角的一家杯子蛋糕店完全满意,也不会在网络安全行业激起任何涟漪;但如果你搞定了核心货币中心银行(Money Center Banks)、顶尖跨国零售商以及大型航空公司,并让他们对产品赞不绝口,你就会瞬间赢得整个行业的信任光环。这也是 Armadin 坚定不移地将超大型核心企业作为首要目标的原因:直面并攻克行业中最艰难的防护课题。 | 客户类型 | 代表场景 / 案例 | 对安全初创企业的商业与品牌价值 | |:--- |:--- |:--- | | **普通长尾小微企业** | 如 Susie's Cupcakes(杯子蛋糕店) | 商业合同额小,无法在严苛的安全合规领域提供公信力背书,无法形成行业光环。 | | **顶级核心机构与巨头** | 货币中心银行、大型航空公司、跨国零售巨擘 | 面对最严苛的黑客攻击与监管审查;一旦攻克并让其满意,便能转化为全行业通行的信誉凭证。 | --- ### `47:00` 唯一不变的护城河:获取客户、让其狂喜,以及集中办公的极速协同 Kevin Mandia 指出,当今初创企业的生存环境比以往任何时候都更加拥挤——创业者数量创下历史新高,热钱充沛,任何赛道都挤满了竞争对手。过去那种“由于安全威胁客观存在且别无选择,因此某家公司能够独占赛道”的红利期已不复存在。在营销噪音漫天飞舞的环境中,唯一的突围方式朴素却致命: “Probably right now, because of the noise in marketing more than ever before, the only way to differentiate is get customer, make customer happy and repeat.” Kevin Mandia 坦言,这并非什么高深莫测的秘籍,商业的底层逻辑从未改变,只是如今被推上了“超光速”(hyperspeed)的轨道。所有周边的销售赋能、市场营销、团队搭建与招聘流程,都必须绝对服务于“让客户狂喜并形成口碑推荐”这一核心目标。 为了在组织层面匹配这一极限速度,Armadin 采取了坚决的反远程办公策略:将所有工程师聚集在同一个物理房间内办公。Kevin Mandia 直言,管理分布式团队的复杂性极高,而在同一个房间里,只要站起身大声抛出一个问题,周围 20 个人可以立刻协同作答,这种极致的敏捷度是远程协作无法比拟的。 在对谈的尾声,Kevin Mandia 展望了未来两年的行业图景。他认为未来两年内,几乎所有企业的安全技术栈都将被彻底推倒重来,原有的旧技术将被连根拔起并替换为全新的智能架构。对于网络安全创业者而言,这是千载难逢的“时代级顺风”(tailwind of a lifetime)。David George 对 Armadin 的未来发展表示了极高的期待,并在感谢 Kevin 的精彩分享后为整场播客画上了句号。 - **唯一的差异化路径**:获取客户 $\rightarrow$ 让客户狂喜 $\rightarrow$ 不断重复这一闭环,依靠真实客户的口碑打破营销噪音。 - **全员同室办公(In-person Engineering)**:摒弃复杂的跨地域分布式协作,依靠物理空间的零距离沟通实现即时反馈与极速研发。 - **安全堆栈的大洗牌**:未来 24 个月内,AI 将驱动整个网络安全底层技术栈的全面重构与大规模替换。 ## Notable quotes > `20:00` If you have humans in the detect and respond loop, you're going to be too slow. — Kevin Mandia > `20:00` I'd rather have a bad patch stopping a bad guy from getting in than have an intrusion. — Kevin Mandia > `10:00` You don't have a defense unless you have a great offense to go up against. — Kevin Mandia > `15:00` And the true north for every CISO should be effective autonomous response. — Kevin Mandia > `25:00` In every technical modality shift, we underestimate the adversary's capability. And in this case, we underestimated the model's capability. — Kevin Mandia > `36:34` Like, why are we waiting for a victim and learn from that? That's ridiculous. You've got to find your own problems first. — Kevin Mandia > `05:41` 那些所谓的‘让我们放慢模型速度,我们不想承担网络安全风险’的论调,已经太迟了;开源模型现在已经足够优秀了。 — Kevin Mandia > `00:00` 我过去做的一切都已经死了,除此以外的一切全都是全新的。 — Kevin Mandia ## Mentioned Kevin Mandia, David George, Armadin, Mandiant, a16z, Travis Lanham, David Slater, Evan Pena, Baltimore Ravens, Google, CrowdStrike, Palo Alto Networks, Fortinet, Tenable, Rapid7, Qualys, Wiz, OpenAI, Anthropic, Hugging Face, George Kurtz, Foundstone, Mythos, RSA Conference ## Video description a16z General Partner David George sits down with Armadin founder and CEO Kevin Mandia to discuss what happens to cybersecurity when attackers can operate at machine speed. After 30 years in security and building Mandiant, Kevin says AI convinced him to get back on the field. He explains how AI changes the economics of cyberattacks, allowing attackers to probe thousands of paths simultaneously, and why that means defense will ultimately need to become autonomous too. They also unpack Armadin’s approach: continuously attacking customers’ systems with AI to find exploitable vulnerabilities before adversaries do, then building toward autonomous defenses that can respond in real time. Kevin shares what Armadin has learned from finding more than 90 zero-days in production environments this year, why humans can’t remain in the detect-and-respond loop, and how the entire security stack could change over the next few years. [Source](https://mgln.ai/e/1344/afp-848985-injected.calisto.simplecastaudio.com/3f86df7b-51c6-4101-88a2-550dba782de8/episodes/24f18a48-5a9a-44ed-905a-34359aaf1190/audio/128/default.mp3?aid=rss_feed&awCollectionId=3f86df7b-51c6-4101-88a2-550dba782de8&awEpisodeId=24f18a48-5a9a-44ed-905a-34359aaf1190&feed=JGE3yC0V)

Source quotes

[20:00] Kevin Mandia: If you have humans in the detect and respond loop, you're going to be too slow. [20:00] Kevin Mandia: I'd rather have a bad patch stopping a bad guy from getting in than have an intrusion. [10:00] Kevin Mandia: You don't have a defense unless you have a great offense to go up against. [15:00] Kevin Mandia: And the true north for every CISO should be effective autonomous response. [25:00] Kevin Mandia: In every technical modality shift, we underestimate the adversary's capability. And in this case, we underestimated the model's capability. [36:34] Kevin Mandia: Like, why are we waiting for a victim and learn from that? That's ridiculous. You've got to find your own problems first. [5:41] Kevin Mandia: 那些所谓的‘让我们放慢模型速度,我们不想承担网络安全风险’的论调,已经太迟了;开源模型现在已经足够优秀了。 [0:00] Kevin Mandia: 我过去做的一切都已经死了,除此以外的一切全都是全新的。

Source quotes

[21:51] Kevin Mandia: If you have humans in the detect and respond loop, you're going to be too slow. [18:00] Kevin Mandia: The true north for every CISO should be effective autonomous response. [0:00] Kevin Mandia: You don't have a defense unless you have a great offense to go up against. [20:00] Kevin Mandia: I'd rather have a bad patch stopping a bad guy from getting in than have an intrusion. [27:30] Kevin Mandia: Assume every layer of your security will fail, and you have to have deterministic rules that eliminate certain activities. [42:30] Kevin Mandia: A CEO's job is to absolutely hide chaos at a company from the employees. [45:00] Kevin Mandia: There is nothing else that will differentiate you other than your customer base raving about you. [32:30] Kevin Mandia: My whole career, everybody underestimates the top tier of what you're up against.

Original transcript

[0:00] You don't have a defense unless you have a great offense to go up against. You want to be the Baltimore Ravens defense of 2000, you kind of want to have your practice offense really push you. That's what Arminen's going to do. We're going to be the all-star team on offense coming at you so you can train your defense with what we're doing. You built Mandiant a great success. Why did you decide to get back on the field? I don't want to sit out the AI shift change when I've done 30 years in security and the whole damn thing's about to change. What AI does in a microsecond would take 70 humans. They can't even do it. It's apples and oranges. This is a tsunami like has never been seen before in security. The whole, let's slow down the models. We don't want cyber risk too late. The open models are already good enough. Arm it in since January this year. We have found over 90 zero days at customer sites, all in production. like rinky-dink companies, like these are like Fortune 500 companies. The differences or similarities between nation-state attacks compared to AI today and then where you think AI can be in a couple of years. On the defensive side, we're going to say we're being attacked by these models, but we're not sure who's behind them. Is it a nation? Is it a human? Is it... Kevin Mandia has spent 30 years in cybersecurity. His view of the AI transition is simple. "Everything I did is dead." and then everything else is new. In this episode, David George sits down with Kevin, founder and CEO of Armiden and the founder of Mandiant, to talk about what happens when cyber attacks move from human speed to machine speed. Kevin explains why AI gives attackers an immediate advantage. from probing thousands of paths simultaneously. to making less sophisticated attackers dramatically more capable. And he makes the case that there's only one viable response. Defense has to become autonomous, too. We also get into how Armadin uses AI to continuously attack customer networks, what the team has learned from finding more than 90 zero days this year, and why Kevin believes the next two years could remake nearly every layer of the cybersecurity stack. Kevin, thanks for being here. No, thank you. yet? Yes. Obviously a great success, many different chapters, you know, it ended up inside of Google, ultimately. Why did you decide to get back on the field? It's a good question, and I don't know if I decided it, and that'll sound weird, but I met with David Slater and with Travis Lanham, the other founders, and Evan Pena I knew. I could say they started this company. They are the founders. I met them. They had the idea. They pitched me on what they wanted to do. And I saw the talent in them. Travis is a generational talent. David Slater's, and I mean this in a positive way, freak of nature. These guys are really, really good. Evan Pena is exceptional at what he does. And when you meet that team and you talk to them, the whole time I was listening to what they were doing, I was thinking, I want to be a part of this. I don't want to sit out the AI shift change when I've done 30 years in security and the whole damn thing's about to change. That's great. Everything I did is dead and everything else is new. But meeting that team and they were starting the company and me realizing, I think I'm a real good fit with these guys to accelerate the need. What Armaden is building every company needs now. And I was like, this team that can build it? And I think I can answer the now. 30 years in security, you meet a few people. Let's go to those people and say, we've built what you need. So I almost felt compelled to do it. I know that sounds weird, but I would not have founded a company again. in mid 50s and I was doing venture. It wasn't like, "Oh, I'm an entrepreneur "and I love starting companies." That's not it. And it wasn't, "Oh, I'm not a VC. "I'm just an operational guy." That's not it. I met the team and went, "We have to do this." I mean, that's really it. - Yeah, and this whole AIC change was happening. - Totally, absolutely. - That's the catalyst, right? - Yes. - So tell us about what Arminen does. - So Arminen leverages frontier models and AI On offense, to test do you have exploitable risk. And that's what we do today, we call it armored in red. But when we started a company, Travis and David Slater and Evan all knew the future of cybersecurity is gonna be A, The good guys have to build the offensive cyber cannon and shoot it at networks to make sure those networks can withstand these attacks because they're the ones that are coming. But we also knew... It's gonna be AI on offense built by the good guys, working and training with AI on defense built by the good guys, and you have to have both. So our act one was, we gotta be the best in the world at finding exploitable risk. If we're five minutes ahead of the bad actor, whether it be a nation state, criminal, Nuisance. If we're five minutes ahead of them, we also recognize their act two, armored in blue, We gotta stop it. [5:00] Unstained control, tourniquet. And so that's what Armiden does. We're building the force field you will need in the AI age to defend yourself from AI attacks. Yeah. Tell us about the nature of the capabilities of AI attacks today and then where you think it goes. Well, great. So the nature of them is, first off, we're getting a weird window in time where we're seeing them. but not at the same level you'd expect. I've seen nothing like what Armiden's already built in the wild, which is there's 25,000 agents on concert, all working together, doing really, really smart things without going on bizarre fishing trips. Because when you respond to an AI attack, You can tell it's AI very quickly. At least I can because I've thought about a lot of offense, I've responded to a lot of attacks in the past that were led by humans. And a human goes to point A, then to point B, then to point C through their intrusion. AI does little things, like four or five differences, but one would be it'll break into point A, Then laterally move to point B. Next thing you know, it's trying to break into point A, I guess. You know what I mean? It's like, I get the drone swarm, but you can probably coordinate and think a little bit better. That's where it's at today. It'll get better and cleaner. But the differences are, first and foremost, the scale of what AI can do dwarfs humans, like in ways humans don't even get. So you have a scaling problem in that humans could always find only one path into a network. Yeah, they had to be selective because they had to devote their limited resources to one direct path, right? And then, so scale is a challenge. Speed, ridiculous. What AI does in a microsecond would take 70 humans. They can't even do it. It's apples to oranges. And then, so what was always lacking is AI creative or effective. But when it comes to what we do, We don't need the fanciest model. We're not trying to speak 400 languages with our models and all that kind of thing. What Arminen's doing on offense is we're finding vulnerabilities, exploitable risk. That is code. That's a structured language, a structured process. Because it's structured... AI is going to be great at it. So I really think it's already here today. Like the whole, let's slow down the models. We don't want cyber risk too late. The open models are already good enough. And these things are coming now. It's just a matter of The minute you have anonymous availability of GPUs, you'll see far more criminal attacks. Oh, interesting. Yeah. You know what I mean? But until you can attack anonymously and it's hard to do crime when people know your name, it's better. If you can commit a crime anonymously, here's my tip for criminals. If you can commit a crime anonymously, that's a lot smarter than doing it with your jersey on, with your name on it. And so anyway, the difference in attacks and what we're seeing now, we are at the precipice, first inning still of AI led attacks coming. And I think that's just and availability of the models is not as readily available to the criminal element as it will be in the future. Yes, exactly. Okay, so you... your experience in working in the security industry for 30 years, you probably saw a fair amount of nation state attacks, right? Every day. Every day. So talk about the differences or similarities between nation state attacks. And I use that just to say the most sophisticated, most successful, if you will, types of attacks compared to AI today and then where you think AI can be in a couple of years. So everything's going to change rapidly, right? But I can tell you Nations on offense have never, in my opinion, they've never really been, when you're hacking for espionage and for security reasons, you hack with what I would call kind of a sniper round. You're not spraying and praying. For the most part, modern nations on offense restrict their targeting and they go deep at very specific things, like 30 defense contractors or dot mill. When they go hard at that, they're, Kind of think of it as that snipe around. With AI, I think it becomes more like a drone swarm. It becomes a little bit different in the cyber domain. And I think even modern nations are thinking, what will our protocol be? If we want to attack this company, do we swarm it? and just burn tokens on it because AI is going to do A lot of things humans just wouldn't. Right. So it's a little sloppier, a little louder. Yeah. but it's more effective. But it's more comprehensive. Yeah, that's the problem. You got it. It's more effective probably. And so there's going to be so many things a nation's got to think through right now. And their whole doctrine will shift as the AI shift change comes. Like how does AI change what our mission is? Do we maybe use the cyber domain differently? Do we drone swarm sometimes, snipe around other times? How do we balance the two? Does it depend on risk, target, how surreptitious we Yeah. Unless you've done a ton of pose training, you got maybe a human in the loop really look [10:00] Are we doing smart things? Because if you just go, hey, here's a prompt, hackabc.com, AI is not going to do it in a surreptitious, smart way. And I think even if you ask it to, it's still not going to until it's been really trained and really had some human influence on it. But more generally, what you're going to see is less capable attackers – less technical, less successful. are going to appear way more successful. It's the equalizer, right? Yeah, because of the volume. Yeah. When you start using models over time, what it's going to be is on the defensive side, we're going to say, we're being attacked by these models, but we're not sure who's behind them, those attacks. Is it a nation? Is it a human? And we'll have some clue, but attribution will get a little difficult. So that's a long-winded answer saying in the AI age, it does democratize far greater expertise good segue back to Armiden. So you have talked about the defense needs to be a great offense, right? Yes. Like best defense. You've got to train your defense with something. Yeah, of course. You've got to train your defense with something, and then it needs to be continuous. Right. Right. So how does the product work, and then how do you get a level of sophistication such that you can identify and remediate these vulnerabilities like what you're describing. They're more sophisticated than a basic prompt. Okay, a lot there. I could talk for 45 minutes on it. But first, I can tell you this. You don't have a defense unless you have a great offense to go up against. You know what I mean? So even think in sports terms, if you want to be the Baltimore Ravens defense at 2000, you kind of want to have your practice offense really push you. You know what I mean? So you know how good you are. And that's what Arminen's going to do. We're going to be the all-star team on offense coming at you. So you can train your defense with what we're doing. And that's going to be important. And you can't really have a human in the loop in the AIH for tactical autonomous defense. You've got to do something fast. You've got to tourniquet the wounds as fast as you can. Thinking back to our – you want to be able to do it continuously, and that's the complexity. So we do a thing called a hyperattack. And, David, that's just a fancy word for we throw – a drone swarm of agents at you and we map your network every service every route every system all assets we may end up with terabytes of metadata on your network from this hyper attack done super fast just it lights you up so that that way we can now it's almost like a metadata twin of what we can see if on the inside do the same thing let's just map everything this is the attackers view your network but with that metadata we now just pull you almost like a heartbeat what's changed What's changed? That's continually looking for, did an app change? Did a route change? Did a service get updated? Did a new machine get presented into the target area so that we can poll cheaply for change and then attack the change? What you really want in the future in the AI age is you want the constant pressure of models attacking you, but you can't do it all the time. Because A, it's cause prohibitive, but B, it's unnecessary. You do it when either the threat changes, hey, new models come out, new intelligence is available, or B, your network changes, so you want to test whether that happens. And then C, you probably just want to test. We have a board meeting tomorrow, let's see how we do. You know what I mean? Yeah, exactly. Yeah. Let's audit ourselves and see where we're at. And that's what we had over the weekend. There was a zero day and a popular product. And immediately, we've already got the heartbeat. We just polled who's got the problem. Yeah. And our goal at Armadin is to go from you know, common vulnerability or CVE to a, uh, We can find if it's exploitable or not before bad guys can. Right. You know, and not all bugs. allow for human beings access to your system in a stable way. So not all bugs are created equal. And so we want to make sure, hey, this one's one you really need to worry about or which ones don't give remote command execution. So long story made short, that hyper attack, that metadata that we get allows us to kind of pull for change and attack you when your network changes. That's the best you can do for continual. And we'll get better and better at it. And the cost for the polling will go down. You know, on small networks, it doesn't cost much. But on a network that changes all the time and is very large, you'd be polling it quite a bit to make sure – You don't have an exposure window. Yeah, of course. Yeah. So that is actually a very good explanation for why this continuous approach matters. Right. It's so fun. Like, you know, you and I share. Well, you're already up against it. Somewhere out there, the criminal element will always have that random scanning, and they probably aren't even using AI for it. They've got one exploit that they think works, and they're just kind of scanning the world for it and then coming at the exploitable risk, you know? And so you're already getting... some pressure on your network from an unseen force. that's not well-intentioned. You know what I mean? So you might as well have a, [15:00] Better Force. Built by the good guys. constantly putting pressure on you. Yeah, it's interesting. So you would kind of, Armiden, I don't know, a year ago would probably be placed in the category of pen testing. And you and I share history and relationship with George at CrowdStrike. And so they famously redefined the category from AV to EDR. And of course they did it in great things. But the category redefinition was on the back of major infrastructure changes and product changes, you know, and allowed them that was far greater and bigger than AV. Talk about pen testing. What is the historical view of pen testing and why that's not what the future is? Yeah, a couple of things. I mean, you had to do it, right? It was kind of like first gen AV. You have to buy AV. And I think when you look at Armadin, we will be as ubiquitous as AV because you have to have that AI force field of AI on offense, training AI on defense. You have to do it and you can do it. So why wouldn't you? And so you look at that and... pen testing to me is always just scanning for what's already known, and it doesn't prove whether you're really exploitable or not. So it's always created a larger list of volumes that don't matter. And so the way we wanted to do it at Armiden was we actually can carry the exploit out. We verify so there's no false positives. We can get remote code execution or get data off of that machine. And a lot of pen tests are nothing but hit your infrastructure, not with a thinking learning technology that memorizes and knows your infrastructure like an AI agent can. So it's not going to do custom apps. It's going to, at least the old versions of pen testing, you know, the Tenable, the Rapid7, the Qualys was more and what services are exposed and are there CVEs available against those services or no unexploitable vulns against them. When you have an AI-based attack, it'll find logic flaws rather than code flaws in custom applications. It'll exhaust all routes all the time. And it's like all I can tell you is Armiden since January of this year, in 2026, we have found over 90 zero days at customer sites, all in production. And by the way, your customer base is like, they're happy we found them. And they're like, this is not like rinky-dink companies. These are like Fortune 500 companies. Yeah, and I don't mean that as fear, uncertainty, and doubt. But the difference is that we've trained our models, we've post-trained all our models with real technology. red teamers, real folks that actually can develop exploits. And that's important. And so when we're scanning networks, we don't have source code to review. We're not finding these zero days with source code. We're not finding these zero days because we can log into an app and now we have access and we can get to other things. We are black box coming from the internet over 90 zero days in major software companies. And they're thankful. And so everybody's like, wow, Mythos came out and you scan source code and find vulnerabilities and you find thousands of them. that's noise. Yes. We're coming from the outside and then we're calling a CISO, you know, usually within 48 hours. Hey, we've got remote code execution in your DMZ. And usually from there, we're getting in and they agree with us. And they, and the nice thing is we're going through, you know, the fixed side's a little bit harder, takes a little bit longer, but those companies go right into incident mode. They respond as if it's an incident. And that's not a pen test. The difference between red teaming and pen testing is pen test to me is a hygiene step. And I think over time, everybody would have red teamed everything all the time if they could. It was cost prohibitive and people prohibitive. With AI and an agent doing it, or in our case, we have lots of different types of agents doing different things. you can now do that. So I think it'll replace pen testing over time. That's like a small portion of what a red team coming at you would do. Yeah. So, um, You mentioned earlier, obviously, that's armored in red. Yeah. You mentioned armored in blue. Talk about armored in blue. The armored in blue is like we can't, David, just show up and say, hey, you're vulnerable. See you later. Right. And, hey, the true north for every CISO should be effective autonomous response. We got to build that. And we knew all along you can't just say, hey, we want to be the best reward at finding exploitable rest. That's – Goal number one, but then goal number two and be the best one to do something about it. And that means. Arm it in blue, and arm it in blue will be, take the information about exploitable risk, and work with the defense plane. whether it be endpoint EDR or firewalls, and create compensating controls at speed. Yes. So that if we find an attack five minutes before someone else using a model finds an attack, [20:00] You're already safeguarded. And these safeguards are going to be rudimentary potentially out of the gates, right, over the next few months. A year from now, they're just going to be there because the whole cyber domain is progressing at a speed where you're going to have to. defend autonomously, for better or for worse. I'd rather have a bad patch stopping a bad guy from getting in than have an intrusion. You know what I mean? So you got to take your lesser of two things, and one's much more manageable. You never want an unknown person with arbitrary access on your network. And so you want to prevent that any way you can. And I would say the first generationists, we're working with CrowdStrike on it, and they know it has to exist. We're working with Pan on it. They know that it has to exist. They want to all shift into the AI age with autonomous defense you have the Fortinets and everybody else. Here's what you can do about it. And I likened it to, you know, kind of field dressing in war. Someone gets shot, you patch it up, But that's not the hospital, you know. That's a, hey, we kind of stopped the bleeding. But then you've got to maybe do something else with more time in humans, potentially, or even, you know, a genic approach to it down the road. So you're going to see it happen regularly. Even in... If you're a CISO, you're going to see autonomous defense happen even if you don't ask for it. Right. Because of the defensive platforms you've already invested in. Yeah. You mentioned earlier... some of the blurring of the lines of different categories within cyber. And I think you joked that your old days, your 30 years of experience is out the window or relevant or something like that. What is the future of the SOC? And then how do the categories within cyber blend together or change? You know, if I'm a CISO, I do believe my true north is effective autonomous security. You want to keep your best people engaged. You want to automate the processes that work for your organization. But you are absolutely saying what survives in the AI age and what doesn't. And I think we're still working through that process. I think there's whole processes in the SOC that will just go away. And for whatever reason, we're automating them right now. Yeah. You know, over time, I can tell you this. If you have humans in the detect and respond loop, you're going to be too slow. Yes. You know what I mean? It's just not going to work well. So you have prevent, detect, respond. Prevent is going to be governed by AI and detect and respond is going to be done by AI. And the goal in cybersecurity has always been if you have, you know. You want to prevent. Yeah, of course. You don't want to detect and respond. So I just see the constant narrowing of the window of every phase to the point where, you know, we're really not doing a lot of detection and response because the window changes. to do it, it all happens too fast. You got it. It's a little bit too fast. But you still got to have that onion peel to some extent of systems backing up systems and assuming failure somewhere. Right. You know, like even Armadine creating in the force field, sooner or later, somebody's going to get around it. Someone's going to create an exploit before we find it somehow, some way on a platform or an app that we just haven't assessed yet. It hasn't been in production at a customer do that, you will want to have a trap behind saying, we've got unauthorized access or unlawful access to a system. Those traps are... You just can't have a human there. I mean, it's just going to because we've already done it at Armand. And when we break in and have a gentic, aware, internal command and control, it proliferates at a speed that is shocking. Yeah. I remember as a human, you're typing on your keyboard, I want to go laterally move with this passphrase from here to here. And you're so slow, and you're doing one thing at a time. This thing just does a thousand things at once. It's just everywhere. And you're like, whoa, okay, done. So each one of those steps of the process has to be automated. It can't be a human in the loop. Yeah, it's as bad as this. I mean, I don't have great analogies. It's like the balloon popped. So when it gets in, it's just like, they're gone. Your whole defense apparatus just popped. So you got to get prevention right and then an immediate lockdown on detect and respond, however you want. And there's always gray areas between those phases because people say if you detect and respond automatically and fast, that is prevention. Yep. So all of it's going to change. Every sister's examining it. Every vendor's examining their role in changing into the shift. So it's going to all change now, but I can't tell you if anyone's positive on how it changes. They're examining their workforce. They're examining their head count. They're examining their processes, meaning the CISOs are. And they're saying, what do I need to look like in the modern era? But it's too soon to tell where it lands. Yep. So too soon to tell what they look like, what their defense apparatus is. [25:00] looks like. Um, Maybe so you have a bunch of Fortune 500 customers. You're close with a bunch of others that are not customers. Like what is the state of their vulnerability today? Rapidly shrinking. You know, everybody's worried. There's a desperation in a moment in both directions, by the way. If you're on offense in Iran or Russia, you have a desperation in a moment of getting now. know. And in fairness, both sides are accurate in their desperation. I mean, because we have near-term pain in the AI age that it advantages offense. So that's fine. That's just the nature of it. But both sides recognize it's for long-term gain, meaning AI on defense, being trained by AI on offense, and being autonomous is going to do a far better, more diligent job than humans peering at packets. You know, and so we're just going through the window of exposure, let's call it, where everyone's at risk on defense and they're all hustling. I've seen incredibly powerful efforts at every company right now, and I'm not aware of any large 1A enterprise not actively scanning for exposure. and doing something about it in real time. And what's interesting, David, is it's like it's Team ball everywhere. Like the CIO, the CISO, the product teams, the business lines are all like, okay, we found something. And it's almost like war roomed. Yeah. Like, we got to go fix this. And the compositor of those teams are pretty broad. So there's no way to make the next year pretty. That's the best way to say it. You know what I mean? It's a cocktail party out there right now, a digital cocktail party. And everybody's in a race. Yep. Yeah, one of our most sophisticated companies told us they took a large percentage of their engineers and research organizations and just devoted it toward fortifying their own walls. Yeah. Which was like an all-hands-on-deck. Yep. This is within the last few months, right? - I think Mythos was the biggest, I mean, we saw it coming long before Mythos, but the Mythos moment from a marketing standpoint got everybody to go, okay, Threats changed. And a lot of people said Mythos came out, find vulnerabilities in our own software. And you have to do that if you're doing software security attestation. So all the vendors ran out and did that. But the way I respond to Mythos is that just made it very well known about AI on offense coming at you. And I think that's what accelerated it. You know, that was... pretty much a firm stamp. It's coming. Yep. What about the hugging face incident? I'd love for you to talk about the, you know, I've given that a lot of thought. I mean, I'm certain at opening. I was like, Oh, or at a regular, they were like, Oh, we could have done this and this and it wouldn't happen. You know what I mean? So they've already figured it out. It's been my experience in every technical modality shift. we underestimate the adversary's capability. And in this case, we underestimated the model's capability. Because, you know, when you really read it post facto, ah, they... could have stopped that, you know? And they could have put guardrails on it, some deterministic things. And I think they realize that now. But I think when you're in a race, it's almost like a lunar landing race, right? The AI race. And you have R&D people and they're doing the work to create models in a way where even those CEOs are like, we can't slow it. Let's get the government to help us slow it. You know, that means you can't even control your own innovation. I have views on chasing that innovation. And it's really hard to package them with then like security, experienced security people that have the skill sets to cage that thing, you know? And it's hard to marry those two up because the security people don't understand the AI as well. And the AI people don't realize. One of the things that we did in our model, I mean, make no mistake, Armiden has made the beast that we're all worried about. We've made a model that attacks. We made many of them. successful breaking in. Well, is it safe? Well, our guys instinctively knew we got to have, obviously, a secure, you know, we got to have a hypervisor. We got to secure this thing. We got to lock it down host-based. We have to have a proxy. It knows the proxy. It's proxy-aware. That's fine. But then our guys did something, and even I was like, nice job. They passively, surreptitiously look at every single Prompt on. Do we like it? Do we not like it? And the majority of the time, if we kill an agent, it's probably nothing to do with safety. It's that the agent's wasting money. You know what I mean? So kill it. It's off on a goose chase we've already done or don't want to do. But there were so many layers of validation that the agent was doing the right thing. And the other thing was... Assume every layer of your security will fail, and you have to have deterministic rules that eliminate certain activities. But what I did learn reading those incidents – It does take them [30:00] aim expertise, to secure agents behaving in certain domains. You know what I mean? - Yeah, yeah, it's a group. - So I get that. So without a cyber background, I get how you're gonna make You're going to test something, go, oh, didn't think of that. Yes. And you would have had to have an experienced team look at what the evals look like to say, you know what? It's going to do this and it's going to do that. So that's why Armadin, we combine the exploit developer types and red teamers with the AI folks because our evals most of the time are made by the red teamers. Right. You know what I mean? They're the ones that understand this stuff. Thank you. period, at different victim sites and our experienced operators have done when testing networks. And we had no model before. go through the entire kill chains of more than eight. So that's where it is. Eight out of 20. And here's what's weird, by the way. We tested the open weight ones and... the most advanced closed models, they all found eight. - Yeah, really? - So if you're, yeah, so it was all about just speed and cost, you know? - Of course, yeah. - And the closed models were faster to finding exploitable risk, but that's coming down, but we kinda let the open models run longer, and they got to the same place. - That's it. - So in the cyber world, the differentiation between closed and open is not as great as in other domains probably. And it's compressed, yeah. I would say that's somewhat consistent, in terms of the capability gap at least closing a little bit. But that's interesting that their performance is basically the same. From my perspective, seeing the charts from the team, all the lines ended up in the same place. When you're looking at, it was immediately time, cost and then call it effectiveness or creativity, they all ended up At the end of all their operations, where they hit diminishing returns, they ended up in the same place. Not on cost, though. Yeah, not on cost. Yeah, that makes sense. Yeah, that makes sense. So it's a decent segue maybe to talk about what kind of models you guys are using and then what role do you think the lab companies play in the future? Well, and I don't even know if I finished answering your last question other than domain expertise on security is going to have to work with the AI folks. Because I did read the Meter publication, and I was like, well, these guys are AI people, but I'm not sure they've done a lot of investigations. They don't have the domain expertise, yeah. And that's going to happen. the modality shift, because here's one. When clouds started emerging, I was running a bunch of incidents. We were responding to breaches for a living at Mandiant, and we had to learn what's a cloud breach look like. We now have to learn what's an AI breach look like, how much data is an anthropic or the model companies that are being leveraged to do the attacks, what do you wish they logged, and how they will change behavior as well to have better audit trails, better forensic into it in a way where we have the accountability. When these things go rogue, you can say, here's what happened and when. And it shouldn't be like two weeks of forensics to figure it out. I hate to say it. Like we log every single thing our agent does. Source IP address, time and date, and what it did. So you got to go backwards and replay these things. And I think they've learned lessons. The hard way. And they're probably way better today than they were even three months ago at OpenAI and Anthropik and testing these things. And whoever had a regular lab, they're looking at this going, okay, we got to tighten up a little bit here. They were surprised because they underestimated it. And we've done the same with human adversaries. It is the weirdest thing. My whole career, everybody underestimates the top tier of what you're up against. Because you don't have to see it every day. And you don't want to fear the boogeyman, as they say under the bed. So you don't want to have FUD. But you still want to respect the technologies that you're creating and test them in a way that is meaningfully effective. Guarded. Got to cage the beast, David. Do you know what I mean? You do. And I would argue cage it too much, release a little bit. Find the line because if you do overly deterministic, here's the art form to safety running AI, at least in cyber on offense, is you want to leverage the intelligence of the frontier labs to do stuff. but not do the wrong stuff. So you need classifiers, you need a model that looks at everything going outbound, everything coming inbound. We've created that with people and humans going, thumbs up, thumbs down, that's good, that's bad. You gotta train it, classify, and look at it. But if you get too deterministic and disallowed too much, you're probably not leveraging the creativity of it. You let it out, so it is a gray area. And that's the problem with that gray area, is that's why no one would ever say, we're 100% certain we're gonna get what we expect. Period. It's a battle we even have, but we have yet to have an issue because we can put a human in the loop or we have classifiers that say a human needs to decide this. We don't know what the hell just happened. You know what I mean? [35:00] to the labs, everything coming back, and something comes back, and we don't know what the hell it is, pause, escalate, judge. Yeah. What do those great security operators look like inside Arminen? A lot of experience. 15 years on offense, 15 years of red teaming. I think we've red teamed literally 99 of the Fortune 100 throughout our careers. Wow. We didn't get one, and I know who it is, and they've never hired me, and I love their products. So one day, maybe I'll get it. How do we get it? Let's go get those guys. Yeah, talk to them all the time. Never land at them. That's all right. They might be good. But, you know, they are very experienced. And they all, you know, when I look at our 90 plus zero days, the majority have been found by human. Right. But they're found by humans because we're leveraging AI to do 90 plus percent of the tedial work, which is pen testing, done, automated. Web app pen testing in creative, articulate way, done, automated for the 98th, 99th percentile. But we're still putting humans on it. But here's where it gets interesting, David. The last few zero days, tech found it. Really? Oh, wow. So we've made the turn. And most people already have made the turn Tech if you on offense leveraging AI your AI agents are finding zero days Yeah I want to shift gears now to your philosophies and mindset in building a company You know, they're different. Yeah. So a couple of things there. Like the first time I built a company was 2004. And I wouldn't have said I was an entrepreneur. I started Mandy at no four February. And it was self-funded and profitable. And we were successful because in hindsight, it's like you almost learn nothing at the time. And you look back and go, oh, I did learn right then and there because of the pain, usually. But I look back on Mandiant now. We had a premise nobody actually believed in 04 because our first website said security breaches are inevitable. And nobody believed it. And I don't even know how much I believed it. It's a pretty good headline. By the way, I'm slightly off. Our first headline was you cannot solely rely on preventive measures. And that was so boring. That's the same as security breaches are inevitable. Yeah. Can't rely on defense. Better ring on the security. Yeah, I got it wrong because I'm not a marketing guy. But anyway, so security breaches are inevitable. And the premise was that let's respond to every breach that matters so we have first mover intelligence on how to prevent it happening again Yeah And so the first model of Intel in all of cybersecurity was antivirus You know it was like we look for malware Yeah We have signatures for it And if we miss David George has to find the malware and submit it to us so we get better And that's a bad model. My mother's not finding malware on her laptop. You know what I mean? She's going to eat her laptop alive. So that model was bad. So we decided a better model because I responded to breaches. And the reason I was responding to them is AV was easily evaded. And so we were like, well, let's learn all the, you know, let's second layer AV because it stinks. And that's what George now owns, you know. So that's second layer AV. You still have to have AV, though. I beat it up, but the reality is you still need it or something that replaces it. So the second layer of defense was required. So AV was imaginal line to here. Then you extend imaginal line with something that can learn and think. And so we wanted to do that. And I actually look at Armand. It's just the third wave of intel. Like, why are we waiting for a victim and learn from that? That's ridiculous. You've got to find your own problems first. Don't wait for defense contractor A to be compromised and then quickly share the information to make sure it never happens again. And that model still needs to exist for the things that are somehow get there, that beat you. But we got that model now and it just not good enough So back to your question you know Mandiant was self There not a lot I don know self companies these days David Well, the speed requires that. You've got to be fast. That's the difference. Yeah. You look at we started Armid and the philosophies were different. When I started Mandiant, it was, hey, this is what we do for a living. Let's make enough money to do it for a living. That's it. I mean, so we hired the best people and we had a philosophy of we're going to pay you more than our competition, but you're going to work harder. Yeah. So we always felt like we had less people working harder, but better people. Yeah, I think we had it. We were known for having great talent and that talent has prevailed. There was a time about a year ago, somebody sent me a text and they said, congratulations, 43 percent of the RSA main stage keynotes are Mandy and alumni. Come on. And that's the text I got. I never verified it, but the guy's pretty accurate. I'll take that stat if that's true, and I think it probably was. We've got a lot of reach over time with a lot of talent. I mean look at FoundSone, look at George Kurtz. He and I worked together at FoundSone in 2000. From FoundSone you've spawned a lot of successful companies and people. So same thing with Mandiant, but the differences are this. [40:00] Gotta be funded. Yep. Be funded. Oh, your growth rate. get the market now. Like I look at Arminen's opportunity, I feel like we have an 80 mile an hour tailwind, but we don't We don't have a sales force. We don't have a go-to-market. We're not international. All that just has to happen. And the only way to thread the needle in today's economy is to be able to do that. to beat the bigs is get this go to market in place with exactly the right tech at the right time And you better already have your act two. Ready. Ready. And your Act 3 behind that ready because you don't want to get boxed into a corner. So Arminen's got an Act 2, we have our Act 3 planned, but we're in the process of building go-to-market, which requires the funding, and you have to build it ahead of time. The consumer AI companies created such meteoric rises in revenue. I don't think they can be replicated in enterprise security sales. You just saw the compression. Wiz got to over $100 million in AR in 18 months from their first release, right? We're going to try to beat that. And that's what you have to do, especially when you're needed, necessary, and you have to exist. And that's not easy to do. So you've got to get the funding. You've got to constantly think, how do you rapidly grow? You can't let the wheels on the bus get wobbly, meaning how do you go that fast and maintain process? At Mandian's pace, if we were self-funded and profitable with no competition because nobody believed the premise, didn't get that wobbly. We just had great leadership and discipline and we could do it. Growing this fast, you have to hire scalable leaders right away that understand institutionalized process. You can't win with grit, gut and moxie. You actually have to proceduralize, almost industrialize. the Armiden way. - Yes. - You know what I mean? And that's what I'm trying to figure out. It's how do we do that? and feel comfortable doing it. And here's complications, so let's do it. A, you got to grow fast. B, in the AI age, It used to be Development was at a speed. - Well you train sales at sales kickoff in January, and you're good. - Exactly, yeah. - So I'm trying to figure out, wait a minute, we're different every two weeks. - It's changing too fast. - What is the modality now of having a sales core that is right up to date. And here's the challenge that I thought. Every CEO I've talked to is like, how does AI change our business? and we all sort that out, but how does it change our manpower? When I look at AI's influence on sales, the reality in enterprise security sales People still buy from people. Yes. You still need the same damn go-to-market structure for now. And in fact, it's even more in bold because the tech's changing so fast, you can't put that onus on the customer to figure out how did you change, where is it at? So we have got to create a process, institutionalized, where sales is trained every week. Where are we at? How are we doing? And these are processes that will get you to win. Yeah, the credibility on the security side, right? Yeah, exactly. Yeah, you got to be great. I'm involved in, we are not ever aiming to be, let's be number two in our space. That sounds fun. It is be the best in the world at what you do. And when we hire people, I remember getting a question once. Somebody asked, well, how do you know when you're the best? And I'm like, when you are the best, you know it. You have to be the best in what I've ever done. - If you have to ask the question, you're probably fine. - I'm pretty sure there was a time in LeBron James' career where he knew I'm gonna have to work harder, to stay the best. Yes. Right? And that's how I want us to feel at Armiden. The sports analogy is all work. Tom Brady never walked on the field going, well, I'm the second best quarterback out here. No, always. But it requires harder work, better people, and you have to constantly test, are we the best? Are we the best? And you learn very quickly from your customers if you got to do better. Right. So that feedback loop, customer straight in to the engineers is critical as well. So long story made short, speed has changed, got to do a capital raise, processes that and test those processes all the time. What I can't stand is chaos. A CEO's job is, to absolutely hide chaos at a company from the employees. - Right. - Period. You gotta make sure they're not like, we're so loose, we have no idea. Wrong. You have to just say, here's the process. If process is too much for you to study, that's the person you go to. All you need to know is a guy or a person's name. And that's how I look at it. How do we grow rapidly without feeling chaotic? How do we grow rapidly earning it with better product? And how do we change fast? I don't know how long IP lasts. So it's like you've got to build a Ferrari engine and say, you know what? Whatever we're doing today, someone else is doing it in six months. Yeah, yeah, yeah. So how do you differentiate over the next six months is go to market. Go to market. Get customers and make them happy. You got it. The brand itself has to be built, too. You have to become a brand that is the seal of approval. Yep. So I just gave you a jumbled answer. I wish AI could summarize really quick. So here's the four differences. The funding, the speed, the branding matters, the go-to-market buildup. You have to build it way faster today. [45:00] than you had two years ago. Well, and the big reason why that's the case is because this is a tsunami like has never been seen before in security, in the security market, right? CrowdStrike, you know, and then the other players that were around it, they redefined the category, but they had to create the category. Yes. In the case of Wiz, part of the reason that it was able to grow so fast is because it was a, oh, bam, hit you like a ton of bricks pressing need. Yep. And so everyone felt like they needed to buy this or something. I think they innovated really fast too, though. Like, you know, you got to get the halo. And I personally think you get the halo trade secrets. You get the halo by getting the right customers and making them ecstatic. Yes. You know, you like, no offense if there's a place called, I don't know, Susie's Cupcakes. They don't get you the halo if you make them happy in cybersecurity. Right. But the money center banks do. The best retail does. The airlines do. You can get it. Yeah, of course. And so that's why Arminen's making money enterprise focus number one. Absolutely. Solve the hardest problems. Yep. And I think Wiz did that. Yeah, they did a great job of it. One of our companies, too. Yep. And we love those guys. All right, what else do you want to talk about, I think? Well, I'd never answer your question on the differences, too. There's more founders today than ever before. Yes. There's more startups than ever before, and they're all able to capitalize now. So you will have competition. in anything you choose to do right now. There's not going to be a mandate. Security breaches are inevitable, and it's right. and there's nobody else there. Yep. That's not going to happen right now. So everyone's in a crowded market. So I think every founder has to recognize you have to differentiate people And probably right now, because of the noise in marketing more than ever before, the only way to differentiate is get customer, make customer happy and repeat. Yep. There is nothing else that will differentiate you other than your customer base raving about you. Yep. So you better go do that. That's it. So I just gave away every trade secret. I've got it. None of it's rotten times. It's like literally, honestly, it's the same thing that's always been in business. Yeah, but it's just at hyperspeed now. Just got to do it faster. And that speed requires... Never forget what you should focus on get customer make customer happy repeat. Yep, that's it and you got to do that and then everything else is like around that is to make sure you do that really well the training the sales enablement the marketing the people you're hiring your hiring process the teamwork, you know, so in some of the ways we differentiate as well. Well, you know, you know, we have all our engineers in one room. Yeah, we're a big believer in that, you know, I think managing distributed teams is more complex than standing up and asking questions and 20 people are in the room to answer slow speed if nothing else yeah So it's a great time to start a company, though, because... almost every, well, every industry is going to change. Yes, sir. and in cybersecurity, Every single tech stack is going to be different over the next two years. Yes, you had people are gonna get ripped out put in new tech and It's all got to be revamped. And so it's fun and exciting to be part of that. It's the tailwind of a lifetime in cyber. Yep. Yep. Well, look, we're so excited about what you're building and through our partners. So thanks for being here. That was fun. Thanks for listening to this episode of the A16Z podcast. If you like this episode, be sure to like, comment, subscribe, leave us a rating or review, and share it with your friends and family. For more episodes, go to YouTube, Apple Podcasts, and Spotify. Follow us on X at A16Z and subscribe to our sub stack at A16Z.substack.com. Thanks again for listening, and I'll see you in the next episode. measures. Thank you.