NVIDIA
Nvidia argues that deploying commercial Level 4 autonomous fleets requires pairing end-to-end reasoning models with deterministic classical safety guardrails on standardized vehicle hardware.
AI-assisted summary of NVIDIA GTC Automotive Special Address — original source. Check the original for full context.
Source published:
Key ideas
- NVIDIA announced a major commercial partnership with Uber to deploy Level 4 autonomous vehicle services across 28 global cities by 2028, supported by an Uber data collection fleet utilizing Hyperion 10 sensor suites. (39:07)
- Four of the world's top ten automotive manufacturers—BYD, Geely, Nissan, and Hyundai—have officially adopted the NVIDIA DRIVE Hyperion compute and sensor reference architecture. (39:07)
- NVIDIA unveiled Albatross 1.5, a 10-billion-parameter reasoning model featuring native routing, multimodal natural language prompt understanding, and flexible camera layouts, which ranks first on the public LingoQA benchmark. (18:55)
- To accelerate industry-wide validation, NVIDIA is open-sourcing 7,000 hours of multi-country driving fleet data alongside NeuRecon neural reconstruction tooling, which powers 2 million daily closed-loop simulation runs internally. (22:40)
- DRIVE Hyperion 10 integrates dual DRIVE AGX Thor SoCs built on Blackwell silicon, delivering an estimated 20x performance improvement over DRIVE Orin when executing in FP4 precision. (12:31)
Detailed notes
## Background Published on YouTube by NVIDIA on March 25, 2026, this GTC Automotive Special Address explores how autonomous vehicles are becoming the first mass-deployed physical AI agents. According to the page description, the session details the path to Level 4 autonomy through NVIDIA's DRIVE Hyperion architecture, its cloud-to-car development and simulation platform, agentic AI innovations, and partnerships across OEMs and robotaxi operators.
## TL;DR Framing 2025 as the pivotal inflection point for autonomous driving driven by reasoning and foundation models, the address presents NVIDIA's three-computer, five-layer automotive stack spanning training, simulation, and real-time vehicle compute. The presentation highlights DRIVE Hyperion 10 powered by dual DRIVE AGX Thor SoCs, the ASIL D-certified HALOS operating system and safety guardrail layer, and open-source foundation models including Albatross 1.5 and the NeuRecon simulation pipeline. It also charts the global deployment of DriveAV's hybrid end-to-end and classical architecture with Mercedes-Benz, an L4 robotaxi partnership with Uber across 28 cities by 2028, and expanding ecosystem adoption across BYD, Geely, Nissan, and Hyundai.
## Atmosphere & style The presentation carries the polished, forward-looking momentum characteristic of an executive NVIDIA GTC address, balancing high-stakes industry ambition with rigorous engineering specifics. The speaker delivers the material with an accessible, grounded confidence, interspersing macro-economic transportation metrics and technical software diagrams with lighthearted candidness about developer adoption. Watching the session feels like attending a comprehensive technical briefing that methodically connects frontier AI research to road-tested, safety-critical automotive hardware.
## Bulletin - [39:07](https://www.youtube.com/watch?v=7N38fD4ksnI&t=2347s) NVIDIA announced a major commercial partnership with Uber to deploy Level 4 autonomous vehicle services across 28 global cities by 2028, supported by an Uber data collection fleet utilizing Hyperion 10 sensor suites. - [39:07](https://www.youtube.com/watch?v=7N38fD4ksnI&t=2347s) Four of the world's top ten automotive manufacturers—BYD, Geely, Nissan, and Hyundai—have officially adopted the NVIDIA DRIVE Hyperion compute and sensor reference architecture. - [18:55](https://www.youtube.com/watch?v=7N38fD4ksnI&t=1135s) NVIDIA unveiled Albatross 1.5, a 10-billion-parameter reasoning model featuring native routing, multimodal natural language prompt understanding, and flexible camera layouts, which ranks first on the public LingoQA benchmark. - [22:40](https://www.youtube.com/watch?v=7N38fD4ksnI&t=1360s) To accelerate industry-wide validation, NVIDIA is open-sourcing 7,000 hours of multi-country driving fleet data alongside NeuRecon neural reconstruction tooling, which powers 2 million daily closed-loop simulation runs internally. - [12:31](https://www.youtube.com/watch?v=7N38fD4ksnI&t=751s) DRIVE Hyperion 10 integrates dual DRIVE AGX Thor SoCs built on Blackwell silicon, delivering an estimated 20x performance improvement over DRIVE Orin when executing in FP4 precision.
## Key takeaways - [07:28](https://www.youtube.com/watch?v=7N38fD4ksnI&t=448s) Autonomous vehicles represent the primary vanguard of Physical AI, serving as the first mass-deployed embodied robotic systems tackling the 13-trillion-mile global transportation market where autonomy currently accounts for only 0.006% of travel. - [09:57](https://www.youtube.com/watch?v=7N38fD4ksnI&t=597s) NVIDIA's automotive development model is built around a 'three-computer' paradigm spanning cloud foundation model training, cloud simulation for validation, and in-vehicle real-time inference. - [09:57](https://www.youtube.com/watch?v=7N38fD4ksnI&t=597s) The platform is organized across a five-layer stack encompassing DRIVE Hyperion hardware, the HALOS safety operating system, foundation reasoning models, the DriveAV application stack, and cloud development infrastructure. - [12:31](https://www.youtube.com/watch?v=7N38fD4ksnI&t=751s) DRIVE Hyperion 10 offers standard Base and High sensor reference designs, with the High package providing full hardware fail-operational redundancy via 14 exterior cameras, 9 imaging radars, and 1 forward LiDAR. - [16:11](https://www.youtube.com/watch?v=7N38fD4ksnI&t=971s) The HALOS operating system delivers ISO 26262 ASIL D safety certification while absorbing hardware and sensor abstraction layers directly into NVIDIA's stack, freeing OEM engineering teams from writing custom middleware. - [17:49](https://www.youtube.com/watch?v=7N38fD4ksnI&t=1069s) HALOS incorporates certified active safety guardrails directly into the operating system runtime, pairing cutting-edge end-to-end models with classical deterministic software stacks compliant with 5-star Euro NCAP standards. - [18:55](https://www.youtube.com/watch?v=7N38fD4ksnI&t=1135s) Albatross 1.5 was fine-tuned on 80,000 hours of curated autonomous driving data built upon the web-scale Cosmos foundation model, which was pre-trained on 20 million hours of real-world video. - [22:40](https://www.youtube.com/watch?v=7N38fD4ksnI&t=1360s) NVIDIA is open-sourcing generative AI simulation tools NeuRecon, Harvester, Fixer, and Cosmos Transfer to extract real-world road obstacles, alter vehicle perspectives, and restyle environmental weather and lighting via text prompts. - [29:15](https://www.youtube.com/watch?v=7N38fD4ksnI&t=1755s) Following a five-year joint engineering initiative, NVIDIA's DriveAV software stack has deployed worldwide across all 2025 Mercedes-Benz vehicles outside China, targeting full address-to-address L2++ availability throughout 2026. - [29:15](https://www.youtube.com/watch?v=7N38fD4ksnI&t=1755s) NVIDIA's production DriveAV architecture utilizes a hybrid approach where end-to-end deep learning networks run concurrently with classical deterministic stacks on a single DRIVE Orin SoC. - [33:19](https://www.youtube.com/watch?v=7N38fD4ksnI&t=1999s) DriveAV maintains high development velocity by logging approximately 10 model iterations per day (over 3,500 in one year) and compressing field data turnaround to closed-loop testing down to under six hours. - [35:57](https://www.youtube.com/watch?v=7N38fD4ksnI&t=2157s) A real-time safety arbitrator continuously monitors end-to-end neural trajectories and instantaneously hands control over to classical path planning whenever safety margins are breached. - [37:19](https://www.youtube.com/watch?v=7N38fD4ksnI&t=2239s) The software architecture creates a unified bridge from L2++ to L4 autonomy, using a shared codebase split between a primary Main ECU and a safety-redundant Satellite ECU executing automated Minimum Risk Maneuvers. - [37:19](https://www.youtube.com/watch?v=7N38fD4ksnI&t=2239s) NVIDIA's commercial deployment roadmap schedules global L2++ scaling within the year, commercial Level 4 pilot fleets next year, and full production L4 passenger vehicles by 2028.
## Detailed walkthrough ### [00:09](https://www.youtube.com/watch?v=7N38fD4ksnI&t=9s) The ChatGPT Moment for Autonomous Driving
The session opens with an energetic welcome to GTC, reflecting on what a transformative period it has been for autonomous vehicle developers. The speaker frames 2025 as a definitive turning point for the industry, driven primarily by the lightning-fast emergence of cutting-edge AI architectures—specifically Vision-Language-Action (VLA) models, world foundation models, and reasoning models. These breakthroughs have fundamentally disrupted legacy autonomous vehicle development pipelines. Rather than causing friction or setbacks, these changes have dramatically accelerated the industry’s trajectory toward full autonomy.
Looking back across NVIDIA's journey over the past decade, the speaker recalls that ten years ago, NVIDIA introduced its first ADAS chip, Parker, which helped power the very first generation of Autopilot. Now, at another pivotal juncture, the company and its engineering teams are partnering across the broader mobility ecosystem to establish a safe, scalable route to full Level 4 autonomy. Reflecting on this turning point, the speaker emphasizes: “And at this moment, I would say that the path to full L4 level autonomy has never been this clear.”
- Technological drivers of this inflection point: Vision-Language-Action (VLA) models, world foundation models, and reasoning models. - Historical milestone: NVIDIA Parker SoC launched a decade prior to enable initial consumer autopilot systems. - Core industry objective: Unlocking scalable, safety-certified Level 4 autonomous driving across passenger vehicles, robotaxis, and delivery platforms.
---
[03:16](https://www.youtube.com/watch?v=7N38fD4ksnI&t=196s) In-Car Reasoning Demonstration with Alpamayo and Mercedes-Benz
To showcase reasoning capabilities in real-world scenarios, the presentation features a drive through San Francisco and across the North Bay in a prototyping vehicle built in partnership with Mercedes-Benz. The vehicle runs NVIDIA's Alpamayo reasoning model, which continuously perceives and evaluates the environment in real time while engaging in natural spoken dialogue with the passengers. When a passenger asks why the Transamerica Pyramid features its distinctive shape, the in-car assistant responds promptly with architectural context, explaining that William Pereira chose the tapered profile so that sunlight could reach street level rather than casting an overpowering shadow across the city blocks.
Beyond conversational infotainment, the test vehicle is prompted to narrate its internal driving thoughts aloud, demonstrating how the model evaluates traffic dynamics before executing maneuvers. As it travels, the vehicle articulates its reasoning in plain English: identifying an oncoming traffic stream when waiting for a left turn gap, planning a path around a double-parked delivery truck, and yielding smoothly to pedestrians at crosswalks or crossing vehicles. When prompted to make casual route adjustments—such as speeding up, changing lanes, taking an exit toward Sausalito for coffee, or pulling over—the system plans safe, compliant maneuvers. Highlighting how this architecture handles unpredictable environments, the narrator notes: “What sets Alpamayo apart is how it reasons through complexity, breaking down edge cases before they become problems.”
- Vehicle platform: Prototyping vehicle developed in close partnership with Mercedes-Benz. - Reasoning model: NVIDIA Alpamayo, operating continuously in real time to handle route planning and conversational queries. - Situational behaviors handled: Lane changes, unprotected left turns, double-parked obstacle navigation, pedestrian crosswalk yielding, and safe drop-off curb detection. - Commercial roadmap: In-vehicle consumer trials and customer experiences targeting late 2025.
---
[07:28](https://www.youtube.com/watch?v=7N38fD4ksnI&t=448s) Physical AI and the 13-Trillion-Mile Opportunity
Tracing the broader progression of artificial intelligence, the speaker references Jensen Huang’s keynote themes outlining the industry's progression from perception AI (sparked by AlexNet in 2012) to generative AI (unlocked by the Transformer in 2017), onward to modern reasoning and agentic models. The next frontier is grounding these agents within physical systems: physical AI. Autonomous vehicles represent the vanguard of this movement as rolling, road-going robots that will serve as the first mass-produced and mass-deployed manifestation of embodied intelligence. Framing the stakes of this shift, the speaker states: “And we believe that building and safely deploying physical AI is going to be the defining challenge of the coming decade and since automotives are just basically driving robots on the road, I'm pretty sure AV will be the first mass-produced and mass-deployed physical AI technology and applications.”
The commercial imperative behind this engineering effort is underscored by staggering global transportation figures. Every year, approximately 13 trillion miles are traveled globally across passenger cars, commercial transport, and delivery vehicles. At present, however, a mere 0.006% of those miles are driven autonomously. Bridging that vast disparity presents an unprecedented economic and technological frontier for mobility providers, OEMs, and NVIDIA alike, supporting the overarching vision that eventually every moving machine will operate autonomously.
```mermaid flowchart LR accTitle: Evolution of AI into Physical Embodiment accDescr: Progression from AlexNet perception AI in 2012 to Transformers in 2017, reasoning agents, and Physical AI in autonomous vehicles.
subgraph Perception["2012: Perception AI"] A["AlexNet<br/>Computer Vision"] end
subgraph Generative["2017: Generative AI"] B["Transformer Architecture<br/>Foundation Models"] end
subgraph Agentic["Present: Agentic AI"] C["Reasoning Models<br/>VLA & World Models"] end
subgraph Physical["Coming Decade: Physical AI"] D["Embodied Robotics<br/>Autonomous Vehicles"] end
A --> B B --> C C --> D ```
- Annual global vehicle travel: Approximately 13 trillion miles logged across personal cars, delivery vans, and motorbikes. - Current autonomous penetration: Only 0.006% of global miles driven autonomously today. - Industry vision: Transitioning 100% of mobility and logistics transport to full autonomous capability over time.
---
[09:57](https://www.youtube.com/watch?v=7N38fD4ksnI&t=597s) The Three-Computer Architecture and Five-Layer Stack
To address the immense complexity of physical AI, NVIDIA has structured its automotive strategy around Jensen Huang’s three-computer paradigm. Solving autonomy requires an ecosystem composed of a cloud training supercomputer, a cloud simulation supercomputer for verification, and an in-vehicle inference supercomputer. On top of these three computational pillars, NVIDIA is building a comprehensive five-layer platform designed to serve developers, Tier 1 suppliers, and automotive OEMs.
At the base rests the DRIVE Hyperion hardware layer, which provides a unified reference architecture spanning computing hardware and sensor suites. Directly above it sits HALOS (Hardware Abstraction and Safety Operating System), delivering safety guardrails, middleware, and operating system foundations for end-to-end models. The middle tier contains foundation and driving models such as the open-sourced Alpamayo architecture. Above that, the application tier encompasses DRIVE AV, supporting in-house full-stack software ranging from assisted driving to complete L4 driverless operations. Finally, an overarching cloud infrastructure layer provides toolchains, synthetic data generation, and foundation models to streamline model development and validation.
```mermaid flowchart TD accTitle: NVIDIA DRIVE Five-Layer Physical AI Architecture accDescr: The five architectural software and hardware layers spanning the three-computer paradigm of training, simulation, and vehicle inference.
subgraph CloudInfra["Cloud Infrastructure Layer"] L5["Foundation Models, Toolchains & Cloud Sim"] end
subgraph AppLayer["Application Layer"] L4["DRIVE AV Full-Stack Software (L2+ to L4)"] end
subgraph ModelLayer["Model Layer"] L3["Alpamayo Reasoning & Foundation Driving Models"] end
subgraph SystemLayer["Operating System & Safety Middleware"] L2["HALOS (ASIL D Safety OS, Guardrails, Middleware)"] end
subgraph HWLayer["Unified Vehicle Hardware Layer"] L1["DRIVE Hyperion (DRIVE AGX Thor & Sensors)"] end
L5 -.-> L4 L4 --> L3 L3 --> L2 L2 --> L1 ```
- The Three Computers: - Cloud Training Computer (foundation model training). - Cloud Simulation Computer (closed-loop testing and synthetic validation). - In-Vehicle Real-Time Inference Computer (in-car execution). - Five Service Layers: - Hardware: DRIVE Hyperion reference compute and sensor configurations. - Platform/OS: HALOS operating system and safety runtime middleware. - Models: Alpamayo open and proprietary reasoning driving models. - Applications: DRIVE AV software stack scaling from partial assistance to full driverless autonomy. - Infrastructure: Cloud development toolsets, foundation models, and evaluation pipelines.
---
[12:31](https://www.youtube.com/watch?v=7N38fD4ksnI&t=751s) DRIVE Hyperion 10, AGX Thor, and Sensor Reference Designs
The compute core of DRIVE Hyperion is powered by dual DRIVE AGX Thor SoCs—NVIDIA’s flagship automotive superchip architecture built on Blackwell technology. Because in-vehicle platforms are perpetually constrained by thermal envelopes and memory bandwidth, Thor incorporates native 4-bit floating point (FP4) precision support alongside FP16 and FP32. Leveraging FP4 allows the system to achieve an approximate 20x performance uplift over the previous-generation DRIVE Orin SoC, providing the compute density necessary to run complex reasoning and multimodal models locally.
Hyperion also addresses data fragmentation across carmakers by establishing a standardized, cross-compatible sensor reference architecture. NVIDIA is partnering with Uber to field a dedicated fleet equipped with the Hyperion 10 sensor specification, kickstarting widespread data collection for the ecosystem. The platform offers two primary sensor packages: a High configuration and a Base configuration. The High model provides full fail-operational redundancy designed for urban and highway L3/L4 deployments, comprising 14 high-definition exterior cameras, up to 4 interior monitoring cameras, 9 imaging radars, and 1 forward LiDAR. The cost-optimized Base package uses 10 cameras and 3 radars to deliver address-to-address, hands-free highway and urban driving, including park-to-park maneuvers.
- Central Compute: Dual DRIVE AGX Thor SoCs built on the NVIDIA Blackwell architecture. - Compute performance: Up to a 20x throughput improvement over DRIVE Orin when utilizing FP4 precision. - Hyperion 10 High Configuration (L3/L4): 14 exterior HD cameras, up to 4 interior cameras, 9 radars, and 1 LiDAR with full hardware fail-operational redundancy. - Hyperion 10 Base Configuration: 10 exterior cameras and 3 radars delivering hands-free address-to-address and park-to-park capability. - Fleet Partnership: Collaborative data collection deployment utilizing Hyperion 10 sensor suites across an Uber testing fleet.
---
[16:11](https://www.youtube.com/watch?v=7N38fD4ksnI&t=971s) HALOS: A Unified L4 Software Safety Foundation
Sitting directly on top of the Hyperion compute fabric is HALOS, designed to provide a unified, safety-certified software foundation for Level 4 autonomous operations. At its base layer, HALOS incorporates an operating system certified to automotive safety's most stringent integrity classification—ASIL D. Evolving from the legacy DriveOS runtime, this OS incorporates foundational developer toolkits and libraries including CUDA, TensorRT, and an LLM SDK to ensure large vision-language and reasoning models execute with maximum hardware efficiency. HALOS maintains broad automotive OS compatibility, supporting both safety-critical QNX and standard Linux environments.
Above the OS kernel, HALOS introduces a standardized middleware layer that redefines historical boundaries between NVIDIA and automotive OEMs. During the preceding DRIVE Orin generation, carmakers had to dedicate hundreds of embedded software engineers just to specify, write, and maintain custom hardware abstraction layers for diverse vehicle sensors and actuators. Under the HALOS architecture, NVIDIA is stepping in to absorb those abstraction responsibilities directly within the platform, freeing OEM engineering teams to concentrate their resources on differentiated user experiences, intelligent vehicle behaviors, and top-level autonomy policies.
- Safety certification: Engineered and certified to ISO 26262 ASIL D, the highest automotive functional safety rating. - Included software runtimes: DRIVE OS foundation, CUDA, TensorRT acceleration, and specialized LLM SDKs for edge inference. - Supported host operating systems: Concurrent support for enterprise Linux and safety-certified QNX environments. - Architectural evolution: Native hardware and sensor abstraction layers in HALOS eliminate the need for OEMs to deploy hundreds of engineers to bridge the gap between silicon and autonomous software.
[17:49](https://www.youtube.com/watch?v=7N38fD4ksnI&t=1069s) HALOS Safety Guardrails and the DRIVE Hyperion Platform
The software architecture powering DRIVE Hyperion is designed to be highly generalizable across different automotive OEMs, drastically cutting the engineering overhead and integration burden required for any car manufacturer to get an autonomous driving stack up and running. Looking toward future deployments with the NVIDIA DRIVE Thor platform, NVIDIA plans to introduce comprehensive, safety-certified guardrails directly into the operating system layer. This architecture pairs cutting-edge end-to-end AI models with five-star Euro NCAP and NCAP active safety software, using a proven classical stack to serve as an indispensable safety backstop.
By building this safety foundation across the various layers of the HALOS operating system, autonomous vehicle developers can run their custom models on top of a rock-solid, standards-compliant baseline. The overarching goal is to let developers innovate rapidly without having to reinvent safety mechanisms from scratch, as the speaker outlines:
> “So in the future, hopefully for every AV developer, they can, you know, put their own end-to-end model on HALOS, you know, and benefit from the safety foundation we have built across different layers within HALOS.”
- **Standardization:** Generalizable cross-OEM software minimizes the engineering burden for deploying autonomy on DRIVE Hyperion. - **Safety integration:** Integrates NCAP and Euro NCAP 5-star active safety software directly alongside classical algorithmic fallbacks. - **Next-gen roadmap:** Full safety guardrail integration is scheduled for rollout with the upcoming DRIVE Thor generation.
---
[18:55](https://www.youtube.com/watch?v=7N38fD4ksnI&t=1135s) Announcing Albatross 1.5: Expanding Reasoning, Routing, and Multimodal Prompts
Building on the foundation model layer, NVIDIA announced the release of Albatross 1.5, arriving barely two months after the launch of Albatross 1.0. Albatross 1.0 was a pioneering 10-billion-parameter model tailored specifically for AV reasoning and emerged as a massive hit in the developer community. Over its first two months, it became the second most downloaded model in the entire robotics category on Hugging Face, amassing over 160,000 downloads—a metric that humorously surprised the team, with the speaker remarking, “I didn't even know there are so many people working on AV.”
Albatross 1.5 retains the 10-billion-parameter footprint of its predecessor but adds critical production-ready capabilities. Foremost among these is native routing support: the model can ingest navigation guidance, waypoint sequences, or vectorized map routes and execute trajectory planning accordingly. In addition, Albatross 1.5 gains natural language prompt understanding, allowing drivers or passengers to ask the vehicle what maneuver it is executing or why a specific decision is being made. It also brings flexible sensor configurations, supporting anywhere from one to four cameras with varying fields of view and placements. These advancements helped Albatross 1.5 secure the number-one spot on the public LingoQA benchmark.
```mermaid flowchart TD accTitle: Albatross Model Training Hierarchy accDescr: Pyramid showing how internet-scale Cosmos models feed fine-tuned autonomous driving models. subgraph Foundation ["Web-Scale Base Layer"] C1["Cosmos Foundation Model<br/>(20M hours web-scale data)"] end subgraph Intermediate ["Transfer & Reasoning Layers"] C2["Cosmos Predict Transfer"] C3["Cosmos Reason"] end subgraph AVLayer ["Fine-Tuning Layer"] A1["Albatross 1.5 Model<br/>(80,000 hours curated AV data)"] end
C1 --> C2 C2 --> C3 C3 --> A1 ```
Behind the scenes, Albatross was trained on 80,000 hours of curated autonomous driving data. While 80,000 hours might sound modest for a model of this caliber, it was not trained from scratch. Instead, its backbone derives directly from the Cosmos Reason model within the Cosmos open-source family. Cosmos was pre-trained on internet-scale data comprising 20 million hours of real-world video. From there, it was adapted via Cosmos Predict transfer learning before Cosmos Reason was fine-tuned into Albatross, providing the architecture with exceptional generalization capabilities.
- **Model size:** 10 billion parameters, optimized for spatial and temporal autonomous reasoning. - **Hugging Face traction:** Albatross 1.0 achieved 160,000+ downloads, ranking #2 across the robotics category. - **Routing inputs:** Ingests waypoints, vectorized maps, or high-level navigation instructions to plan paths. - **In-cabin interaction:** Natural language prompt comprehension allows real-time passenger Q&A regarding driving maneuvers. - **Camera flexibility:** Adaptable to 1, 2, or 4 camera sensor layouts across varying fields of view and mounting locations. - **Benchmark:** Ranks #1 on the public LingoQA autonomous driving benchmark.
---
[22:40](https://www.youtube.com/watch?v=7N38fD4ksnI&t=1360s) Production Pipeline: Open Data, Neural Reconstruction, and World Models
Deploying open-source models like Albatross into safety-critical, production vehicles requires an exhaustive fine-tuning and validation pipeline. The workflow relies on massive data ingestion—both physical and synthetic—along with fast data search, curation, model training, and continuous failure-mode discovery fed back from road testing into retraining. To help the wider ecosystem tackle this challenge, NVIDIA is open-sourcing 7,000 hours of high-quality autonomous driving fleet data gathered across 25 different countries during DriveAV development. Although not sufficient on its own to train a model end-to-end, its geographic diversity makes it the largest and most comprehensive open-source validation dataset available.
Tooling is equally critical for closed-loop validation, leading to the public release of NeuRecon (neural reconstruction). NeuRecon allows developers to take real-world sensor logs and photorealistically reconstruct camera pixels from altered vehicle poses and novel camera perspectives, which is vital for evaluating closed-loop behavior without going onto public roads. The speaker emphasized the maturity of NeuRecon by pointing to NVIDIA's internal reliance on it, noting:
> “We are running two million simulation tests based on NeuRecon on a daily basis to develop our stack. So there's a, I guess, famous phrase, we are eating our own dog food.”
Beyond simple scene replay, NVIDIA announced the open-sourcing of two generative AI models that plug directly into NeuRecon: Fixer and Harvester. Harvester extracts physical objects—pedestrians, vehicles, or road obstacles—spotted in real-world driving footage and catalogs them for reuse. Fixer then realistically inserts these harvested objects into entirely different video sequences and alters their trajectory, expanding training diversity by an order of magnitude. Combined with Cosmos Transfer, which can restyle any recorded sequence into novel weather conditions, low-light night scenes, different terrains, or foreign cities via text prompts, developers can systematically target corner-case scenarios in simulation.
```mermaid flowchart LR accTitle: DriveAV Data and Generative Simulation Pipeline accDescr: End-to-end cycle from real-world drive data through simulation modifications to in-car deployment. subgraph Ingestion ["Data Ingestion & Curation"] D1["Fleet Driving Data<br/>(7K hrs open sourced)"] D2["Harvester Model<br/>(Extracts field objects)"] end subgraph GenAI ["NeuRecon & Generative AI"] S1["NeuRecon Closed Loop<br/>(2M daily sims)"] S2["Fixer & Cosmos Transfer<br/>(Weather, lighting, actors)"] end subgraph Production ["Deploy & Feedback"] P1["Model Retraining"] P2["Vehicle Deployment &<br/>Failure Mode Feedback"] end
D1 --> S1 D2 --> S2 S2 --> S1 S1 --> P1 P1 --> P2 P2 -->|Edge cases| D1 ```
- **Open dataset:** 7,000 hours of multi-country driving footage covering 25 nations for testing and benchmarking. - **NeuRecon scale:** Powers 2,000,000 closed-loop autonomous simulation runs every single day within NVIDIA. - **Harvester & Fixer:** Generative models designed to rip real-world entities from footage and dynamically insert them into new simulated runs. - **Cosmos Transfer:** Text-guided environmental transfer that converts clear daylight runs into storms, snow, night, or foreign cityscapes.
---
[29:15](https://www.youtube.com/watch?v=7N38fD4ksnI&t=1755s) DriveAV Evolution: From Parker to Thor and the Mercedes-Benz Global Rollout
NVIDIA's role in autonomous vehicles spans a decade of hardware and software co-development. The journey began 10 years ago when the NVIDIA DRIVE Parker SoC powered the first commercial iterations of Autopilot, followed by the Xavier and Orin architectures, which catalyzed the mass rollout of intelligent driving assistance in China and worldwide. In modern EV markets, particularly China, advanced AV capabilities have become an absolute commercial necessity. Looking ahead, DRIVE Thor is carrying forward this legacy as the centralized supercomputing brain within the DRIVE Hyperion architecture, already moving into start of production (SOP) with leading global OEMs.
On the software side, NVIDIA’s DriveAV team has been building autonomy stacks in parallel for a decade, pioneering deep neural network path planning as early as 2017 with PilotNet. That foundational research turned into major commercial production partnerships: Mercedes-Benz in 2020, followed by Jaguar Land Rover (JLR) and Lucid Motors. In 2025, after five years of deep joint engineering, NVIDIA’s software stack deployed globally across all Mercedes-Benz vehicles outside of China, setting the stage for full point-to-point, address-to-address Level 2++ autonomous capabilities to roll out across the Mercedes fleet throughout 2026.
Technologically, DriveAV uses a hybrid architecture that pairs an end-to-end neural network policy with a classical, deterministic software stack. While end-to-end foundation models provide a smooth, human-like driving feel, traditional automotive validation mandates the functional safety (FuSa) and strict ISO 26262 compliance offered by classical stacks. Combining both allows NVIDIA to deliver human-like driving dynamics without compromising system interpretability or safety verification. In NVIDIA's production build, this entire hybrid stack—including the production version of Albatross—executes efficiently on a single DRIVE Orin system-on-chip:
> “And this kind of interpretable safety is very important to the industry. So having a hybrid stack, you can achieve both. Number one, you can still have human-like driving experience, and meanwhile, without compromising, basically, the safety interoperability.”
- **Compute milestones:** Evolution spanning Parker (10 years ago), Xavier, DRIVE Orin, to the mass adoption and SOP of DRIVE Thor. - **Production OEM programs:** Strategic Tier-1 software and hardware partnerships with Mercedes-Benz, Jaguar Land Rover, and Lucid Motors. - **Mercedes-Benz rollout:** Technology deployed worldwide across the 2025 Mercedes lineup (ex-China), with full address-to-address L2++ functionality rolling out across 2026. - **Hybrid stack architecture:** Couples end-to-end AI (Albatross) for smooth planning with an ISO 26262/FuSa-compliant classical stack for deterministic verification. - **Efficiency:** The complete production hybrid stack runs entirely on a single NVIDIA DRIVE Orin SoC.
[33:19](https://www.youtube.com/watch?v=7N38fD4ksnI&t=1999s) Hybrid Architecture and High-Velocity DriveAV Model Iteration
NVIDIA's internal DriveAV development couples an end-to-end, LiDAR-less, mapless deep learning stack on one side with a proven classical stack on the other. Sitting directly above both pipelines is a dedicated safety arbitrator designed to evaluate planned paths in real time and guarantee vehicle safety throughout execution. This dual-architecture design serves as the engine across NVIDIA’s consumer-facing feature set, providing automated parking, active safety mechanisms, hands-free Highway L2+, and address-to-address or park-to-park urban navigation under L2++.
To bring these end-to-end models into production, the DriveAV team has prioritized rapid engineering velocity backed by a massive dedicated GPU cluster. Having initiated development on this end-to-end model roughly one year prior, the team has already logged over 3,500 distinct model iterations—maintaining a pace of approximately ten new versions deployed every single day.
Simulation infrastructure plays an indispensable role in maintaining this pipeline cadence. NVIDIA’s closed-loop toolchain has compressed the entire cycle from field collection to ready-to-test model down to under six hours, with plans to trim that turnaround to just a few hours. The pipeline incorporates an extended version of the open-sourced AlpaSim simulator, specifically adapted to support closed-loop testing of hybrid stacks where classical algorithms and end-to-end neural network models run concurrently against identical scenarios.
- **Stack Composition:** Mapless and LiDAR-free end-to-end model running in parallel with a classical software stack, coordinated by a real-time safety arbitrator. - **Feature Coverage:** Automated parking, active safety, hands-free Highway L2+, and urban address-to-address L2++. - **Iteration Cadence:** 3,500 total iterations completed within the first year of development, averaging roughly 10 model releases per day. - **Turnaround Window:** Less than 6 hours from initial field data capture to closed-loop validation and replay testing, targeting a reduction to several hours.
---
[35:57](https://www.youtube.com/watch?v=7N38fD4ksnI&t=2157s) Safety Arbitrator Guardrails and Global Scaling of L2++
To illustrate how safety guardrails operate between the co-running stacks, the presentation showcases a real-world driving scenario involving a cyclist riding along the road shoulder. As the shoulder narrows and forces the cyclist inward toward vehicle traffic, the end-to-end model (designated as AlphaMario, highlighted in green) plans an initial path. Simultaneously, the safety arbitrator monitors the projected path against the classical planning modules and detects that the neural network's margin of error is insufficient for safe clearance.
The speaker explains the arbitrator's immediate intervention logic: “Essentially, it will say, okay, this current trajectory is not safe enough.” Without perceptible lag or hesitation, the system executes an instantaneous handoff to the classical planner's trajectory, steering clear of the cyclist while preserving vehicle stability and passenger safety.
With the hybrid software architecture validated in mixed driving environments, NVIDIA has launched a worldwide scaling campaign for its L2++ platform. Development vehicles are operating across multiple continents, with the goal of expanding coverage across the entirety of the United States and selected metropolitan hubs throughout Europe before the end of the year, followed by broader international availability the next year.
- **Arbitrator Transition:** Zero-delay trajectory switching from the end-to-end AlphaMario model to classical trajectories whenever safety boundaries are breached. - **Edge-Case Handling:** Dynamic handoffs during real-time road obstructions, such as disappearing shoulders that force cyclists into active traffic lanes. - **Rollout Milestones:** Complete United States coverage and initial European city deployments scheduled by the end of the year, expanding to full global availability the following year.
---
[37:19](https://www.youtube.com/watch?v=7N38fD4ksnI&t=2239s) Scalable L4 Architecture and the Autonomous Deployment Roadmap
A central design strength of NVIDIA's automotive software stack is its direct architectural bridge between driver-assist capabilities and full Level 4 autonomy. Instead of requiring a ground-up rewrite for driverless operations, the production L2++ foundation extends cleanly into an L4-certified dual-computing layout split between a Primary Electronic Control Unit (Main ECU) and a Secondary Safety Redundant ECU (Satellite ECU).
```mermaid flowchart TD accTitle: L4 Dual ECU Architecture and Fail-Safe Flow accDescr: Diagram illustrating the Main ECU running L2++ with supplementary sensors alongside a Satellite ECU executing classical safety backup and Minimum Risk Maneuvers.
subgraph MainECU["Main ECU (Primary Compute)"] A["L2++ DriveAV Stack (End-to-End & Classical)"] B["Supplementary Sensor Inputs"] B --> A end
subgraph SatECU["Satellite ECU (Safety Redundant Compute)"] C["Classical Redundant Stack"] D["Minimum Risk Maneuver (MRM)"] C --> D end
A <-->|"Arbitration & Status Heartbeat"| C A -->|"Single Point of Failure"| D ```
Under this configuration, the Main ECU runs the core L2++ stack while ingesting supplementary sensor streams routed from the Satellite ECU to elevate perception range and confidence. The Satellite ECU hosts an independent, classical-based safety redundant stack programmed to initiate an automated Minimum Risk Maneuver (MRM) if any single point of failure disables the primary compute block. This common code repository allows commercial partners to develop and deploy both L2++ and L4 vehicles concurrently without bifurcating engineering efforts.
NVIDIA's overarching deployment roadmap sets concrete milestones for bringing these autonomous systems to public roads: - **Current Year:** Global scaling of urban address-to-address L2++ capabilities. - **Next Year:** Initial operational rollouts of dedicated Level 4 commercial pilot fleets. - **2028:** Full commercial deployment of Level 4 autonomous systems in production passenger vehicles alongside OEM partners.
---
[39:07](https://www.youtube.com/watch?v=7N38fD4ksnI&t=2347s) Hyperion Ecosystem Expansion and the Uber Level 4 Partnership
Industry adoption of the NVIDIA DRIVE Hyperion reference platform continues to accelerate, with major global carmakers standardizing on its compute and sensor architecture. The speaker highlights that new original equipment manufacturers are entering the Hyperion fold almost every month, with four leading automakers recently signing on: BYD, Geely, Nissan, and Hyundai. Representing four of the world’s top ten automotive manufacturers, their adoption reflects the operational and economic advantages of relying on a shared, safety-certified compute and sensor baseline rather than custom proprietary hardware.
In parallel with OEM partnerships, NVIDIA announced an alliance with Uber aimed directly at commercializing Level 4 robotaxis. Under the terms of the agreement, the two companies plan to roll out autonomous L4 vehicle services across 28 global cities by 2028. Beyond in-cabin autonomy and embedded chips, NVIDIA emphasizes its role as a full-stack enterprise AI provider, utilizing NVIDIA Omniverse digital twins across automotive factory design, production planning, vehicle aerodynamics, and enterprise software.
Reflecting on the scale of the automotive industry's transition, the speaker stresses the necessity of collective development: “Autonomy is a daunting task. It's a grand mission, but it really needs everybody to work together.” NVIDIA aims to unify OEMs, Tier 1 suppliers, and independent AV software developers behind open platforms to close the performance gap between early prototypes and production-grade safety reliability.
- **New Hyperion Partners:** BYD, Geely, Nissan, and Hyundai join the ecosystem, uniting four of the world's top ten automakers around common compute and sensor architectures. - **Uber Global L4 Alliance:** Formal partnership established to deploy autonomous Level 4 technologies across 28 metropolitan markets globally by 2028. - **Enterprise Digital Twins:** Industrial use of NVIDIA Omniverse for end-to-end automotive design, virtual factory floor simulation, and assembly optimization. - **Industry Safety Target:** Collective effort required to advance autonomy from early single-digit statistical benchmarks toward upper-90s reliability.
---
[41:14](https://www.youtube.com/watch?v=7N38fD4ksnI&t=2474s) Key Takeaways: The Next Phase of NVIDIA DRIVE
Concluding the special address, the speaker reviews the central pillars defining NVIDIA DRIVE’s next stage of growth, structured across three specialized computing domains and five integrated layers of platform services:
First, on the physical vehicle hardware front, DRIVE Hyperion is expanding across top-tier OEMs to standardize sensor layouts and onboard compute, while the strategic data partnership with Uber creates an extensive, diverse training repository accessible to the broader developer ecosystem. Second, NVIDIA is significantly upgrading DriveOS (HALOS), moving it beyond a standard automotive operating system into an active real-time safety guardrail layer capable of supervising end-to-end AI stacks on Hyperion hardware.
Third, on the application layer, NVIDIA announced AlphaMario 1.5, the next generation of its end-to-end driving policy network. DriveAV engineering remains focused on scaling L2++ capabilities globally this year while extending the core code architecture into Level 4 redundancy. Finally, across cloud and simulation infrastructure, NVIDIA is open-sourcing its foundational automotive models, neural reconstruction tools, and Cosmos world foundation and transfer models, equipping developers across the mobility sector to enrich their simulation datasets and compress validation cycles.
## Notable quotes > [07:28](https://www.youtube.com/watch?v=7N38fD4ksnI&t=448s) building and safely deploying physical AI is going to be the defining challenge of the coming decade
> [00:09](https://www.youtube.com/watch?v=7N38fD4ksnI&t=9s) the path to full L4 level autonomy has never been this clear.
> [39:07](https://www.youtube.com/watch?v=7N38fD4ksnI&t=2347s) Autonomy is a daunting task. It's a grand mission, but it really needs everybody to work together.
> [03:16](https://www.youtube.com/watch?v=7N38fD4ksnI&t=196s) What sets Alpamayo apart is how it reasons through complexity, breaking down edge cases before they become problems.
## Mentioned AlexNet, AlpaSim, Alpamayo, AlphaMario, AlphaMario 1.5, BYD, Cosmos, Cosmos Predict, Cosmos Reason, Cosmos Transfer, CUDA, DRIVE AGX Thor, DRIVE AV, DRIVE Hyperion, DRIVE Hyperion 10, DRIVE Orin, DRIVE OS, DRIVE Parker, DRIVE Thor, DRIVE Xavier, Fixer, Geely, HALOS, Harvester, Hugging Face, Hyundai, Jaguar Land Rover, Jensen Huang, LingoQA, Lucid Motors, Mercedes-Benz, NeuRecon, Nissan, NVIDIA, NVIDIA Omniverse, PilotNet, QNX, TensorRT, Uber, William Pereira
## Video description Autonomous vehicles (AVs) are emerging as the first mass-deployed physical AI agents, reshaping mobility and driving new demands in AI, safety, and scalable development. This special address explores the industry’s path to Level 4 autonomy and how NVIDIA is helping accelerate it. With the DRIVE Hyperion architecture, manufacturers (OEMs) and AV developers can build scalable, safety-certified autonomy solutions. NVIDIA will present its cloud-to-car platform—spanning training, simulation, and in-vehicle compute—to support developing and validating next-generation drive-policy models. The session will also touch on how agentic AI is poised to transform AVs end to end, from automating data-driven development and validation to enabling more intelligent, adaptive in-car experiences. Gain insights into L4 software architectures, the DRIVE Hyperion platform, and ecosystem collaboration across OEMs, AV developers, mobility providers, and robotaxi companies.
[Source](https://www.youtube.com/watch?v=7N38fD4ksnI)