NVIDIA
Surging GPU energy demands require operators to replace bespoke data center construction with pre-simulated, factory-standardized infrastructure to support 600-kilowatt racks.
AI-assisted summary of NVIDIA GTC Studio with Insights from Vertiv — original source. Check the original for full context.
Source published:
Key ideas
- Vertiv is shifting data center deployment from bespoke, on-site construction to a factory-like model using pre-engineered, standardized building blocks. (5:54)
- The integration of NVIDIA Omniverse allows Vertiv to create digital twins of power and cooling chains, enabling physics-based simulations before physical construction begins. (3:34)
- The industry is moving away from general-purpose design toward purpose-built 'AI factories' that are hyper-optimized for specific GPU cluster architectures. (8:59)
- Vertiv is proactively solving for future physics-based constraints, including the management of racks reaching 600 kilowatts and scaling site capacities to the gigawatt level. (10:22)
Detailed notes
## Background This NVIDIA GTC Studio episode was published by the official NVIDIA YouTube channel on March 30, 2026. The program features Scott Armul, Chief Product and Technology Officer at Vertiv, who discusses the critical role Vertiv plays in delivering power and cooling infrastructure to support the massive scale of modern AI factories.
## TL;DR The discussion focuses on the transition from traditional, bespoke data center construction to a standardized, converged infrastructure model required for high-density AI workloads. Armul explains how Vertiv leverages NVIDIA Omniverse to create digital twins of power and cooling systems, allowing for physics-based simulations that accelerate deployment and ensure performance before physical construction begins. By positioning themselves as the foundational layer of the 'five-layer cake' of AI architecture, Vertiv aims to solve the heat and power challenges of future gigawatt-scale data centers.
## Atmosphere & style The tone is professional, forward-looking, and intellectually engaging, reflecting the high-stakes environment of an industry trade conference. Host Tiffany Jansen creates a warm and accessible rapport with Armul, successfully balancing technical depth with relatable analogies that make complex engineering concepts feel tangible. There is a palpable sense of urgency and excitement throughout the conversation, as both speakers emphasize the rapid, 'compounding acceleration' of AI technology and the critical importance of keeping pace with it.
## Bulletin - [05:54](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=354s) Vertiv is shifting data center deployment from bespoke, on-site construction to a factory-like model using pre-engineered, standardized building blocks. - [03:34](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=214s) The integration of NVIDIA Omniverse allows Vertiv to create digital twins of power and cooling chains, enabling physics-based simulations before physical construction begins. - [08:59](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=539s) The industry is moving away from general-purpose design toward purpose-built 'AI factories' that are hyper-optimized for specific GPU cluster architectures. - [10:22](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=622s) Vertiv is proactively solving for future physics-based constraints, including the management of racks reaching 600 kilowatts and scaling site capacities to the gigawatt level.
## Key takeaways - [00:10](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=10s) Vertiv’s rise in public visibility is directly linked to the rapid expansion of generative AI and their close technical partnership with NVIDIA. - [01:30](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=90s) Modern AI models require massive clusters of GPUs, necessitating dedicated physical infrastructure to handle the resulting power consumption and heat output. - [02:00](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=120s) Vertiv’s cooling strategy spans a full heat dissipation path: from extracting heat at the silicon level to removal from the data hall and final atmospheric rejection or reuse. - [03:34](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=214s) Simulating infrastructure in NVIDIA Omniverse allows Vertiv to verify performance and compatibility digitally, significantly accelerating the 'time to token' for new AI clusters. - [06:12](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=372s) The shift toward converged physical infrastructure eliminates the inefficiencies of integrating piecemeal products from disparate vendors on-site. - [07:15](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=435s) In the 'five-layer cake' analogy of AI architecture, Vertiv occupies the foundational infrastructure layer. - [07:30](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=450s) Standardized building blocks are critical for scaling data centers to gigawatt capacities without the logistical chaos of traditional construction. - [08:59](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=539s) Data center design is no longer 'agnostic'; infrastructure must now be engineered specifically to match the requirements of the computing hardware it supports. - [09:45](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=585s) The industry is evolving to treat the entire data center site as a single, optimized 'computer' rather than a collection of independent server rooms. - [10:22](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=622s) Vertiv maintains a 'maniacal' focus on looking multiple GPU generations ahead to ensure infrastructure capabilities keep pace with hardware performance roadmaps.
## Detailed walkthrough ### [00:10](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=10s) From Behind-the-Scenes to the Spotlight: Vertiv's Growing Recognition
Tiffany Jansen welcomes Scott Armul, the Chief Product and Technology Officer at Vertiv, to the NVIDIA GTC Studio. Jansen opens the conversation with a lighthearted admission: she has been eagerly anticipating this sit-down because Vertiv is tackling a massive, long-standing challenge in AI infrastructure that the general public is only now starting to fully appreciate. Armul agrees with this assessment, noting that Vertiv has historically transitioned from being a critical but relatively obscure player in the data center industry to a company that is now firmly in the spotlight.
Armul attributes this newfound public awareness and industry recognition to Vertiv's strong financial performance and rapid growth, but most importantly, to their deep partnership with NVIDIA. By jointly developing cutting-edge power and cooling solutions, Vertiv has captured the attention of people who previously paid little mind to the physical infrastructure space. Armul jokes that even his own neighbors finally understand what he does for a living, illustrating how the rise of generative AI has pushed data center infrastructure into the mainstream consciousness.
[01:30](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=90s) Explaining the Core Challenge: Power and Cooling for AI
To explain Vertiv's mission in simple terms, Jansen shares an anecdote about how she described the company to her mother earlier that morning. She explained that the advanced AI models and chatbots people interact with daily require thousands of GPUs to run, and to keep those GPUs functioning, they need two fundamental things: power and cooling. Armul enthusiastically validates this high-level explanation, confirming that every single query, inference, or digital interaction relies on physical GPUs sitting inside a data center.
Armul explains that these high-performance chips consume immense amounts of power and, as a consequence, generate extraordinary amounts of heat. Vertiv's job is to design and deploy critical infrastructure—ranging from traditional air cooling to advanced liquid cooling systems—to safely extract that heat from the chip, pull it out of the server racks, remove it from the data hall, and ultimately reject it into the atmosphere or find innovative ways to reuse it.
As Scott Armul explains: > "To query that chatbot, to run that AI inference, to do all of those things that a normal person would interact with AI or candidly any data center, those servers, those chips, those GPUs have to sit somewhere."
- **Core Infrastructure Elements:** Vertiv designs and delivers the physical systems that power and cool data centers, including liquid cooling, air cooling, and heat rejection systems. - **Heat Dissipation Path:** Heat is extracted directly from the silicon chips, pulled out of the server racks, removed from the data hall, and rejected into the atmosphere or redirected for heat reuse to minimize environmental impact.
[03:34](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=214s) GTC Announcements: Digital Twins and the Omniverse
Turning to the major news of the week at GTC, Armul highlights Vertiv's groundbreaking work within NVIDIA Omniverse, specifically mentioning their converged systems engineering approach. Vertiv is partnering with NVIDIA to pre-define and simulate entire data center environments digitally before any physical construction begins. By utilizing physics-based simulations and emulations within the Omniverse platform, Vertiv can model how their power and thermal chains—including liquid cooling and heat rejection systems—will interact with NVIDIA's chip clusters and servers under real-world workloads.
This digital twin approach represents a massive shift away from traditional, bespoke on-site construction. Instead of solving compatibility and performance issues after equipment has been delivered and commissioned, Vertiv can verify the entire system's behavior virtually. This drastically accelerates deployment timelines, helping customers achieve a faster "time to token."
As Scott Armul notes: > "Within NVIDIA's Omniverse, we're trying to drive towards more physics-based and simulated types of designs to speed up a lot of the converged infrastructure approach so that long before a shovel ever hits the ground or a construction company is trying to put up a data center, we understand the performance of our gear."
```mermaid flowchart TD accTitle: Vertiv Digital Twin to Physical Deployment Workflow accDescr: A flowchart showing how Vertiv uses NVIDIA Omniverse to simulate, pre-fabricate, and deploy converged data center infrastructure.
subgraph Digital_Phase ["Digital Simulation (NVIDIA Omniverse)"] A["Physics-Based Simulation"] -->|"Model thermal & power chains"| B["Pre-defined Interfaces & Block Sizes"] B -->|"Verify chip & cluster performance"| C["Digital Twin Validation"] end
subgraph Physical_Phase ["Physical Deployment"] C -->|"Pre-fabricated assembly"| D["Factory-Like Construction"] D -->|"Standardized connection points"| E["Rapid On-Site Commissioning"] E -->|"Faster 'Time to Token'"| F["Operational AI Factory"] end ```
- **Omniverse Integration:** Vertiv uses NVIDIA Omniverse to create digital twins of data centers, allowing for physics-based simulation of thermal and power performance. - **Time to Token:** By simulating the interaction of chips, clusters, and infrastructure digitally, Vertiv accelerates physical deployment and reduces the time required to get AI clusters operational.
[06:12](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=372s) The Foundation of the AI Factory: Converged Physical Infrastructure
Jansen asks Armul to demystify the concept of "converged physical infrastructure," a term that can easily sound like corporate buzzwords to those outside the industry. Armul explains that converged infrastructure is about moving away from piecemeal, "point products" designed by isolated companies that must be awkwardly integrated on-site by consulting engineers and construction crews. Instead, Vertiv designs pre-engineered, standardized building blocks with predefined interfaces and connection points, fully simulated in a CAD and Omniverse environment.
When discussing Vertiv's position in the broader AI ecosystem, Armul enthusiastically embraces the popular "five-layer cake" analogy of AI architecture, proudly claiming the bottom layer. Jansen calls this the most important, foundational layer, and Armul agrees, explaining that a robust, purpose-built foundation allows operators to scale data centers to gigawatt levels without the chaos of multiple trades clashing on-site. By treating data center deployment more like a standardized factory assembly line, Vertiv helps companies unlock superior performance, achieve faster time-to-market, and lower their overall total cost of ownership (TCO).
As Scott Armul puts it: > "In the five layer cake analogy that has become so fun to dissect this week, we're the infrastructure layer."
- **Five-Layer Cake Analogy:** Vertiv represents the foundational physical infrastructure layer upon which the rest of the AI stack (hardware, software, models, applications) is built. - **Scale Challenges:** Standardized, converged building blocks are essential for scaling data centers to gigawatt levels without the complexity of traditional, bespoke construction.
### [08:59](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=539s) Shifting Paradigms in AI Infrastructure Scott Armul explains that the era of "agnostic" data center design has ended. Previously, data centers were built around general-purpose CPU-based servers with relatively predictable energy and cooling requirements, where the specific workload was rarely a primary concern for infrastructure engineers. AI has fundamentally altered this by moving toward a "unit of compute" model where the hardware is hyper-optimized for specific performance parameters.
By understanding the architecture of an NVIDIA "super pod," Vertiv can work backward from these purpose-built clusters to determine exactly what the power and cooling infrastructure must look like to achieve maximum efficiency. Armul notes, “We can scale that same analogy and that same approach out to the entire site so that that site is optimized to work as a single computer.”
### [10:22](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=622s) Future-Proofing for the Gigawatt Era Looking ahead, Armul describes the industry’s state as one of "compounding acceleration." Because the roadmap for GPU performance is unlocking new capabilities at such a rapid pace, Vertiv is forced to look multiple generations ahead to solve looming physics-based constraints. The primary challenge involves managing massive energy density, such as powering racks that reach 600 kilowatts or higher, and scaling entire "AI factories" to reach gigawatt-scale capacity.
To meet these demands, the company works "somewhat maniacally" to ensure their technology investments and development roadmaps stay ahead of the hardware. The goal is to ensure the physical infrastructure is ready and tested well before the next generation of GPU clusters arrives for deployment. As Armul puts it, “We're in a race to try to not only keep up with that pace, but we're trying to look multiple GPU generations ahead to say, what are the physics-based problems we're going to need to solve?”
- **Primary Challenges:** - Managing high-density racks (600 kilowatts+). - Scaling total site capacity to the gigawatt level. - Synchronizing infrastructure readiness with GPU release cadences.
## Notable quotes > [01:30](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=90s) To query that chatbot, to run that AI inference, to do all of those things that a normal person would interact with AI or candidly any data center, those servers, those chips, those GPUs have to sit somewhere. — Scott Armul
> [10:22](https://www.youtube.com/watch?v=MyNEr7tf-WQ&t=622s) We're trying to look multiple GPU generations ahead to say, what are the physics-based problems we're going to need to solve? — Scott Armul
## Mentioned Scott Armul, Tiffany Jansen, Vertiv, NVIDIA, NVIDIA GTC, NVIDIA Omniverse
## Video description Scott Armul, Chief Product and Technology Officer at Vertiv, explains how Vertiv meets AI infrastructure demands at scale—delivering the power and cooling systems behind modern data centers and developing the solutions to streamline the design and deployment of next-generation AI factories.
[Source](https://www.youtube.com/watch?v=MyNEr7tf-WQ)