NVIDIA
Data centers must integrate AI-driven energy intelligence with physical infrastructure to eliminate the 40% efficiency gap currently threatening compute scalability.
AI-assisted summary of NVIDIA GTC Studio with Insights from Schneider Electric — original source. Check the original for full context.
Source published:
Key ideas
- Energy infrastructure serves as the fundamental layer of the AI architecture stack, and its capacity, sustainability, and efficiency currently serve as the primary constraints on global AI factory scaling. (0:10)
- Predictive AI algorithms applied to data center HVAC and cooling systems can reduce cooling energy consumption by approximately 10%. (2:23)
- In standard AI data centers, up to 36-40% of input energy is lost or stranded during handovers between power distribution, compute, and cooling subsystems. (11:11)
- Schneider Electric is integrating digital twin technology and NVIDIA SimReady assets to simulate thermal and electrical performance before construction, ensuring maximum efficiency from the design phase. (14:21)
Detailed notes
## Background This NVIDIA GTC studio session, published by the official NVIDIA YouTube channel on March 30, 2026, features a discussion with Pankaj Sharma of Schneider Electric. The page description explains that the session explores the challenges of scaling AI infrastructure, specifically focusing on energy as the foundational 'five-layer cake' and the potential for AI to optimize the energy systems it relies upon.
## TL;DR Pankaj Sharma argues that while energy is the primary bottleneck for scaling AI factories, the solution lies in a dual approach of physical infrastructure modernization and AI-driven software optimization. By applying 'energy intelligence'—using historical performance data to fine-tune cooling and power distribution—operators can recover significant amounts of stranded energy capacity. The session emphasizes that overcoming the industry's power constraints requires a 'system play' that integrates accelerated compute with advanced liquid cooling and digital orchestration, rather than relying solely on component-level upgrades.
## Atmosphere & style The session carries the professional, high-energy, and forward-looking atmosphere characteristic of a technical industry conference. The dialogue between Janzen and Sharma is collegial and collaborative, pivoting from a sense of initial alarm over power limitations to a grounded, problem-solving confidence. It feels like a high-level briefing designed to cut through industry hype, replacing anxiety about energy ceilings with a methodical, engineering-first perspective on how to build the next generation of AI infrastructure.
## Bulletin - [00:10](https://www.youtube.com/watch?v=lBNHFR41GgY&t=10s) Energy infrastructure serves as the fundamental layer of the AI architecture stack, and its capacity, sustainability, and efficiency currently serve as the primary constraints on global AI factory scaling. - [02:23](https://www.youtube.com/watch?v=lBNHFR41GgY&t=143s) Predictive AI algorithms applied to data center HVAC and cooling systems can reduce cooling energy consumption by approximately 10%. - [11:11](https://www.youtube.com/watch?v=lBNHFR41GgY&t=671s) In standard AI data centers, up to 36-40% of input energy is lost or stranded during handovers between power distribution, compute, and cooling subsystems. - [14:21](https://www.youtube.com/watch?v=lBNHFR41GgY&t=861s) Schneider Electric is integrating digital twin technology and NVIDIA SimReady assets to simulate thermal and electrical performance before construction, ensuring maximum efficiency from the design phase.
## Key takeaways - [05:02](https://www.youtube.com/watch?v=lBNHFR41GgY&t=302s) The rapid advancement of AI models and accelerated compute has compressed industry adoption timelines, making power availability an urgent bottleneck rather than a long-term planning exercise. - [00:10](https://www.youtube.com/watch?v=lBNHFR41GgY&t=10s) Energy is the foundational layer of the 'five-layer AI cake,' meaning physical infrastructure must evolve alongside advancements in compute and software. - [02:23](https://www.youtube.com/watch?v=lBNHFR41GgY&t=143s) AI functions as a dual-use technology: it is a primary driver of power demand, but it also provides the necessary tools for grid optimization and energy management. - [04:15](https://www.youtube.com/watch?v=lBNHFR41GgY&t=255s) Digital grid software can reduce technical line losses across power networks, effectively creating 'hidden' capacity without needing to build new power generation assets. - [06:12](https://www.youtube.com/watch?v=lBNHFR41GgY&t=372s) Scaling AI infrastructure requires a 'system play,' where power, cooling, and compute orchestration function as a single, cohesive unit rather than independent silos. - [07:28](https://www.youtube.com/watch?v=lBNHFR41GgY&t=448s) Brownfield data centers often hit 'thermal and electrical walls' because their legacy infrastructure was not originally designed for the high rack densities required by modern AI clusters. - [08:55](https://www.youtube.com/watch?v=lBNHFR41GgY&t=535s) Energy intelligence refers to using historical operational data combined with AI to drive real-time, autonomous optimizations in data center performance. - [09:18](https://www.youtube.com/watch?v=lBNHFR41GgY&t=558s) Operators of legacy, non-digital facilities must decide between retrofitting with external telemetry adapters or performing expensive 'rip-and-replace' hardware upgrades to enable AI-native monitoring. - [11:11](https://www.youtube.com/watch?v=lBNHFR41GgY&t=671s) Stranded capacity in AI factories is largely caused by poor synchronization during handovers between high-speed compute surges and the corresponding thermal/electrical responses. - [12:04](https://www.youtube.com/watch?v=lBNHFR41GgY&t=724s) The acquisition of Motivair enables Schneider Electric to manage the critical direct-to-chip cooling loops necessary for stabilizing high-density AI hardware. - [12:30](https://www.youtube.com/watch?v=lBNHFR41GgY&t=750s) True efficiency in cooling requires dynamic orchestration of fluid flow rates and temperatures, not merely installing high-capacity hardware. - [14:21](https://www.youtube.com/watch?v=lBNHFR41GgY&t=861s) SimReady digital twins allow engineers to test power failover and fluid dynamics in software, significantly lowering the risk of design flaws in new AI factories. - [15:22](https://www.youtube.com/watch?v=lBNHFR41GgY&t=922s) Energy intelligence is the essential linchpin for scaling AI, as physical grid expansion alone cannot keep pace with the exponential demand for compute power.
## Detailed walkthrough ### [00:10](https://www.youtube.com/watch?v=lBNHFR41GgY&t=10s) The Five-Layered AI Cake: Energy as the Critical Foundation
Host Tiffany Janzen opens the session at the NVIDIA GTC studio by welcoming Pankaj Sharma, Executive Vice President of Software and Services at Schneider Electric. Settling into the conversation after two packed and information-heavy days at the conference, Janzen notes that the work Schneider Electric is tackling directly addresses the single biggest bottleneck facing modern AI infrastructure: scaling power. With AI factories popping up rapidly around the world, their viability hinges entirely on securing massive amounts of electricity.
Sharma grounds the power dilemma in NVIDIA CEO Jensen Huang’s keynote concept of the “five-layered cake” of AI architecture. While Schneider Electric operates across multiple tiers of that stack, its core role sits squarely at the base: the foundational energy infrastructure. As generative AI embeds itself deeper into consumer and commercial workflows, efficiency gains across society drive an exponential demand for physical AI factories. That expansion immediately clashes with planetary limits around available generation and grid infrastructure. Sharma underscores that power availability cannot be treated as an isolated engineering problem; it must simultaneously meet stringent sustainability targets. As Sharma explains:
> “Now, when we think about the overall planet and the amount of energy available, and we keep in mind that at the end of the day, it has to be sustainable too, right?”
Addressing this baseline layer requires modernizing utility grid infrastructure, deploying clean generation, and building highly efficient physical data center hardware capable of handling massive thermal and electrical loads.
- **Foundational Layer:** Schneider Electric's primary footprint is at the bedrock of the AI infrastructure stack, delivering the power and thermal backbone required by AI factories. - **The Core Constraint:** Surging AI adoption demands more compute, which requires new physical facilities that are currently constrained by grid bottlenecks and the scarcity of clean, green power generation.
```mermaid flowchart TD accTitle: The AI Factory Infrastructure Dependencies accDescr: Diagram showing how AI applications rely on compute factories, which depend on sustainable energy and physical infrastructure at the foundation.
subgraph AI_Stack ["AI Architecture Stack"] Apps["AI Applications & Consumer/Enterprise Workloads"] Factories["AI Factories & Compute Clusters"] Foundation["Energy & Physical Infrastructure (Schneider Electric)"] end
subgraph Energy_Reqs ["Critical Foundation Inputs"] CleanGen["Clean & Sustainable Generation"] GridCap["Grid Transmission & Distribution Capacity"] PhysicalEff["Efficient Power Delivery & Cooling Systems"] end
Apps --> Factories Factories --> Foundation Foundation --- CleanGen Foundation --- GridCap Foundation --- PhysicalEff ```
---
[02:23](https://www.youtube.com/watch?v=lBNHFR41GgY&t=143s) AI for Energy and Energy for AI: Cooling and Grid Optimization
While the immense power requirements of AI dominate public discourse, Sharma reframes the dynamic as a dual opportunity: energy is needed to power AI, but AI itself is the essential tool required to unlock, optimize, and expand energy capacity. Janzen remarks on the circular irony of the problem—the technology consuming massive power is also the primary mechanism to fix the grid. Asked for concrete examples of how AI is already solving these structural hurdles, Sharma points to data center thermal management. The intense heat generated by high-density compute clusters requires complex HVAC and liquid cooling operations. By training AI algorithms on historical operational data from data center cooling systems, operators can automate dynamic on/off cycles and performance profiles, slashing cooling energy consumption by nearly 10 percent.
Beyond internal data center operations, AI algorithms are actively applied to compute workload scheduling and utility grid management. In large model training facilities, AI systems can predict and balance when peak compute is genuinely necessary versus when loads can be throttled or shifted, directly dampening peak power draw. Outside the data center walls, Schneider Electric’s digital grid business deploys software across transmission and distribution networks to optimize flow, reducing technical line losses by several percentage points. These reclaimed percentages represent raw, usable megawatts injected back into the available power pool. Reacting to these numbers, Janzen admits that her own research into the energy bottleneck had left her feeling stuck on how the industry could realistically scale without hitting a hard ceiling. Sharma emphasizes that panic over power demand misses the broader picture:
> “So AI for energy actually is a very important tool.”
He further elaborates on why software optimization must accompany raw capacity additions:
> “Of course, we need to generate, but we can't solve for what is available and how much is getting utilized.”
- **HVAC and Cooling Savings:** Applying predictive AI algorithms to historic data center cooling and HVAC operations reduces overall cooling energy consumption by almost 10%. - **Workload Optimization:** Monitoring compute necessity in large-scale AI training factories optimizes duty cycles and curbs unnecessary energy draw. - **Digital Grid Optimization:** Schneider Electric's software models bring down utility grid technical losses by several percentage points, expanding effective grid headroom without constructing new power plants.
---
[05:02](https://www.youtube.com/watch?v=lBNHFR41GgY&t=302s) Beyond Silos: Long-Term Efficiency and the System Play
Janzen wonders whether Schneider Electric’s focus on energy optimization is a reactive pivot to the recent generative AI boom or a continuation of longstanding work. Sharma reflects that data center energy constraints have been a continuous industry challenge for decades. What has fundamentally changed is the velocity of demand: advanced large language models paired with NVIDIA’s accelerated compute architectures have compressed adoption timelines from years into months. Schneider Electric approaches the problem from two fronts: re-engineering physical equipment to maximize native electrical efficiency, and wrapping that hardware in digital management software to shrink the gap between input energy entering a facility and the actual power utilized by compute chips.
Sharma stresses that scaling up to meet modern AI workloads cannot happen solely by speeding up silicon. The entire ecosystem must accelerate in parallel—including power generation, substation hardware, physical rack infrastructure, and orchestration software. Janzen observes that these layers cannot operate in traditional engineering silos, prompting Sharma to highlight that the physical facility and the digital management platform must function as an integrated machine to extract maximum performance:
> “So the system play is absolutely critical.”
According to Sharma, isolated component optimizations inevitably fail unless the entire data center operates as a cohesive, closed-loop system:
> “It's not just accelerated compute. It's accelerated generation of energy, the accelerated infrastructure, which is needed. It's accelerated digital, which is all softwares, which are going to make it easier.”
- **The Real Driver of Urgency:** Energy scarcity is not new, but the rapid capability jumps in LLMs and NVIDIA compute have dramatically steepened the adoption curve. - **Shrinking the Efficiency Delta:** Schneider’s engineering goal focuses on minimizing the losses between gross input power arriving at the data center boundary and useful power delivered to the compute silicon. - **Accelerated Everything:** Meeting AI demand requires concurrent acceleration across clean generation, physical facility infrastructure, and real-time digital software.
---
[07:28](https://www.youtube.com/watch?v=lBNHFR41GgY&t=448s) Brownfield Challenges and Upgrading Legacy Facilities
Janzen turns the conversation to brownfield environments—facilities built on older designs or saddled with legacy, archaic software systems—and asks how Schneider Electric adapts its physical and digital solutions when stepping into existing installations. Sharma clarifies that true greenfield “AI factories” purpose-built for generative AI are only just beginning to emerge across the market. Instead, the vast majority of existing global capacity consists of traditional data centers constructed over the past several decades.
Because global demand for computing is at an all-time high, these legacy facilities currently operate at exceptionally high utilization rates. However, many older facilities have hit a hard thermal and electrical wall. They were engineered around lower rack densities and predictable enterprise CPU workloads, leaving their cooling and electrical distribution paths fundamentally incapable of supporting modern, high-density AI clusters. Sharma observes the friction occurring within legacy footprints:
> “But some of the builds which happened in the past have reached a limit of performance, simply because they were never built for this level of compute.”
This reality forces operators to overhaul both their physical power and cooling delivery systems while simultaneously retrofitting digital monitoring tools to prevent legacy builds from stalling out under modern AI compute pressures.
[08:55](https://www.youtube.com/watch?v=lBNHFR41GgY&t=535s) Defining Energy Intelligence and Modernizing Brownfield Infrastructure
Pankaj Sharma introduces the concept of “energy intelligence” as a critical software intervention for existing facilities. In brownfield environments, operators often seek to optimize legacy infrastructure using modern software capabilities. Sharma explains that energy intelligence means taking decades of historical performance data from data centers and other critical industrial applications, feeding that operational history into software engines, and applying artificial intelligence to surface actionable optimizations. These insights can be implemented either as AI-augmented workflows or increasingly as fully AI-native automated decisions designed to drive the performance and efficiency of the underlying physical layer.
Upgrading brownfield facilities presents steep physical hurdles when decades-old equipment lacks native digital interfaces. Sharma points out that when the physical layer is completely analog, operators face a crossroads: they must either deploy digital appliances and edge adapters to extract telemetry from legacy machines, or undertake the cost and disruption of ripping and replacing the hardware entirely. Schneider Electric conducts comprehensive asset analyses to determine whether an installation can be retrofitted with sensing appliances or requires a hardware swap. Furthermore, Sharma stresses that location and external constraints dictate the entire strategy. If a data center sits in a region where the electrical grid is already maxed out, expanding the physical footprint is futile unless efficiency can be extracted from within the existing power envelope.
> “Energy intelligence is where, when you have performance data of data centers, as one example, and any other application for that matter, for the longest period of time, for decades, you utilize that data and then put AI on top of the data with the help of software, come up with insights, which you can either be AI augmented or AI native, more so AI native now, when it was heard that as a conversation, so that those insights can help improve the performance of the physical layer.” — Pankaj Sharma
- **Digitizing Analog Assets:** Facilities with non-digital infrastructure must either install bolt-on telemetry appliances to capture performance data or execute full equipment replacements. - **Geographic Grid Bottlenecks:** Physical expansions are rendered pointless if the regional utility grid cannot deliver additional megawatts, making internal energy intelligence the only viable path to capacity growth.
---
[11:11](https://www.youtube.com/watch?v=lBNHFR41GgY&t=671s) Systems Integration and Managing Handovers in AI Factories
Addressing the complex architecture of AI factories, Sharma explains why individual component efficiency is insufficient on its own. While AI factories are among the most heavily utilized computing environments in the world—running sustained, homogeneous model-training workloads—they still suffer from significant stranded capacity. Sharma cites an operational example where, out of 100 arbitrary units of energy entering a facility, only roughly 64 units actually reach the compute layer, leaving the remaining 36 to 40 units lost or stranded throughout the distribution chain. Recovering this stranded power requires managing the power distribution, cooling, and compute subsystems as a single, coordinated entity.
The primary point of energy leakage occurs during the operational handovers between interdependent subsystems. When compute demand surges, power infrastructure must ramp up instantaneously, which in turn triggers a proportional demand on the cooling infrastructure. If the control handovers between power delivery, server utilization, and heat removal are not synchronized in real time, massive thermal and electrical inefficiencies result. Sharma references Schneider Electric’s integration of Motivair—a leader in liquid cooling that joined the company roughly two years prior—to illustrate that having world-class hardware like Coolant Distribution Units (CDUs) and heat exchangers is only half the battle. Real efficiency depends on dynamic system orchestration: regulating the flow rates of cooling fluids, adjusting to load swings, and maintaining precise operating temperatures across the thermal envelope.
```mermaid flowchart TD accTitle: AI Factory System Handover Flow accDescr: Diagram illustrating how incoming power flows through physical systems and requires coordinated handover to prevent stranded capacity.
subgraph PowerIn["Power Inflow"] Grid["100 Units Total Inflow"] end
subgraph PhysicalLayers["Physical Subsystems"] Pwr["Power Infrastructure"] Comp["Compute Infrastructure"] Cool["Cooling Infrastructure & Liquid Loops"] end
subgraph Outcomes["System Utilization"] Used["~64 Units Active Compute"] Stranded["~36-40 Units Stranded / Lost"] end
Grid --> Pwr Pwr -->|"Dynamic Handover"| Comp Comp -->|"Thermal Load Handover"| Cool Comp --> Used Pwr -.->|"Uncoordinated Handover"| Stranded Cool -.->|"Sub-optimal Flow / Temp"| Stranded ```
> “If that handover is not seamless, then you're losing a lot of energy.” — Pankaj Sharma
> “Even if each one of those individual components are the most efficient components, software defined components... the system play is absolutely critical.” — Pankaj Sharma
- **Stranded Energy Reality:** In typical operations, up to 36% to 40% of supplied energy fails to reach compute workloads due to subsystem mismatches. - **Motivair Integration:** Schneider Electric brought liquid cooling manufacturer Motivair into its portfolio roughly two years prior to anchor direct-to-chip cooling and CDU distribution. - **Holistic Fluid Dynamics:** Efficient liquid cooling requires precise orchestration of fluid velocities and operating temperatures rather than just high-capacity heat exchangers.
---
[14:21](https://www.youtube.com/watch?v=lBNHFR41GgY&t=861s) Digital Twins, SimReady Infrastructure, and AI for Energy
When asked how the industry can break through the energy ceiling constraining AI scaling, Sharma highlights the marriage of physical efficiency and pre-construction simulation. Physical components such as power distribution units and advanced liquid cooling loops must continue to gain hardware-level efficiency, but the ultimate unlocks stem from energy intelligence deployed during the architectural phase. Leveraging the concept of NVIDIA SimReady assets, Schneider Electric designs every physical component to exist as a simulation-ready digital twin.
By modeling the entire electrical and thermal facility before ground is broken, engineers run predictive AI algorithms trained on decades of real-world operational performance data. These algorithms identify design flaws, simulate fluid dynamics, and test power failover handovers in software long before physical installation. Sharma frames this convergence as “AI for energy,” emphasizing that expanding AI capacity cannot rely solely on waiting for grid expansions or building more power plants. To meet escalating compute demands, the industry must rely on energy intelligence to squeeze maximum computing throughput from every megawatt available. The conversation closes with Sharma reinforcing that while modernizing physical grids remains a necessity, software-driven energy intelligence is the immediate linchpin for next-generation AI infrastructure.
> “More and more energy needed for AI cannot happen without energy intelligence, because of the learning what we have collectively for so many decades on how the performance of energy is and utilization is, you have to apply AI on that, and that's energy intelligence.” — Pankaj Sharma
- **SimReady Digital Twins:** Designing data centers with NVIDIA SimReady-compatible assets allows operators to simulate and optimize thermal and electrical performance before breaking ground. - **AI for Energy:** Algorithmic optimization applied to decades of facility telemetry unlocks capacity that physical hardware upgrades alone cannot achieve. - **Closing Takeaway:** Overcoming the power bottleneck requires a three-part approach: software-driven energy intelligence, highly coordinated physical-layer efficiency, and long-term utility grid modernization.
## Notable quotes > [05:02](https://www.youtube.com/watch?v=lBNHFR41GgY&t=302s) It's not just accelerated compute. It's accelerated generation of energy, the accelerated infrastructure, which is needed. It's accelerated digital, which is all softwares, which are going to make it easier. — Pankaj Sharma
> [11:11](https://www.youtube.com/watch?v=lBNHFR41GgY&t=671s) Even if each one of those individual components are the most efficient components, software defined components... the system play is absolutely critical. — Pankaj Sharma
> [02:23](https://www.youtube.com/watch?v=lBNHFR41GgY&t=143s) So AI for energy actually is a very important tool. — Pankaj Sharma
## Mentioned Pankaj Sharma, Tiffany Janzen, Schneider Electric, NVIDIA, Jensen Huang, Motivair, GTC
## Video description Pankaj Sharma, Executive Vice President of Software and Services at Schneider Electric, outlines the challenges of scaling AI infrastructure, emphasizing energy as the foundation of the five-layer AI cake. As AI adoption accelerates, he points to growing pressure on power, grid capacity, and sustainable energy—while highlighting the opportunity to use AI to optimize and expand energy systems for the next generation of AI.
[Source](https://www.youtube.com/watch?v=lBNHFR41GgY)