@Scale
Meta eliminated human bottlenecks in AI data center expansion by deploying Loom, an end-to-end automation pipeline that cuts physical network design time from months to hours through joint device placement and fiber optimization.
AI-assisted summary of Physical Network Design at Scale | Brandon Premo and Richard Cziva from Meta — original source. Check the original for full context.
Source published:
Detailed notes
## Background Published on YouTube by @Scale on August 27, 2026, this talk features Brandon Premo and Richard Cziva from Meta presenting physical network design at scale. The page description outlines how Meta developed Loom, an automated pipeline incorporating Planogram for device placement and Fiber Design Automation for cabling, to accelerate network design from months to hours amid surging AI workloads.
## TL;DR Meta's presentation details Loom, an automated physical network design pipeline created to keep pace with unprecedented AI capacity demands across heterogeneous data centers. The authors explain how traditional manual placement and cabling bottlenecks are solved using Planogram—which balances fiber connectivity costs against failure domain isolation using lexicographic optimization (ILP, RL, and graph algorithms)—and an automated fiber design system. The talk concludes by highlighting key lessons learned, such as formalizing intuitive engineering rules into machine logic and eliminating legacy design habits, while outlining future directions for brownfield expansion and total fiber traceability.
## Atmosphere & style The session delivers an authoritative, deeply technical, and pragmatic tone characteristic of senior infrastructure engineers sharing hard-won production lessons. The narrative shifts smoothly from the tension of manual design bottlenecks to the systematic clarity offered by algorithmic optimization, evoking a sense of engineering rigor and modern innovation. Watching the presentation feels like an engaging, high-level masterclass in data center architecture, balancing mathematical exactness with honest reflections on organizational habits.
## Key takeaways - [00:04](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=4s) The massive scale and heterogeneous nature of AI workload capacity demands rendered traditional manual physical network design an operational bottleneck. - [01:41](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=101s) Meta developed Loom, an end-to-end automated physical network design pipeline that understands building layouts, maps logical topologies, and designs fiber cabling. - [02:28](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=148s) Logical topologies lack physical context, requiring explicit placement of thousands of devices onto data center floors, rows, and racks. - [04:42](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=282s) Physical device placement involves a fundamental trade-off between clustering devices for cheaper fiber vs. spreading devices across failure domains for fault tolerance. - [06:42](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=402s) Planogram utilizes multi-objective lexicographic optimization to strictly order competing goals like connectivity, failure survival, row similarity, and rack efficiency. - [08:08](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=488s) Greedy heuristic scripts fail at scale due to tangled physical constraints, combinatorial explosion, and conflicting design objectives. - [08:08](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=488s) Planogram solves complex placement by combining graph algorithms for problem decomposition, integer linear programming (ILP) for provable optimality, and reinforcement learning (RL) for scale. - [18:03](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=1083s) Formalizing human domain expertise and intuitive design rules into precise mathematical optimization criteria was significantly harder than building the core software engines. - [18:03](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=1083s) Automating the design pipeline exposed and eliminated wasteful legacy habits, such as reserving half-empty racks for vague future upgrades. - [18:59](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=1139s) Loom and Planogram serve as Meta's production-grade physical network design pipeline, with future goals focusing on strand-level traceability, expanding constraint models, and supporting brownfield migrations.
## Detailed walkthrough ### [00:04](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=4s) AI Demand and the Limits of Manual Physical Network Design
AI workloads are fundamentally altering how data centers are constructed, driving an unprecedented demand to turn up massive amounts of network capacity far faster than legacy processes were ever built to support. Larger capacity builds inherently translate to larger physical networks, requiring significantly more network equipment and massive amounts of interconnecting fiber infrastructure. Adding to this scale challenge, modern capacity is not delivered in a uniform, cookie-cutter fashion; instead, it spans a highly heterogeneous mix of as-built data centers, leased facilities, and cloud infrastructure, where no two physical sites are identical.
The traditional approach to physical network infrastructure design was an artisanal, almost entirely manual process. For every single project, teams of human experts had to meticulously analyze the physical building, its power allocations, failure domain boundaries, and row and rack floor plans. They then had to select the appropriate network topology products and figure out how to physically map and design each component for that specific physical space. Because project counts scale directly with AI capacity demands, this expert-dependent model quickly became a bottleneck due to a severe shortage of specialized domain experts.
- Capacity demands require turning up unprecedented volume across heterogeneous environments (as-built data centers, lease sites, and cloud facilities). - The historical physical network design process was artisanal, manual, slow, and unscalable. - The severe shortage of domain experts relative to the skyrocketing number of AI infrastructure projects forced a transition to end-to-end automation.
[01:41](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=101s) Loom: End-to-End Automated Physical Network Design Pipeline
To eliminate this operational bottleneck, Meta built an automated physical network design pipeline (Loom) that understands the physical layout and structural properties of data center buildings. The pipeline automatically selects the proper network topology products for a project, maps the logical network onto the physical floor plan, and designs the complete fiber infrastructure required to connect every device together. The overall workflow relies heavily on two foundational automation components: **Planogram** for device placement and **Fiber Design Automation** for physical cabling.
- The automated pipeline captures the complete end-to-end workflow: building properties, product selection, logical-to-physical mapping, and fiber cabling design. - **Planogram** handles device placement across the physical floor plan subject to dimensional, power, and failure-domain constraints. - **Fiber Design Automation** generates the complete physical fiber infrastructure connecting all placed endpoints.
[02:28](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=148s) The Placement Challenge: Bridging Logical Topologies and Physical Reality
For decades, networking research and engineering have focused heavily on logical topology—how switch layers stack, how devices interconnect, and how traffic routes across them. However, a logical topology is merely a blueprint that cannot carry a single bit of live traffic on its own. Actual network traffic flows through physical fibers plugged into devices inside physical racks drawing power inside real data center rooms. Someone must take the logical blueprint and decide the exact row and rack location for thousands of individual devices.
Historically, mapping logical blueprints to physical floors was slow, manual, and highly inconsistent across different engineers and geographic regions. To illustrate the difficulty, consider a common building block design: a **megapod** consisting of leaf and spine switches in a Clos topology, sitting below an aggregation layer called the **axo-spine** (built from XSW switches organized into distinct planes). In this architecture, each plane connects to a single spine switch index across every megapod in the region (e.g., Plane 1 connects to SSW1 everywhere, Plane 2 to SSW2, and so on). These parallel planes never cross, creating two distinct structural consequences:
1. **Logical reach over physical proximity:** Connectivity is governed strictly by logical properties, meaning a plane must reach every corner of a data center building regardless of physical layout. 2. **Region-wide shared fate:** A plane represents a region-wide failure domain; taking down a single plane drops that specific slice of uplink capacity across every single megapod simultaneously.
- Logical topology design has decades of deep research, but physical floor placement was historically neglected and left to manual execution. - A **megapod** uses a Clos topology of leaf and spine switches; above it, the **axo-spine** layer uses XSW switches divided into parallel planes. - Plane connectivity is non-local and spans the entire building footprint, making physical device placement extremely complex.
[04:42](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=282s) The Architectural Collision: Clustering vs. Spreading
Placing a logical topology onto a physical floor plan requires two intertwined steps: racking the devices (grouping spine switches by megapod and axo-spine switches by plane) and allocating those racks to specific rows on the floor plan. Because connectivity must survive both steps, two fundamental engineering instincts violently collide during placement: the desire to cluster devices together versus the desire to spread them apart for fault tolerance.
This trade-off can be illustrated by two opposing physical placement options for axo-spine switches across failure domains:
- **Option 1: Clustering (Failure-Closed):** All switches for a given plane are packed into a single failure domain. This requires minimal fiber—often just a single trunk per plane—making it extremely simple and inexpensive. However, if that failure domain goes down, the entire plane is wiped out, completely severing that spine index across every megapod simultaneously. This creates a massive blast radius with "failure-closed" behavior. - **Option 2: Spreading (Failure-Open):** Switches for every plane are scattered across all available failure domains. Fiber requirements explode because every plane must reach every physical domain. However, losing a failure domain now only results in losing a minor slice of capacity across each plane. The network gracefully handles the loss via Equal-Cost Multi-Path (ECMP) shrinking, providing a highly preferred "failure-open" degradation.
- **Clustering:** Minimal fiber footprint, simple cabling, but maximal blast radius (a single failure domain loss takes down an entire logical plane). - **Spreading:** High fiber complexity and cost, but minimal blast radius (failures trigger an ECMP shrink rather than total plane loss). - Planogram explicitly models, ranks, and solves this trade-off between fiber cost and failure blast radius.
[06:42](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=402s) Multi-Objective Lexicographic Optimization in Planogram
Network engineers do not evaluate placement trade-offs using a single numeric score; instead, they operate on a ranked hierarchy of competing design objectives. Planogram models this using **lexicographic optimization**, where higher-ranked objectives are fully satisfied before lower-ranked objectives are evaluated. The system focuses on four core objectives:
1. **Connectivity:** Minimizes the number of rack pairs that must connect between adjacent layers, reducing inter-rack links to yield simpler and cheaper fiber infrastructure (the clustering instinct). 2. **Surviving Failures:** Spreads physical entities across failure domains so no single infrastructure failure exceeds the blast radius budget tolerated by network designers (the spreading counterweight). 3. **Row Similarity:** Keeps rack role layouts uniform from row to row, creating standardized floor plans that are easier to construct and operate. 4. **Rack Efficiency:** Packs equipment into the minimum number of physical racks to maximize the utilization of space and power budgets.
Rather than blending these goals into a single weighted mathematical score with arbitrary coefficients, lexicographic optimization enforces strict priority ordering. Changing the ranking alters the output to suit different deployment goals: a cost-sensitive project places connectivity at the top, while a resilience-critical site prioritizes failure spreading.
- Objectives are strictly ordered (lexicographic optimization) rather than combined into a single weighted score. - Changing objective hierarchy allows the exact same optimization engine to produce provably optimal designs for different business constraints (e.g., cost-optimized vs. resilience-optimized).
[08:08](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=488s) Why Greedy Heuristics Fail: Planogram's Internal Architecture
When faced with physical placement, the initial engineering instinct is often to write simple greedy bin-packing scripts. However, greedy heuristics consistently fail for physical data center placement due to three core complexities:
- **Tangled Constraints:** Power limits, physical rack space, maximum cable lengths, and port compatibility are tightly coupled; fixing one constraint almost always violates another. - **Combinatorial Explosion:** Thousands of network entities, multiple valid logical topologies, and diverse physical floor plans create a massive search space that simple heuristics cannot navigate effectively. - **Conflicting Objectives:** Scripts hardcode arbitrary winners between competing goals (e.g., cheap fiber vs. failure domain isolation, or dense packing vs. row uniformity), producing sub-optimal designs.
To overcome these limits, **Planogram** operates as an orchestrator combining three distinct computational engines:
- **Graph Algorithms:** Perform an initial pass to decompose the massive placement problem into smaller, tractable sub-problems. - **Integer Linear Program (ILP):** Serves as the primary heavy lifter, delivering a provably optimal placement design for a given lexicographic ranking. - **Reinforcement Learning (RL):** Adds scale and generates a diverse family of near-optimal design variants rather than a single static solution.
The output of Planogram is a precise physical topology where every single network entity is assigned to an exact row and rack coordinate on the data center floor, providing the machine-readable foundation needed to automate fiber design.
- Inputs to Planogram: Logical topology (LNTG), Data Center Stencil (floor plan, power/space budgets, failure boundaries), and ranked Objectives. - Output: Precise physical placement mapping every switch and device to an exact row and rack location. - Engine combination: Graph pass for tractability, ILP for provable optimality, and RL for scale and solution variety.
<ElicitationsGroup message="Explore related network automation topics or technical details:"> <Elicitation label="Explain Fiber Design Automation and channel schematics" query="How does Meta's Fiber Design Automation work, and what are channel schematics?"/> <Elicitation label="Summarize the real-world results and performance metrics of Loom" query="What are the real-world deployment scale and performance metrics achieved by Meta's Loom pipeline?"/> </ElicitationsGroup>
[18:03](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=1083s) Key Lessons: Formalizing Objectives and Exposing Habits
Automating Meta's physical network design pipeline produced far better plans rather than simply generating them faster, but the journey revealed several unexpected challenges. The primary obstacle was not the technical buildout of the automation engines themselves, but rather the organization and formalization of domain knowledge. Translating human expertise into machine logic proved complex: an expert engineer could state an objective like "stretch things out for resilience" in five seconds, but turning that intuitive concept into precise, rankable mathematical criteria required months of effort.
Furthermore, introducing automation forced the team to confront legacy design rules that were actually just ingrained habits. For instance, past manual designs consistently left racks half-filled under the assumption of preserving "future upgradability." When questioned during the automation push, no functional justification remained—it was simply a tradition quietly wasting valuable data center space. Once explicit optimization objectives were defined, these unexamined habits had nowhere left to hide.
* Automating physical network design shifts focus from speed alone to producing higher-quality, optimized plans. * Knowledge organization was significantly harder than building the automation framework itself. * Formalizing intuitive rules (e.g., resilience spacing) into precise algorithmic objectives took months. * Questioning legacy habits eliminated wasteful practices, such as leaving racks half-empty for unspecified future upgrades.
[18:59](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=1139s) Production Deployment at Meta and Future Horizons
The Planogram (device placement) and fiber design automation tools represent the first comprehensive work bringing physical layout, placement, and cabling automation to the @Scale community. The system operates end-to-end: high-level logical intent is fed into the pipeline, and a complete, build-ready region design comes out. Neither component is a mere research prototype—together, they form the default, production-grade physical design pipeline at Meta today.
Looking to the future, the team is pursuing three main directions. First, they are establishing end-to-end traceability from top-level intent down to every individual installed fiber strand. Second, they are expanding the system's constraint engine to incorporate additional physical infrastructure limits, including power delivery, cooling capacity, and structural loads. Finally, while the system currently handles greenfield new builds, development is underway to support brownfield designs—enabling complex, live network migrations in existing production regions. Physical design deserves to be automated, optimized, and studied as a first-class problem in an era where AI workloads are rapidly reshaping data center architecture.
* The end-to-end physical network design pipeline is fully deployed in production as Meta's default workflow. * Future effort #1: Achieving total traceability from logical intent down to the installed fiber strand. * Future effort #2: Incorporating advanced structural, power, and cooling constraints. * Future effort #3: Expanding capabilities from greenfield builds to brownfield network migrations in active production regions. * "AI is rewriting how we build data centers faster than any manual process can keep up."
<ElicitationsGroup message="Explore related aspects of Meta's data center automation:"> <Elicitation label="Explain how Planogram optimizes rack device placement" query="Explain how Meta's Planogram system optimizes rack device placement and handles physical failure domains."/> <Elicitation label="Detail Meta's automated fiber design architecture" query="Detailed breakdown of how Meta's fiber design component automates cabling and connectivity patterns."/> </ElicitationsGroup>
## Notable quotes > [00:04](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=4s) AI workloads are fundamentally altering how data centers are constructed, driving an unprecedented demand to turn up massive amounts of network capacity far faster than legacy processes were ever built to support.
> [00:04](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=4s) For every single project, teams of human experts had to meticulously analyze the physical building, its power allocations, failure domain boundaries, and row and rack floor plans.
> [00:04](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=4s) Because project counts scale directly with AI capacity demands, this expert-dependent model quickly became a bottleneck due to a severe shortage of specialized domain experts.
> [01:41](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=101s) Planogram handles device placement across the physical floor plan subject to dimensional, power, and failure-domain constraints.
> [02:28](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=148s) Logical topology design has decades of deep research, but physical floor placement was historically neglected and left to manual execution.
> [02:28](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=148s) Plane connectivity is non-local and spans the entire building footprint, making physical device placement extremely complex.
> [04:42](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=282s) Because connectivity must survive both steps, two fundamental engineering instincts violently collide during placement: the desire to cluster devices together versus the desire to spread them apart for fault tolerance.
> [06:42](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=402s) Rather than blending these goals into a single weighted mathematical score with arbitrary coefficients, lexicographic optimization enforces strict priority ordering.
> [08:08](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=488s) Tangled Constraints: Power limits, physical rack space, maximum cable lengths, and port compatibility are tightly coupled; fixing one constraint almost always violates another.
> [18:03](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=1083s) Translating human expertise into machine logic proved complex: an expert engineer could state an objective like "stretch things out for resilience" in five seconds, but turning that intuitive concept into precise, rankable mathematical criteria required months of effort.
> [18:03](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=1083s) When questioned during the automation push, no functional justification remained—it was simply a tradition quietly wasting valuable data center space.
> [18:59](https://www.youtube.com/watch?v=TS1d05vl9aQ&t=1139s) AI is rewriting how we build data centers faster than any manual process can keep up.
## Mentioned Brandon Premo, Richard Cziva, Meta, YouTube, @Scale, Loom, Planogram, Fiber Design Automation, Clos topology, ECMP, Integer Linear Program (ILP), Reinforcement Learning (RL)
[Source](https://www.youtube.com/watch?v=TS1d05vl9aQ)