Ai4
Connecting multimodal AI directly to 3D CAD via Model Context Protocol catches 70% of manufacturing defects in two hours, bypassing multi-week supplier review bottlenecks before tooling begins.
AI-assisted summary of AI for Hardware Development With Amazon Robotics — original source. Check the original for full context.
Source published:
Detailed notes
## Background Published on YouTube by the channel Ai4 on August 15, 2026, this presentation features Satvik Sabarad, an Advanced Manufacturing Engineer at Amazon Robotics. The talk details how multimodal AI agents, Claude Code CLI, and custom Model Context Protocol (MCP) servers bridge directly into 3D CAD software to fuse symbolic geometric data with visual context, automating manufacturability feedback and should-cost modeling.
## TL;DR Satvik Sabarad outlines an AI-driven framework deployed upstream at Amazon Robotics to compress multi-week supplier review cycles into automated analyses taking mere hours. The architecture pairs Claude Code CLI with SolidWorks via custom MCP servers, generating real-time VBScript macros and capturing multi-angle renders to evaluate geometric clearances, tooling constraints, and cycle times. Modular Markdown instruction files orchestrate deterministic calculations alongside multimodal visual reasoning, compiling comprehensive HTML reports with flagged DFM violations. In pilot studies on injection-molded components, the system achieved 70% coverage of vendor feedback, 85% true-positive accuracy, and should-cost estimates within ±25% of supplier quotes.
## Atmosphere & style The presentation carries a crisp, pragmatic, and highly technical tone grounded in the real-world complexities of industrial manufacturing rather than speculative AI hype. Sabarad speaks with the authoritative, steady confidence of an engineer managing deployed systems at massive scale, seamlessly linking low-level CAD mechanics with agentic orchestration. The accompanying terminal and CAD demo evokes a compelling sense of tangible productivity, illustrating a practical bridge between cutting-edge LLMs and traditional mechanical engineering workflows.
## Key takeaways - [00:04](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=4s) Physical AI focuses on embodied intelligence in robotics, whereas AI for hardware development leverages AI upstream to invent, design, optimize, and manufacture physical hardware. - [00:04](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=4s) Hardware development cycles typically span 3 to 4 years due to multi-week supplier review delays, contract negotiations, and iterative redesigns for tooling and manufacturability. - [03:26](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=206s) External contract manufacturers typically require 8 to 10 weeks to return actionable Design for Manufacturing (DFM) feedback, creating a major program bottleneck. - [05:39](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=339s) Subtle design flaws like improper bend radii, small punched hole diameters, and non-standard tooling drive up manufacturing failure rates, tooling wear, and production costs. - [07:50](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=470s) Using Model Context Protocol (MCP) and Claude Code CLI enables AI agents to interface directly with desktop CAD software like SolidWorks rather than relying on fragile hardcoded APIs. - [07:50](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=470s) The agent dynamically synthesizes VBScript macros inside the CAD environment to extract symbolic feature trees while simultaneously capturing multi-angle rendered screenshots for multimodal evaluation. - [12:06](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=726s) Modular Markdown instruction files act as domain-specific agents for metals, plastics, and PCBAs, while an orchestrator manages the boundary between deterministic code and LLM reasoning. - [13:02](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=782s) Multimodal LLMs evaluate components holistically, understanding functional intent, structural relationships, and human assembly access beyond rigid rule checks. - [15:10](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=910s) Multimodal visual reasoning enables should-cost estimation by predicting raw material needs and machining cycle times directly from 3D geometry. - [16:24](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=984s) In a plastic injection molding pilot, the AI agent achieved 70% DFM coverage and 85% accuracy in just 2 hours compared to a multi-week supplier turnaround. - [16:24](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=984s) AI-driven should-cost modeling landed within ±25% of finalized supplier quotes, with ongoing fine-tuning targeting regional and vendor-specific profiles.
## Detailed walkthrough ### [00:04](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=4s) Physical AI vs. AI for Hardware Development
Satvik Sabarad opens his presentation by introducing his role as an Advanced Manufacturing Engineer at Amazon Robotics, where he interfaces directly between internal design teams and an extensive network of external contract manufacturers and vendors. While Amazon Robotics develops autonomous systems strictly for internal fulfillment and warehouse logistics rather than consumer markets, the operational scale is staggering: the organization has recently deployed over one million robots across warehouse facilities in the United States, Europe, and Southeast Asia.
Setting the conceptual scope for the session, Satvik draws a clear distinction between physical AI and "AI for hardware development." While physical AI focuses on robotics and the embodiment of intelligence inside physical mechanical systems, his work tackles the reverse problem: leveraging artificial intelligence to invent, design, optimize, and manufacture the physical hardware itself. Every tangible physical product, whether a smartphone, a laptop, an office chair, or the carpet underfoot, demands an exhaustive, multi-year product development lifecycle. A phone held in someone's hand today likely began initial design phases three or four years earlier. Moving from concept design to consumer deployment involves prototype fabrication, extensive testing, contract negotiations with global suppliers, vendor sourcing, cost modeling, and recurring iterative redesigns to fit vendor manufacturing capabilities.
- **Deployed Scale:** Amazon Robotics has crossed the milestone of 1,000,000+ active robots deployed globally across US, European, and Southeast Asian fulfillment networks. - **Hardware Development Timelines:** Modern consumer electronics and robotics require 3 to 4 years from initial design kick-off to full-scale commercial manufacturing. - **Focus Areas:** Deploying multimodal LLMs upstream to compress hardware cycles across two primary disciplines: Design for X (DFX)—spanning manufacturability, scalability, and reliability—and cost-optimization case studies based on live internal robot programs.
---
[03:26](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=206s) The Vendor Feedback Bottleneck and DFX Reviews
When scaling a complex robotic platform composed of thousands of unique custom components, the traditional engineering design review process creates a massive logistical and operational bottleneck. Hardware design engineers package complete engineering releases—including native 3D CAD models and detailed 2D manufacturing drawings—and distribute them to external suppliers across the globe. Contract manufacturers must parse every drawing and feature tree by hand to evaluate whether parts can be fabricated reliably at scale and whether tooling investments can be justified.
```mermaid flowchart TD accTitle: Traditional vs AI Upstream Hardware Review Flow subgraph Traditional["Traditional Supplier Feedback Cycle (8-10 Weeks)"] A["CAD & 2D Drawings Package"] --> B["Global Contract Manufacturer Review"] B --> C["Tooling & DFM Iteration Notes"] C --> D["Engineering Redesign Loop"] end
subgraph AIUpstream["Upstream AI Agent Review (Minutes)"] E["Native 3D CAD File"] --> F["Custom MCP Server & CLI Agent"] F --> G["Instant DFM, Tooling & Assembly Rules"] G --> H["Optimized Design Before Supplier Hand-Off"] end ```
The friction in this cycle stems from deep physical constraints: metal die castings, sheet metal bends, and injection-molded parts each demand custom hard tooling, strict draft angles, precise material specifications, and machine-specific clearances. Because vendor manufacturing capabilities differ wildly depending on machinery and geographical facilities, suppliers take anywhere from 8 to 10 weeks to return actionable Design for Manufacturing (DFM) feedback. If critical manufacturing, assembly, or maintainability flaws are caught only after a multi-month feedback delay, the entire product launch slips. By deploying multimodal AI directly upstream into the engineering design phase, Amazon Robotics aims to catch tooling clashes, inadequate bend radii, and assembly interferences in minutes rather than months.
---
[05:39](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=339s) Anatomy of Supplier DFM Feedback on Sheet Metal
To illustrate the exact nature of these reviews, Satvik shares a concrete example of an industrial sheet metal bracket undergoing standard vendor scrutiny. When an experienced manufacturing engineer examines the part, they flag multiple subtle design flaws that dictate production yields and long-term durability:
- **Corner Relief and Bend Radii:** The inner corner radius of a bend was modeled smaller than the recommended tool radius, creating excessive localized stress that causes the sheet metal to crack during stamping or after cycling in the field. - **Hole Diameter to Sheet Thickness:** A punched through-hole featured a diameter smaller than the sheet metal stock thickness, which causes high tooling wear, punch breakages, and micro-fractures around the hole perimeter. - **Tooling Consolidation and Cost Reduction:** By standardizing and consolidating distinct hole patterns into a single uniform diameter across the sheet, the supplier avoids purchasing custom punching dies or dedicated secondary machining setups. - **Design for Maintainability and Assembly (DFMA):** A recessed access hole forced factory technicians to blindly thread tools into cramped, inaccessible internal pockets during assembly. Relocating or expanding the hole eliminated manual assembly bottlenecks on the plant floor.
In large-scale robotics programs featuring thousands of unique parts, having human engineers manually review every single feature across hundreds of supplier packages creates an unsustainable cognitive burden, resulting in the multi-week delays typical of traditional hardware cycles.
---
[07:50](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=470s) The Technical Architecture: Claude Code, MCP, and Multimodal CAD
Compressing this multi-week cycle down to automated real-time evaluation relies on two major technological breakthroughs: the Model Context Protocol (MCP) introduced in late 2024, and rich multimodal visual analysis. Rather than relying on fragile, hardcoded REST API endpoints where engineers must explicitly map every incoming and outgoing parametric boundary, MCP allows an agent to interface directly with desktop CAD software like Dassault Systèmes SolidWorks. The AI agent inspects the running CAD session, dynamically determines what geometric context it requires, and actively writes its own code on the fly.
```mermaid flowchart LR accTitle: Multimodal CAD Ingestion Architecture subgraph CADBridge["CAD Extraction Layer"] A["SolidWorks CAD Session"] --> B["Custom MCP Server"] B --> C["On-the-Fly Macro / VBScript Generator"] C --> D["Symbolic Data: Bounding Box, Features & Material"] A --> E["Multi-Angle Rendered Screenshots (Top, Side, ISO)"] end
subgraph LLMAnalysis["Multimodal Reasoning Layer"] D --> F["Claude Code CLI Engine"] E --> F G["Engineering DFM Rule Checker"] --> F F --> H["Markdown DFM Report & Actionable Fixes"] end ```
When connecting an LLM agent via Claude Code CLI to SolidWorks over MCP, the agent can query whether a model is open. If a requested tool does not exist within the MCP server to parse a complex feature tree, the agent dynamically synthesizes custom Visual Basic (VBScript) macros, runs them inside the SolidWorks API environment, and extracts part metadata, material specifications, feature hierarchies, and geometric bounding boxes. Simultaneously, the system commands the CAD engine to capture multi-angle viewport renders—top, side, front, and isometric projections.
Combining symbolic engineering data (exact feature trees, tolerances, and material properties) with visual spatial renderings overcomes the brittleness of traditional deterministic rule checkers. The multimodal model evaluates spatial clearances and human assembly accessibility just like "a seasoned manufacturing engineer who is looking at the part in real time." At the end of each Claude Code CLI inspection loop, the session outputs a structured Markdown log detailing all flagged DFM violations, tooling cost drivers, and proposed geometry modifications.
[12:06](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=726s) Orchestrating Agents and Rules via Markdown Instructions
When scaling the analysis to new components, the entire workflow can be kicked off simply by invoking an existing Markdown instruction file that orchestrates the necessary steps. This modular framework easily extends across diverse hardware domains, including metals, injection-molded plastics, electronics, and PCBAs (Printed Circuit Board Assemblies). By encoding domain-specific logic into separate Markdown files, each file effectively acts as a specialized agent. An overarching orchestrator coordinates these agents and delegates subtasks as needed.
```mermaid flowchart TD accTitle: Markdown-Driven Agent Orchestration Architecture accDescription: Diagram showing an orchestrator routing CAD analysis tasks between deterministic scripts and LLM multimodal reasoning.
subgraph Inputs["Inputs & Orchestration"] CAD["3D CAD / PCBA Artifacts"] MD["Markdown Agent Instructions"] ORCH["Claude Code Orchestrator"] end
subgraph Execution["Execution Pathways"] DET["Deterministic Code / CAD Macros<br/>(Feature tree, geometry, rules)"] LLM["Multimodal LLM Reasoning<br/>(Visual context, component description)"] end
subgraph Outputs["Final Deliverables"] REP["HTML DFM & Cost Report"] end
CAD --> ORCH MD --> ORCH ORCH -->|Rule Checks & Measurements| DET ORCH -->|Visual & Semantic Analysis| LLM DET --> REP LLM --> REP ```
Crucially, this structure governs the switching mechanism between deterministic rule-based code and LLM-driven reasoning. When an evaluation requires exact geometric math or known programmatic CAD macros, the system invokes deterministic scripts; it only falls back to calling the LLM when qualitative understanding, contextual synthesis, or visual reasoning is required.
- Domain-specific Markdown files serve as modular agents for metals, plastics, electronics, and PCBAs. - The orchestration layer handles the decision boundary between deterministic execution and LLM inference. - Eliminates unnecessary model calls by keeping hard-and-fast geometric calculations in deterministic code.
---
[13:02](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=782s) Live DFM Workflow and Holistic Component Understanding
Demonstrating the implementation via a video recording sped up roughly 4x to 5x, the workflow pairs a 3D CAD model on the left with Claude Code running in the terminal on the right. Once the user loads the Markdown agent files into the Claude Code session and prompts it to perform a Design for Manufacturability (DFM) analysis, the agent dynamically generates a structured task list. It systematically executes CAD macros to extract dimensions, captures rendered visual screenshots from multiple perspectives, synthesizes a comprehensive component description, evaluates the part against explicit DFM guidelines, and compiles the entire output into an interactive HTML report.
The qualitative component description produced in the report highlights a key capability unique to multimodal LLMs: rather than merely processing disconnected dimensions through rigid rule checks, the model understands the part holistically, grasping its intended design function and structural features. Engineers can interrogate the model with design-specific queries, review visual callouts of flagged defects, and inspect a summary table detailing passing and failing manufacturing parameters. These DFM rules can be adjusted dynamically on the fly to reflect specific vendor capabilities, manufacturing regions, or internal Amazon Robotics engineering standards.
- The agent builds an autonomous task checklist: macro execution, visual capture, holistic description, and guideline evaluation. - Outputs compile cleanly into an HTML report highlighting flagged defects and parameter pass/fail metrics. - Rule sets remain fully configurable on the fly according to local supplier capabilities or internal corporate requirements.
---
[15:10](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=910s) AI-Powered Should-Cost Modeling
Beyond manufacturability, multimodal AI provides a quantitative framework for should-cost estimation. When external suppliers submit quotes, engineering teams historically had to take those figures at face value without an easy way to verify fair market pricing. By deploying multimodal models directly on the geometry, the team estimates baseline manufacturing costs for individual parts and scales those projections up to program-level bill of materials (BOM) costs to build an entire robot at target production volumes.
The underlying calculation breaks down into raw material costs and manufacturing processing costs. Manufacturing cost in machining workflows hinges primarily on estimated cycle time multiplied by the shop's hourly machine rate. Because cycle time is tightly coupled to part geometry, feature depth, and operational complexity, multimodal AI visual reasoning plays an essential role in arriving at realistic production times.
---
[16:24](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=984s) Pilot Evaluation Metrics and Real-World Results
To ensure model predictions remain grounded, the team benchmarks AI performance against real engineering ground truth using strict evaluation metrics for both DFM feedback and should-cost modeling:
| Evaluation Metric | Target Domain | Definition / Benchmark | |:--- |:--- |:--- | | **DFM Coverage** | Manufacturability | Percentage of total supplier-identified feedback issues successfully flagged by the AI agent. | | **DFM Accuracy** | Manufacturability | Percentage of AI-flagged issues that represent valid, true-positive manufacturing concerns. | | **Cost Delta** | Should-Cost Modeling | Percentage deviation between AI-predicted cost estimates and finalized supplier quotes. |
In a pilot case study focused on complex plastic injection molding components, an external supplier returned 90 distinct pieces of DFM feedback after their typical multi-week review cycle. The AI agent identified approximately 70% of those supplier-flagged issues in just 2 hours of automated analysis. Of the issues identified by the AI, 85% were verified as accurate, true-positive DFM risks.
For should-cost modeling, the AI's preliminary price predictions landed within a ±25% delta of the supplier quotes. Active engineering efforts are focused on bridging this remaining cost and accuracy gap by fine-tuning models on historical supplier feedback and regional manufacturing datasets to create supplier-specific evaluation profiles.
- **2 hours vs. 2 weeks:** Compressed supplier feedback turnarounds from multi-week waiting periods to roughly two hours. - **70% DFM coverage:** Caught nearly three-quarters of all feedback items identified by human tooling experts. - **85% DFM precision:** Verified true-positive accuracy across flagged injection-molding issues. - **±25% should-cost accuracy:** Preliminary cost estimates consistently matched supplier quotation bands.
## Notable quotes > [00:04](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=4s) Physical AI focuses on robotics and the embodiment of intelligence inside physical mechanical systems, his work tackles the reverse problem: leveraging artificial intelligence to invent, design, optimize, and manufacture the physical hardware itself. — Satvik Sabarad
> [00:04](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=4s) Deploying multimodal LLMs upstream to compress hardware cycles across two primary disciplines: Design for X (DFX)—spanning manufacturability, scalability, and reliability—and cost-optimization case studies based on live internal robot programs. — Satvik Sabarad
> [03:26](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=206s) Contract manufacturers must parse every drawing and feature tree by hand to evaluate whether parts can be fabricated reliably at scale and whether tooling investments can be justified. — Satvik Sabarad
> [03:26](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=206s) By deploying multimodal AI directly upstream into the engineering design phase, Amazon Robotics aims to catch tooling clashes, inadequate bend radii, and assembly interferences in minutes rather than months. — Satvik Sabarad
> [05:39](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=339s) The inner corner radius of a bend was modeled smaller than the recommended tool radius, creating excessive localized stress that causes the sheet metal to crack during stamping or after cycling in the field. — Satvik Sabarad
> [05:39](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=339s) A punched through-hole featured a diameter smaller than the sheet metal stock thickness, which causes high tooling wear, punch breakages, and micro-fractures around the hole perimeter. — Satvik Sabarad
> [07:50](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=470s) The AI agent inspects the running CAD session, dynamically determines what geometric context it requires, and actively writes its own code on the fly. — Satvik Sabarad
> [07:50](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=470s) The multimodal model evaluates spatial clearances and human assembly accessibility just like a seasoned manufacturing engineer who is looking at the part in real time. — Satvik Sabarad
> [12:06](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=726s) When an evaluation requires exact geometric math or known programmatic CAD macros, the system invokes deterministic scripts; it only falls back to calling the LLM when qualitative understanding, contextual synthesis, or visual reasoning is required. — Satvik Sabarad
> [13:02](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=782s) Rather than merely processing disconnected dimensions through rigid rule checks, the model understands the part holistically, grasping its intended design function and structural features. — Satvik Sabarad
> [15:10](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=910s) Manufacturing cost in machining workflows hinges primarily on estimated cycle time multiplied by the shop's hourly machine rate. — Satvik Sabarad
> [16:24](https://www.youtube.com/watch?v=RiNp_Vx44H8&t=984s) In a pilot case study focused on complex plastic injection molding components, an external supplier returned 90 distinct pieces of DFM feedback after their typical multi-week review cycle. The AI agent identified approximately 70% of those supplier-flagged issues in just 2 hours of automated analysis. — Satvik Sabarad
## Mentioned Amazon Robotics, Satvik Sabarad, Claude Code CLI, Model Context Protocol (MCP), Dassault Systèmes SolidWorks, SolidWorks API, VBScript, Design for Manufacturing (DFM), Design for X (DFX), Design for Maintainability and Assembly (DFMA), PCBAs (Printed Circuit Board Assemblies), Ai4
## Video description Satvik Sabarad - Advanced Manufacturing Engineer, Amazon Robotics
Hardware development across every industry — robotics, automotive, silicon, datacenters, and aerospace — remains constrained by multi-week supplier cycles required to obtain manufacturability feedback and cost estimates, and these cycles represent the single largest lever on program timelines. This talk examines what becomes possible when a multimodal AI agent is given direct access to a 3D CAD file — its feature tree, drawings, tolerances, and rendered views — and tasked with reasoning about how a part should be manufactured and what it should cost. I will present a working system built on Claude Code CLI, custom agents, and MCP servers that bridges directly into CAD, fusing symbolic geometric data with rendered visual context to reason about geometry, tolerances, and manufacturability in a manner comparable to a seasoned engineer. The talk will cover the underlying architecture, the evaluation framework used to benchmark model outputs against real engineering ground truth, and results from production programs in which multi-week feedback loops have been reduced to minutes. Attendees will leave with a clear technical view of how multimodal agents can operate on real engineering artifacts and a practical framework for applying these methods within their own hardware domain.
[Source](https://www.youtube.com/watch?v=RiNp_Vx44H8)