D'Andrea Flies Damaged Drones on Two Propellers Using Control Models

The astounding athletic power of quadcopters | Raffaello D'Andrea — TED

TED

Mathematical modeling and high-rate trajectory re-planning allow mechanically minimal drones to execute athletic maneuvers and survive catastrophic physical damage without redundant hardware.

AI-assisted summary of The astounding athletic power of quadcopters | Raffaello D'Andrea — original source. Check the original for full context.

Source published:

Key ideas

  • Model-based control enables quadcopters to execute dynamic athletic tasks, including balancing inverted poles and carrying unconstrained glasses of water without spilling due to apparent gravity alignment. (4:37)
  • Mathematical re-analysis demonstrates graceful degradation under catastrophic failure, allowing a quadcopter to hover stably on only two propellers by deliberately sacrificing yaw control and spinning continuously. (6:14)
  • Maneuvers exceeding sensor feedback latency, such as a high-speed triple flip, can be mastered using iterative learning algorithms that update feedforward commands based on terminal error across successive trials. (7:52)
  • High-rate trajectory re-planning running at 50 Hz allows multi-drone teams to coordinate complex cooperative tasks, such as catching and launching balls using an elastic net at extreme accelerations. (10:10)

Detailed notes

## Background Published on June 12, 2013, by the TED channel on YouTube, this talk features roboticist Raffaello D'Andrea presenting at TEDGlobal. According to the video description, D'Andrea demonstrates his flying quadcopters—autonomous robots designed to think like athletes by solving complex physical challenges through learning algorithms, interactive gesture control, and cooperative decision-making.

## TL;DR D'Andrea showcases the principles of machine athleticism through a series of live demonstrations using autonomous quadcopters in an indoor flight arena. Relying on mathematical differential equations, control theory, and high-speed motion capture rather than manual trial-and-error, the quads balance inverted poles, carry unspilled glasses of water, recover from catastrophic motor loss, and juggle balls with attached rackets. The presentation also highlights multi-drone cooperation via a shared elastic net and real-time physical and gestural interaction with humans. Concluding the talk, D'Andrea reflects on how playful, sports-inspired experimentation pushes machines to their physical limits and stresses that guiding the future societal impact of autonomous technology is a social responsibility rather than a technical choice.

## Atmosphere & style The presentation carries the electrifying energy of a live high-wire act, where cutting-edge robotics and mathematical rigor collide with physical theater. D'Andrea speaks with calm, academic clarity and infectious curiosity, steadily building anticipation as he unleashes acrobatic maneuvers that seem to defy intuition. Moments of gasping tension—such as disabling two propellers mid-air or frantically swatting at falling drones during an escalating gravity game—dissolve into audience laughter and awe, creating an inspiring and thought-provoking blend of rigorous control engineering, playful spectacle, and philosophical reflection on the human future of automation.

## Bulletin - [04:37](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=277s) Model-based control enables quadcopters to execute dynamic athletic tasks, including balancing inverted poles and carrying unconstrained glasses of water without spilling due to apparent gravity alignment. - [06:14](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=374s) Mathematical re-analysis demonstrates graceful degradation under catastrophic failure, allowing a quadcopter to hover stably on only two propellers by deliberately sacrificing yaw control and spinning continuously. - [07:52](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=472s) Maneuvers exceeding sensor feedback latency, such as a high-speed triple flip, can be mastered using iterative learning algorithms that update feedforward commands based on terminal error across successive trials. - [10:10](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=610s) High-rate trajectory re-planning running at 50 Hz allows multi-drone teams to coordinate complex cooperative tasks, such as catching and launching balls using an elastic net at extreme accelerations.

## Key takeaways - [00:23](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=23s) Quadcopters achieve full directional agility and four degrees of control solely by modulating the rotation speeds of four fixed propellers, rendering them mechanically minimal but fundamentally reliant on continuous feedback control. - [00:23](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=23s) Instead of trial-and-error tuning, model-based design captures physical flight dynamics through differential equations, enabling control theory to synthesize precise stabilization routines. - [02:29](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=149s) A quadcopter can balance an inverted pole in mid-air and follow position wands simply by appending inverted pendulum dynamics to its existing mathematical flight model. - [04:37](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=277s) Carrying an unconstrained glass of water without spilling requires zero software modifications because propeller thrust naturally aligns with the combined vector of gravity and lateral acceleration. - [06:14](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=374s) Deep mathematical modeling permits graceful hardware degradation, proving that a quadcopter missing two opposing propellers can maintain roll, pitch, and altitude authority by spinning continuously along its vertical axis. - [07:52](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=472s) High-speed aerobatic flips outpace localization feedback latency, requiring open-loop bursts combined with iterative learning algorithms that calibrate subsequent attempts from terminal position errors. - [08:51](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=531s) Striking an incoming ball with a drone-mounted tennis racket relies on high-rate trajectory re-planning at 50 Hz, constantly updating interception plans every 20 milliseconds. - [10:10](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=610s) Multi-agent coordination enables three quads to operate an elastic net cooperatively, catching and launching projectiles with peak accelerations roughly five times greater than a human bungee jumper rebound. - [11:16](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=676s) Skeletal gesture tracking bridges human intent and machine athleticism, translating intuitive arm gestures directly into reference trajectories for flight controllers. - [12:36](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=756s) Estimating external physical forces in real time enables synthetic physics, allowing drones to respond to human touch compliantly as if immersed in viscous fluid. - [13:36](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=816s) Simulated games, such as altering artificial gravity parameters, mirror the biological role of play by providing a structured framework to stress-test algorithms at the vehicle's physical limits. - [15:13](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=913s) Steering whether autonomous machine agility benefits humanity or is misused is fundamentally a societal and ethical choice rather than a technical one.

## Detailed walkthrough ### [00:23](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=23s) Machine Athleticism and Model-Based Design

Raffaello D'Andrea introduces the flying quadrocopters—or “quads” for short—to explore what it truly means for a machine to exhibit athleticism. Although quadcopters have been around for a long time, their contemporary surge in popularity stems from their extreme mechanical simplicity: by merely adjusting the rotation speeds of four fixed propellers, the vehicles can roll, pitch, yaw, and accelerate along their orientation. Packed onto each frame are a battery, an onboard computer, wireless communication radios, and a suite of sensors. Yet this mechanical minimalism and high agility introduce a critical drawback: quadcopters are inherently unstable and cannot fly without continuous automatic feedback control.

To create an indoor equivalent of a global positioning system, D'Andrea's team installs overhead cameras connected to a laptop, tracking reflective markers attached to the quads and other objects across the flight arena. This spatial localization stream feeds into another computer running estimation and control algorithms, which wirelessly relays flight commands down to the quadcopter, which itself executes onboard estimation and control routines. For D'Andrea, the software architecture is the true core of the achievement: “The bulk of our research is algorithms.” He describes this computational layer as “the magic that brings these machines to life.”

To craft these athletic behaviors, the team relies on model-based design. Rather than guessing or relying on trial-and-error tuning, researchers first capture the physical dynamics of the craft using differential equations. They then apply control theory to analyze the system and synthesize stabilization routines. This mathematical foundation is what enables the machine to achieve even basic stationary hovering:

```mermaid flowchart TD accTitle: Indoor GPS and Quadcopter Control Architecture accDescr: Diagram illustrating the closed-loop tracking and control pipeline between overhead cameras, offboard laptops, and the quadcopter.

subgraph Sensing ["Vision & Localization"] A["Overhead Cameras"] --> B["Indoor GPS Laptop"] end

subgraph Computation ["Command & Control"] B -->|"Marker coordinates"| C["Estimation & Control Laptop"] C -->|"Radio control commands"| D["Onboard Flight Computer"] end

subgraph Execution ["Physical System"] D -->|"Motor speed adjustments"| E["Propellers & Frame"] E -.->|"Reflective markers tracked"| A end ```

- Quadcopters achieve four degrees of control—roll, pitch, yaw, and directional acceleration—solely by modulating the independent speeds of four fixed propellers. - Flight dynamics are represented mathematically through systems of differential equations before being manipulated via control theory.

[02:29](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=149s) The Balancing Pole Demonstration

To demonstrate the power of model-based design, D'Andrea challenges a quadcopter to balance an inverted pole while hovering in mid-air. He points out that while a human can accomplish this with practice by leveraging two feet firmly planted on the ground and two versatile hands, the task becomes noticeably tougher on one foot without using hands. The quadcopter has neither feet nor hands, and it must balance the stick while sustaining its own flight. A single reflective marker on the tip of the pole allows the overhead camera system to track its position in 3D space.

When released, the quad rapidly executes minute horizontal adjustments underneath the pole, keeping it perfectly upright to the amazement of the audience. D'Andrea explains that designing the algorithm did not require starting from scratch; the engineers simply appended the mathematical model of the inverted pendulum to the existing model of the quadcopter. With the unified quad-pole dynamics formulated, control theory readily yielded stabilizing algorithms. The resulting system is remarkably robust: even when D'Andrea repeatedly swats the pole, the quad swiftly darts back underneath to restore equilibrium.

Extending the system's mathematics further, D'Andrea incorporates a target spatial coordinate into the model. Holding a wand equipped with reflective markers, he gestures across the stage, directing the quadcopter to maintain a fixed offset from the wand while balancing the stick. As he points around the stage, the machine smoothly tracks his movements without dropping the pole. Summarizing the core takeaway, D'Andrea emphasizes: “The key to these acrobatic maneuvers is algorithms, designed with the help of mathematical models and control theory.”

[04:37](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=277s) Physical Insight: Carrying a Glass of Water

D'Andrea brings the quadcopter back, lets the pole fall away, and sets up a contrasting experiment to demonstrate why understanding physical principles is just as vital as mathematical modeling. He places a glass filled with water directly on top of the quadcopter's frame. The drone visibly drops a few inches in altitude under the added weight, yet unlike the balancing pole demo, D'Andrea reveals that he never modeled the glass or the liquid inside it. The flight software has no knowledge that the glass even exists.

Using his marker wand, D'Andrea directs the quad into rapid, sweeping maneuvers through the air. Despite sharp accelerations, not a single drop spills. He explains the straightforward physics at play: first, gravitational acceleration acts uniformly on every object; second, the quad's propellers produce thrust in the exact same upward direction perpendicular to the frame. Because the craft must tilt its entire body to accelerate laterally, the net apparent force vector remains directed straight down through the base of the glass, leaving horizontal shear forces dominated almost entirely by negligible aerodynamic drag.

The demonstration highlights a fundamental engineering distinction between apparent difficulty and physical reality. “The lesson here is that some high-performance tasks are easier than others, and that understanding the physics of the problem tells you which ones are easy and which ones are hard,” D'Andrea remarks, adding that while balancing an inverted pole requires complex modeling and rapid active feedback, carrying an unconstrained glass of water requires no special software at all.

[06:14](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=374s) Graceful Degradation and Flying on Two Propellers

D'Andrea turns to the athletic ability to perform through physical injury, asking whether an aerial robot can continue operating after catastrophic damage. Conventional drone engineering dictates that a vehicle requires at least four fixed propeller-motor pairs to maintain four independent degrees of freedom: roll, pitch, yaw, and collective thrust acceleration. While hexacopters and octocopters provide mechanical redundancy through extra hardware, quadcopters are widely favored precisely because they represent the theoretical minimum configuration of four actuators.

To challenge this assumption, D'Andrea demonstrates a quadcopter that has had two opposing propellers disabled, prompting an audible reaction from the audience. Standard flight theory would declare the vehicle uncontrollable. However, by thoroughly re-analyzing the mathematical model of the damaged system, the researchers discovered an unconventional flight mode: by deliberately sacrificing yaw control and allowing the vehicle to spin continuously about its vertical axis, the remaining two propellers can still generate sufficient authority to control roll, pitch, and net vertical acceleration.

The spinning craft hovers stably in place, executing controlled motion without tumbling out of the sky. D'Andrea underscores the broader architectural lesson of this discovery: “Mathematical models tell us exactly when and why this is possible.” Rather than burdening vehicles with redundant motors, structural weight, and extra batteries, deep mathematical analysis allows engineers to write clever recovery algorithms that gracefully absorb hardware failures, mirroring the resilience of human athletes.

[07:52](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=472s) Iterative Learning: The High-Speed Triple Flip

Drawing parallels to elite sports, D'Andrea describes the tension of watching an Olympic diver perform somersaults into the pool aiming for a rip entry, or a gymnast vaulting through the air hoping to stick the landing. When a quadcopter is tasked with executing an explosive triple flip and returning to its exact starting coordinate, the maneuver transpires far too quickly for traditional feedback loops. Because latency in position estimation prevents real-time trajectory adjustments mid-maneuver, the drone cannot rely on continuous indoor GPS updates during execution.

Instead, the quad executes the sequence blind, treating each attempt as an open-loop burst. Upon finishing the rotation, the system measures its terminal error—how far it drifted from the intended recovery position—and uses that error data to adjust the control parameters for subsequent attempts. D'Andrea notes: “Similar to the diver and the vaulter, it is only through repeated practice that the maneuver can be learned and executed to the highest standard.”

- High-speed aerobatic flips exceed the sensor-to-actuator feedback latency limit, making closed-loop positioning impossible during the rotation. - Iterative learning algorithms update feedforward motor commands across successive trials based purely on the terminal state of the previous run.

[08:51](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=531s) High-Rate Trajectory Re-Planning: Racket and Ball

Striking a fast-moving ball is a core skill across many human sports that athletes execute with apparent ease. D'Andrea mounts an ordinary tennis racket to the top of a quadcopter, pointing out that its functional sweet spot is relatively small—roughly the diameter of an apple. When a ball is tossed toward the hovering craft, the drone lunges dynamically upward and outward, striking the ball cleanly back into the thrower's hands.

This maneuver relies on rapid algorithmic re-planning running at 50 Hz, or once every 20 milliseconds:

1. The vision system extrapolates the ball's incoming ballistic trajectory. 2. The control system calculates the required impact velocity and racket orientation to reflect the ball back to the tosser. 3. An optimization routine generates an intercept trajectory moving the quad from its current kinematic state to the collision point. 4. The quad executes only the first 20 milliseconds of that plan before discarding the rest. 5. The entire computational cycle repeats every 20 milliseconds until racket impact occurs.

Reflecting on the challenge of mimicking human coordination, D'Andrea poses the central question: “How do we make a machine do what an athlete does seemingly without effort?” The answer lies in replacing human muscle memory and instinct with high-frequency predictive mathematics.

[10:10](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=610s) Cooperative Athletics: The Sky Net

Dynamic agility is not limited to isolated machines; quads can also coordinate as a synchronized team. D'Andrea introduces three quadcopters tethered to the corners of an elastic net, dubbed the “sky net.” When a ball is tossed high into the arena, the three drones maneuver in unison to position the mesh beneath the falling projectile. Once the ball lands in the net, the drones coordinate a rapid collective slingshot maneuver, pulling the net taut and rocketing vertically upward to hurl the ball back across the stage.

At the moment of maximum acceleration, the quads orient themselves completely vertical. D'Andrea notes that the peak g-force experienced by the airframes during the launch is roughly five times greater than what a human bungee jumper feels at the bottom of a drop. The software orchestrating this multi-agent maneuver relies on the same mathematical foundation used for the single-drone racket demonstration: “Mathematical models are used to continuously re-plan a cooperative strategy 50 times per second.”

- Three quadcopters collectively handle load-bearing, ball catching, and ballistic launching using a shared flexible net. - The acceleration at peak launch extension subjects the craft to loads approximately five times more intense than the bottom rebound of a human bungee jump.

[11:16](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=676s) Human-Machine Gestural Interaction

Shifting the focus from autonomous capability to collaborative interaction, D'Andrea examines what happens when machine athleticism is paired with human movement. Positioning himself before a commercial gaming gesture sensor capable of tracking skeletal body parts in real time, he connects his physical body to the quadcopter flight arena. Much like the marker pointer used earlier, the camera's joint-tracking output feeds reference commands directly into the quadcopter's flight control algorithms.

Standing on stage, D'Andrea manipulates the quadcopter through air gestures alone, guiding its position, causing it to dart across the flight volume, and controlling its dynamic orientation purely with his arms and hands. He observes: “We now have a natural way of interacting with the raw athleticism of these quads with my gestures.” The demonstration highlights how high-speed algorithmic stabilization bridges the gap between imprecise human gestures and sharp machine execution.

[12:36](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=756s) Synthetic Physics and Physical Interaction

Interaction with athletic machines can also be tactile rather than visual. D'Andrea approaches a quadcopter hovering motionless in space and grabs its carbon-fiber frame. Under default programming, the quad aggressively resists displacement, fighting against his hand to stay anchored to its target coordinates. However, by using mathematical models to infer the exact external force applied by the human hand, the control system can invert that dynamic.

“Once we know this force, we can also change the laws of physics, as far as the quad is concerned, of course,” D'Andrea explains. By reprogramming the response, he makes the drone behave as though it were submerged in a dense, viscous fluid. When pushed, it yields smoothly and glides in the direction of the force before gently coasting to a stop without snapping back. D'Andrea takes advantage of this compliant mode to manually grab an auxiliary camera drone and position it in the air like a studio tripod, setting it up to record the final stage performance.

[13:36](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=816s) The Variable Gravity Game and the Purpose of Play

To conclude the demonstrations, D'Andrea showcases an interactive game that exploits the system's ability to manipulate apparent physics. A group of quadcopters is programmed to simulate artificial planetary environments: they initially float as though operating under the microgravity of Pluto. As the game progresses, the algorithmic gravity parameter steadily scales up toward Earth's standard acceleration, requiring D'Andrea and his team to frantically bat the drones upward to keep them airborne. The stage turns into energetic slapstick as the researchers scramble to keep the falling quads afloat before gravity overwhelms them.

Catching his breath as the audience laughs and applauds, D'Andrea addresses the seemingly playful nature of the entire research program. While spectators might assume the lab is simply indulging in entertainment, he reflects on the deeper biological and evolutionary significance of play:

> “Some conjecture that the role of play in the animal kingdom is to hone skills and develop capabilities. Others think that it has more of a social role, that it's used to bind the group. Similarly, we use the analogy of sports and athleticism to create new algorithms for machines to push them to their limits.”

[15:13](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=913s) The Social Choice of Autonomous Technology and the Team Behind the Arena

Reflecting on the breathtaking speed and agility demonstrated by the autonomous quadcopters, Raffaello D'Andrea steps back to address the broader societal implications of such rapid technological advancement. He prompts the audience to consider the ultimate trajectory of these systems, asking, “What impact will the speed of machines have on our way of life?” He emphasizes that this dilemma is not fundamentally new, noting that throughout human history, every creation and innovation carries a dual nature: “Like all our past creations and innovations, they may be used to improve the human condition or they may be misused and abused.” For D'Andrea, steering that outcome is not an engineering challenge to be solved in the laboratory, but an ethical responsibility shared by society at large.

He urges the audience to take an intentional path forward, declaring, “This is not a technical choice we are faced with; it's a social one.” Drawing a final parallel to human athletics, he makes a passionate plea: “Let's make the right choice, the choice that brings out the best in the future of machines, just like athleticism in sports can bring out the best in us.”

To close the presentation, D'Andrea directs the spotlight away from the flying robots and toward the human minds responsible for making the live demonstration possible. Inviting the audience to meet “the wizards behind the green curtain,” he presents the current members of the Flying Machine Arena research team, giving credit to each researcher by name as the crowd breaks into enthusiastic applause. Praising their talent and vision, he leaves the audience with a final endorsement: “Look out for them. They're destined for great things.”

- **Flying Machine Arena research team members recognized on stage:** - Federico Augugliaro - Dario Brescianini - Markus Hehn - Sergei Lupashin - Mark Muller - Robin Ritz

## Notable quotes > [04:37](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=277s) The lesson here is that some high-performance tasks are easier than others, and that understanding the physics of the problem tells you which ones are easy and which ones are hard — Raffaello D'Andrea

> [15:13](https://www.youtube.com/watch?v=w2itwFJCgFQ&t=913s) Let's make the right choice, the choice that brings out the best in the future of machines, just like athleticism in sports can bring out the best in us. — Raffaello D'Andrea

## Mentioned Raffaello D'Andrea, Flying Machine Arena, TEDGlobal, Kinect, Federico Augugliaro, Dario Brescianini, Markus Hehn, Sergei Lupashin, Mark Muller, Robin Ritz

## Video description Visit http://TED.com to get our entire library of TED Talks, transcripts, translations, personalized Talk recommendations and more.

In a robot lab at TEDGlobal, Raffaello D'Andrea demos his flying quadcopters: robots that think like athletes, solving physical problems with algorithms that help them learn. In a series of nifty demos, D'Andrea show drones that play catch, balance and make decisions together -- and watch out for an I-want-this-now demo of Kinect-controlled quads.

The TED Talks channel features the best talks and performances from the TED Conference, where the world's leading thinkers and doers give the talk of their lives in 18 minutes (or less). Look for talks on Technology, Entertainment and Design -- plus science, business, global issues, the arts and more. You're welcome to link to or embed these videos, forward them to others and share these ideas with people you know.

Follow TED on Twitter: http://twitter.com/TEDTalks Like TED on Facebook: http://facebook.com/TED Subscribe to our channel: http://youtube.com/TED

TED's videos may be used for non-commercial purposes under a Creative Commons License, Attribution–Non Commercial–No Derivatives (or the CC BY – NC – ND 4.0 International) and in accordance with our TED Talks Usage Policy (https://www.ted.com/about/our-organization/our-policies-terms/ted-talks-usage-policy). For more information on using TED for commercial purposes (e.g. employee learning, in a film or online course), please submit a Media Request at https://media-requests.ted.com

[Source](https://www.youtube.com/watch?v=w2itwFJCgFQ)

中文简报

D'Andrea利用控制模型使仅剩两旋翼的受损无人机实现飞行 数学建模与高频轨迹重规划使结构极简的无人机能够执行高难度机动,并在无需冗余硬件的情况下承受毁灭性物理损坏。 D'Andrea在室内飞行场地通过一系列自主四旋翼无人机的现场演示,展现了机器运动能力的原理。这些四旋翼无人机依托数学微分方程、控制理论和高速动作捕捉,而非人工试错,成功实现了倒立摆平衡、运送满杯水而不溢出、遭遇毁灭性电机损坏后的恢复,以及使用所附球拍颠球。演示还重点展示了通过共用弹性网实现的多机协同,以及与人类的实时物理和手势互动。在演讲最后,D'Andrea反思了这种受体育运动启发的探索性实验如何将机器推向物理极限,并强调引导自主技术的未来社会影响是一项社会责任,而非单纯的技术抉择。 基于模型的控制使四旋翼无人机能够执行动态运动任务,包括平衡倒立杆,以及通过视在重力对齐运送无固定水杯且滴水不漏。 (4:37) 数学重新分析展示了系统在遭遇毁灭性故障时的平稳降级能力,四旋翼无人机通过主动牺牲偏航控制并持续自旋,仅靠两个螺旋桨即可稳定悬停。 (6:14) 超出传感器反馈延迟极限的机动动作(例如高速三连翻滚)可以通过迭代学习算法来掌握,该算法会根据连续试验中的终端误差来更新前馈指令。 (7:52) 以50赫兹运行的高频轨迹重规划使多无人机编队能够协同完成复杂的合作任务,例如在极高加速度下利用弹性网接球和抛球。 (10:10)

Reading summary

Raffaello D'Andrea demonstrates that machine athleticism in quadcopters is achieved through model-based design, predictive algorithms, and physical insight rather than mechanical complexity. By mathematically modeling flight dynamics and applying control theory, standard quadcopters can perform high-speed aerobatics, adapt to catastrophic hardware failures, and cooperate dynamically in real time. Model-Based Control and Mechanical Simplicity (0:23) Quadcopters achieve agility through extreme mechanical minimalism, altering roll, pitch, yaw, and directional acceleration solely by varying the speeds of four fixed propellers. However, this design is inherently unstable and cannot fly without continuous automatic feedback control. Rather than using trial-and-error tuning, D'Andrea's team employs model-based design: they capture vehicle dynamics through differential equations and apply control theory to synthesize stabilization algorithms. In their flight arena, an indoor localization network of overhead cameras tracks reflective markers, relaying spatial data to offboard computers that calculate and transmit control commands back to the quadcopters. The effectiveness of this mathematical approach is demonstrated by balancing an inverted pole. Engineers did not design a new control system from scratch; they simply appended the mathematical model of an inverted pendulum to the existing quadcopter model. The resulting algorithms allow the craft to make rapid horizontal adjustments beneath the pole, maintaining equilibrium even when the pole is physically swatted or directed to follow a wand across the arena. Physical Intuition and Synthetic Dynamics (4:37) D'Andrea emphasizes that mathematical modeling must be balanced with physical insight, noting that understanding the underlying physics reveals which high-performance tasks are inherently easy or difficult. In one demonstration, a quadcopter maneuvers rapidly while carrying an unconstrained, full glass of water without spilling a drop, despite the software having no mathematical model of the glass or liquid. Because aerodynamic drag is negligible and lateral acceleration requires tilting the airframe, the combined force vector of propeller thrust and gravity remains directed perpendicular to the frame and straight through the bottom of the glass. Conversely, understanding physical forces allows engineers to alter how humans interact with machines. By calculating the external forces exerted by a human hand on a hovering frame, the control software can invert default resistance. D'Andrea demonstrates a quadcopter programmed to mimic motion through a viscous fluid, yielding smoothly to hand contact so it can be repositioned mid-air like an aerial tripod. Graceful Degradation Under Hardware Failure (6:14) Conventional drone engineering dictates that four independent motor-propeller units are the theoretical minimum required to maintain full flight control. To test resilience, D'Andrea demonstrates a quadcopter flying with two opposing propellers disabled—a state standard flight theory considers uncontrollable. By re-evaluating the damaged vehicle's mathematical model, researchers discovered that sacrificing yaw control allows the craft to maintain roll, pitch, and altitude while spinning continuously around its vertical axis. This recovery routine prevents the damaged vehicle from crashing and allows it to hover stably in place. D'Andrea notes that deep mathematical modeling allows algorithms to absorb severe mechanical damage, providing graceful degradation without adding the physical weight, cost, and complexity of redundant motors. Trajectory Re-Planning and Iterative Learning (7:52) When maneuvers exceed sensor-to-actuator feedback latency limits, the flight architecture shifts to open-loop execution and predictive optimization. During an explosive triple flip, latency prevents real-time indoor GPS updates mid-rotation. Instead, the drone executes the flip open-loop, measures its terminal drift from the target position after completing the maneuver, and uses iterative learning algorithms to adjust feedforward motor commands across subsequent attempts. For high-speed dynamic interception—such as striking a ball with an apple-sized sweet spot on a mounted tennis racket—the system re-plans trajectories at 50 Hz, or every 20 milliseconds. The software extrapolates the ball's ballistic path, optimizes an intercept trajectory, executes only the first 20 milliseconds of the plan, and discards the rest to recalculate. The same 50 Hz trajectory re-planning enables three quadcopters to coordinate an elastic net, collectively catching a thrown ball and launching it vertically with peak accelerations roughly five times what a human bungee jumper experiences. Athletic Play and Societal Implications (13:36) Addressing the playful nature of their demonstrations—which include gesture-controlled flight and a slapstick game where drones simulate gravitational transitions from Pluto to Earth—D'Andrea links machine athleticism to the evolutionary role of play in animals. He argues that structured play serves to hone operational skills, explore behavioral limits, and bind groups together, functioning as an R&D framework for developing novel machine capabilities. D'Andrea concludes by addressing the broader implications of high-speed autonomous machines. Arguing that every major innovation carries the potential for both benefit and abuse, he insists that steering the future of autonomous systems is not a technical choice for engineers, but an ethical and social responsibility for society as a whole. D'Andrea demonstrates that model-based control theory enables quadcopters to perform extreme athletic feats, but these demonstrations rely on an instrumented indoor flight arena with high-speed overhead localization tracking. As machine agility and autonomy advance toward real-world deployment, the core challenge shifts from mathematical stabilization to the societal choices governing how autonomous technology is utilized.

精炼阅读摘要

机器人学者Raffaello D'Andrea在演讲中指出,四轴飞行器(quadcopter)之所以能够展现出类似人类运动员的高动态敏捷性,其核心并非依赖复杂的机械冗余,而是基于精确的物理洞察、微分方程数学建模与高频控制理论算法。 模型驱动设计与软硬件控制架构 (0:23) 四轴飞行器在机械结构上具有极简性,仅通过调节四个固定螺旋桨的转速即可实现横滚、俯仰、偏航及方向加速度四个自由度的控制。但由于这种构型天生不稳定,系统必须依赖持续的自动反馈控制。D'Andrea团队通过安装在空中的摄像头构建室内定位体系,实时追踪机体和物体上的反光标记,并将数据传输至控制计算机进行状态估计与算法计算,随后通过无线电向机载计算平台下发调整指令。D'Andrea强调其研究的核心是算法,控制团队舍弃了盲目的试错调试,而是先用微分方程对飞行器的物理动力学进行严谨表达,再借助控制理论综合出稳定化例程。 在顶杆平衡演示中,团队直接将倒立摆系统的数学模型附加到四轴飞行器的动力学模型中,便迅速合成了自适应平衡算法,飞行器通过高速水平机动即可在空中顶起细杆;即使受到外力拍打,也能迅速回弹复位并跟随手持指挥棒平稳巡航。与此形成鲜明对比的是运送水杯实验:机载算法完全未对水杯或液体进行建模,飞行器在大幅度机动下却能做到滴水不漏。D'Andrea解释称,这是由于飞行器侧向加速时机身倾斜,其推力与重力的合力方向始终垂直穿过杯底,切向剪切力几乎仅剩微弱的空气阻力。这证明深刻理解物理原理能让工程师明辨任务的难易,从而避免不必要的软件复杂度。 容错降级飞行与开环迭代学习 (6:14) 传统无人机理论普遍认为四轴飞行器是维持全自由度受控飞行的最小执行器配置,若失去螺旋桨往往会导致坠毁。然而,D'Andrea团队通过重新推演受损系统的数学模型,发现当飞行器被故意停用两只对角螺旋桨后,只需主动放弃对偏航角(yaw)的锁定并允许机身绕垂直轴持续自旋,剩余的两个螺旋桨便足以维持横滚、俯仰和垂直方向的加速度控制。这一优雅降级方案表明,借助深入的数学推演可以设计出高容错算法,在不增加电机、电池等机械冗余负荷的前提下赋予机器如运动员带伤作战般的韧性。 而在高速机动场景下,机器同样需要借鉴运动员的训练机制。当飞行器执行高速三周空翻(triple flip)并力求精准返回原点时,动作发生的速度远远超出了传感器到执行器的反馈延迟极限,导致传统闭环控制失效。为此,控制系统将整个空翻过程作为开环动作盲飞执行,并在动作完成后测量其终点状态与预定位置的误差,进而利用迭代学习算法在连续试飞中逐步修正前馈电机指令。正如跳水或跳马运动员通过反复加练以追求完美入水与落地,机器也能通过历次动作终点误差的数据回馈实现高精度空中特技。 高频轨迹重规划与多机协同竞技 (8:51) 在模拟对抗性球类运动时,D'Andrea为飞行器加装了击球甜点区仅有苹果大小的网球拍。为了迎击抛向空中的网球,系统以50Hz(即每20毫秒一次)的高频率运行轨迹重规划:视觉系统推算球的弹道,控制系统解算出击球所需的碰撞速度与球拍姿态,优化例程据此生成拦截轨迹;飞行器仅执行该轨迹最初的20毫秒指令,便立即丢弃后续规划并在下一周期重新解算,直至在极短时间内完成精准击打。这种以高频预测数学代替人类肌肉记忆与本能的机制,成功复现了运动员看似轻而易举的协调动作。 这种敏捷性进一步延伸至多机协同场景。在“天网”(sky net)实验中,三架四轴飞行器共同拉起一张弹性网,并在空中协同接住抛来的小球。随后,三机协同执行如同弹弓般的快速机动,在极度紧绷的状态下拉网垂直向高空加速,将球反弹发射出去。在最大加速度瞬间,三架飞行器的姿态完全垂直,机身承受的峰值重力加速度约为人类蹦极跳到底部反弹时所受加速度的五倍。该协作系统同样以每秒50次的频率实时重算协同策略,展示了分布式多智能体在高动态负载下的执行潜力。 人机交互融合与合成物理学的应用 (11:16) 在人机互动方面,团队将体感手势追踪设备接入飞行控制回路,使操作者能仅通过手臂与手势姿态在舞台上直接引导飞行器的空间位姿与机动轨迹,使算法成为弥合人类粗糙手势与机器锐利动作之间的纽带。除了视觉交互,控制系统还实现了触觉力控交互:当工程师直接抓取悬停的机体时,算法能利用动力学模型实时反推人手施加的外力。基于此前馈感知,系统可以人工改变飞行器的受控物理法则,例如将其设定为如同浸没在高黏度流体中,受到推挤时顺畅滑移、松手即止而不再剧烈抵抗,从而允许人员直接将其推移至合适机位作为录像支架。 在随后的互动游戏中,多架飞行器被编程设定为先模拟冥王星的低重力环境,随后环境重力参数逐步向地球标准加速度递增,研究人员必须在台上奋力拍击下坠的飞行器以使其维持在空中。D'Andrea援引生物学观点指出,动物界中“玩耍”的本质在于磨炼技能、发展能力以及维系群体联结;科研团队以体育与竞技为隐喻展开研究,其核心目的同样在于借助极致场景倒逼新算法的诞生,从而将机器的运动潜能推向物理极限。 D'Andrea在总结中指出,飞行器惊人的敏捷演进最终将引发关于机器速度如何重塑人类生活方式的深层思考。他强调,技术的双刃剑属性自古皆然,既可造福社会也可能遭致滥用;如何引导自主系统的发展轨道并非实验室内部的工程技术问题,而是全社会共同面临的伦理抉择,应当主动选择让人工智能与自主机器像体育竞技激发人类潜能一样,引领人类走向积极的未来。

Source quotes

[4:37] Raffaello D'Andrea: The lesson here is that some high-performance tasks are easier than others, and that understanding the physics of the problem tells you which ones are easy and which ones are hard [15:13] Raffaello D'Andrea: Let's make the right choice, the choice that brings out the best in the future of machines, just like athleticism in sports can bring out the best in us.

Original transcript

[0:00] Translator: Joseph Geni Reviewer: Morton Bast [0:23] So what does it mean for a machine to be athletic? [0:27] We will demonstrate the concept of machine athleticism [0:29] and the research to achieve it [0:31] with the help of these flying machines called quadrocopters, [0:34] or quads, for short. [0:38] Quads have been around for a long time. [0:40] They're so popular these days because they're mechanically simple. [0:44] By controlling the speeds of these four propellers, [0:46] these machines can roll, pitch, yaw, [0:49] and accelerate along their common orientation. [0:52] On board are also a battery, a computer, [0:55] various sensors and wireless radios. [0:59] Quads are extremely agile, but this agility comes at a cost. [1:03] They are inherently unstable, [1:05] and they need some form of automatic feedback control [1:08] in order to be able to fly. [1:16] So, how did it just do that? [1:19] Cameras on the ceiling and a laptop [1:21] serve as an indoor global positioning system. [1:24] It's used to locate objects in the space [1:26] that have these reflective markers on them. [1:28] This data is then sent to another laptop [1:30] that is running estimation and control algorithms, [1:32] which in turn sends commands to the quad, [1:34] which is also running estimation and control algorithms. [1:41] The bulk of our research is algorithms. [1:44] It's the magic that brings these machines to life. [1:48] So how does one design the algorithms that create a machine athlete? [1:52] We use something broadly called model-based design. [1:55] We first capture the physics [1:57] with a mathematical model of how the machines behave. [2:00] We then use a branch of mathematics called control theory [2:04] to analyze these models [2:06] and also to synthesize algorithms for controlling them. [2:09] For example, that's how we can make the quad hover. [2:12] We first captured the dynamics with a set of differential equations. [2:16] We then manipulate these equations with the help of control theory [2:19] to create algorithms that stabilize the quad. [2:23] Let me demonstrate the strength of this approach. [2:29] Suppose that we want this quad to not only hover [2:31] but to also balance this pole. [2:34] With a little bit of practice, [2:36] it's pretty straightforward for a human being to do this, [2:39] although we do have the advantage of having two feet on the ground [2:42] and the use of our very versatile hands. [2:44] It becomes a little bit more difficult [2:47] when I only have one foot on the ground [2:49] and when I don't use my hands. [2:52] Notice how this pole has a reflective marker on top, [2:55] which means that it can be located in the space. [3:04] (Audience) Oh! [3:05] (Applause) [3:09] (Applause ends) [3:11] You can notice that this quad is making fine adjustments [3:14] to keep the pole balanced. [3:16] How did we design the algorithms to do this? [3:19] We added the mathematical model of the pole [3:21] to that of the quad. [3:22] Once we have a model of the combined quad-pole system, [3:25] we can use control theory to create algorithms for controlling it. [3:30] Here, you see that it's stable, [3:32] and even if I give it little nudges, [3:34] it goes back -- [3:37] to the nice, balanced position. [3:40] We can also augment the model [3:41] to include where we want the quad to be in space. [3:44] Using this pointer, made out of reflective markers, [3:47] I can point to where I want the quad to be in space [3:49] a fixed distance away from me. [3:59] (Laughter) [4:07] The key to these acrobatic maneuvers is algorithms, [4:10] designed with the help of mathematical models [4:13] and control theory. [4:15] Let's tell the quad to come back here [4:17] and let the pole drop, [4:18] and I will next demonstrate the importance [4:21] of understanding physical models [4:23] and the workings of the physical world. [4:37] Notice how the quad lost altitude when I put this glass of water on it. [4:41] Unlike the balancing pole, [4:42] I did not include the mathematical model of the glass [4:45] in the system. [4:47] In fact, the system doesn't even know that the glass is there. [4:50] Like before, I could use the pointer to tell the quad [4:52] where I want it to be in space. [4:57] (Applause) [5:03] (Applause ends) [5:05] Okay, you should be asking yourself, [5:07] why doesn't the water fall out of the glass? [5:09] Two facts. [5:10] The first is that gravity acts on all objects in the same way. [5:15] The second is that the propellers [5:16] are all pointing in the same direction of the glass, pointing up. [5:20] You put these two things together, [5:22] the net result is that all side forces on the glass are small [5:25] and are mainly dominated by aerodynamic effects, [5:28] which at these speeds are negligible. [5:35] And that's why you don't need to model the glass. [5:37] It naturally doesn't spill, no matter what the quad does. [5:44] (Audience) Oh! [5:50] (Applause) [5:55] (Applause ends) [5:57] The lesson here [5:59] is that some high-performance tasks are easier than others, [6:03] and that understanding the physics of the problem [6:05] tells you which ones are easy and which ones are hard. [6:08] In this instance, carrying a glass of water is easy. [6:10] Balancing a pole is hard. [6:14] We've all heard stories of athletes performing feats while physically injured. [6:18] Can a machine also perform with extreme physical damage? [6:22] Conventional wisdom says [6:24] that you need at least four fixed motor propeller pairs in order to fly, [6:28] because there are four degrees of freedom to control: [6:30] roll, pitch, yaw and acceleration. [6:33] Hexacopters and octocopters, with six and eight propellers, [6:36] can provide redundancy, [6:37] but quadrocopters are much more popular [6:39] because they have the minimum number of fixed motor propeller pairs: four. [6:44] Or do they? [6:52] (Audience) Oh! [6:54] (Laughter) [7:01] If we analyze the mathematical model of this machine [7:04] with only two working propellers, [7:06] we discover that there's an unconventional way to fly it. [7:19] We relinquish control of yaw, [7:21] but roll, pitch and acceleration can still be controlled [7:24] with algorithms that exploit this new configuration. [7:33] Mathematical models tell us exactly when and why this is possible. [7:37] In this instance, this knowledge allows us to design [7:40] novel machine architectures [7:43] or to design clever algorithms that gracefully handle damage, [7:46] just like human athletes do, [7:48] instead of building machines with redundancy. [7:52] We can't help but hold our breath [7:54] when we watch a diver somersaulting into the water, [7:57] or when a vaulter is twisting in the air, [7:59] the ground fast approaching. [8:00] Will the diver be able to pull off a rip entry? [8:03] Will the vaulter stick the landing? [8:05] Suppose we want this quad here to perform a triple flip [8:08] and finish off at the exact same spot that it started. [8:11] This maneuver is going to happen so quickly [8:13] that we can't use position feedback to correct the motion during execution. [8:17] There simply isn't enough time. [8:19] Instead, what the quad can do is perform the maneuver blindly, [8:23] observe how it finishes the maneuver, [8:25] and then use that information to modify its behavior [8:28] so that the next flip is better. [8:30] Similar to the diver and the vaulter, [8:32] it is only through repeated practice [8:34] that the maneuver can be learned and executed [8:36] to the highest standard. [8:45] (Laughter) [8:46] (Applause) [8:51] Striking a moving ball is a necessary skill in many sports. [8:55] How do we make a machine do [8:56] what an athlete does seemingly without effort? [9:09] (Laughter) [9:16] (Applause) [9:20] (Applause ends) [9:22] This quad has a racket strapped onto its head [9:25] with a sweet spot roughly the size of an apple, so not too large. [9:29] The following calculations are made every 20 milliseconds, [9:31] or 50 times per second. [9:33] We first figure out where the ball is going. [9:36] We then next calculate how the quad should hit the ball [9:39] so that it flies to where it was thrown from. [9:41] Third, a trajectory is planned that carries the quad [9:46] from its current state to the impact point with the ball. [9:49] Fourth, we only execute 20 milliseconds' worth of that strategy. [9:53] Twenty milliseconds later, the whole process is repeated [9:56] until the quad strikes the ball. [10:07] (Applause) [10:10] Machines can not only perform dynamic maneuvers on their own, [10:13] they can do it collectively. [10:15] These three quads are cooperatively carrying a sky net. [10:27] (Applause) [10:32] (Applause ends) [10:33] They perform an extremely dynamic and collective maneuver [10:38] to launch the ball back to me. [10:40] Notice that, at full extension, these quads are vertical. [10:48] (Applause) [10:50] In fact, when fully extended, [10:52] this is roughly five times greater than what a bungee jumper feels [10:55] at the end of their launch. [11:03] The algorithms to do this are very similar [11:05] to what the single quad used to hit the ball back to me. [11:09] Mathematical models are used to continuously re-plan [11:11] a cooperative strategy 50 times per second. [11:16] Everything we have seen so far has been about the machines and their capabilities. [11:20] What happens when we couple this machine athleticism [11:23] with that of a human being? [11:25] What I have in front of me is a commercial gesture sensor [11:29] mainly used in gaming. [11:30] It can recognize what my various body parts [11:32] are doing in real time. [11:34] Similar to the pointer that I used earlier, [11:36] we can use this as inputs to the system. [11:39] We now have a natural way of interacting [11:41] with the raw athleticism of these quads with my gestures. [12:22] (Applause) [12:36] Interaction doesn't have to be virtual. [12:38] It can be physical. [12:39] Take this quad, for example. [12:41] It's trying to stay at a fixed point in space. [12:44] If I try to move it out of the way, it fights me, [12:48] and moves back to where it wants to be. [12:52] We can change this behavior, however. [12:55] We can use mathematical models [12:57] to estimate the force that I'm applying to the quad. [13:00] Once we know this force, we can also change the laws of physics, [13:03] as far as the quad is concerned, of course. [13:07] Here, the quad is behaving as if it were in a viscous fluid. [13:14] We now have an intimate way of interacting with a machine. [13:18] I will use this new capability to position [13:21] this camera-carrying quad to the appropriate location [13:23] for filming the remainder of this demonstration. [13:36] So we can physically interact with these quads [13:38] and we can change the laws of physics. [13:41] Let's have a little bit of fun with this. [13:43] For what you will see next, [13:44] these quads will initially behave as if they were on Pluto. [13:48] As time goes on, gravity will be increased [13:51] until we're all back on planet Earth, [13:53] but I assure you we won't get there. [13:55] Okay, here goes. [14:04] (Laughter) [14:34] (Laughter) [14:37] (Applause) [14:41] Whew! [14:47] You're all thinking now, [14:48] these guys are having way too much fun, [14:50] and you're probably also asking yourself, [14:52] why exactly are they building machine athletes? [14:56] Some conjecture that the role of play in the animal kingdom [14:59] is to hone skills and develop capabilities. [15:01] Others think that it has more of a social role, [15:03] that it's used to bind the group. [15:05] Similarly, we use the analogy of sports and athleticism [15:08] to create new algorithms for machines [15:11] to push them to their limits. [15:13] What impact will the speed of machines have on our way of life? [15:16] Like all our past creations and innovations, [15:19] they may be used to improve the human condition [15:22] or they may be misused and abused. [15:24] This is not a technical choice we are faced with; [15:26] it's a social one. [15:28] Let's make the right choice, [15:29] the choice that brings out the best in the future of machines, [15:32] just like athleticism in sports can bring out the best in us. [15:36] Let me introduce you to the wizards behind the green curtain. [15:39] They're the current members of the Flying Machine Arena research team. [15:42] (Applause) [15:47] Federico Augugliaro, Dario Brescianini, [15:49] Markus Hehn, Sergei Lupashin, Mark Muller and Robin Ritz. [15:53] Look out for them. They're destined for great things. [15:55] Thank you. [15:56] (Applause)