Toyota, AV Makers See Global Driverless Sales Capped at 25% by 2041
Ai4
Fragmented municipal regulations, lack of global lane infrastructure, and homologation barriers will restrict full vehicle autonomy to under a quarter of new car sales over the next 15 years.
## Background
Published on YouTube by Ai4 on August 22, 2026, 'The AI-Powered Vehicle: Smarter, Safer, and Fully Connected' features an industry panel discussing how artificial intelligence is redefining driver experiences, vehicle design, and fleet safety. The session convenes leaders from automotive OEMs and tech suppliers to examine how real-time sensor data and AI architectures are building the foundation for true vehicle autonomy.
## TL;DR
Moderated by Steve Greenfield of Automotive Ventures, the panel brings together executives from May Mobility, Tensor Auto, and Toyota Research Institute to discuss the technical and commercial deployment of automotive AI. The conversation explores multimodal on-device perception, hybrid reasoning architectures, and diffusion models in manufacturing, alongside human-centric systems like TRI's Driving Sensei. The panelists also examine operational realities, including Level 4 manufacturer liability, dynamic insurance pricing, and the transformation of dealership service bays into autonomous maintenance hubs. Concluding with a forward-looking wager, the speakers estimate that 10% to 25% of global passenger vehicles will achieve full autonomy within 15 years, citing regulatory fragmentation rather than technology as the primary bottleneck.
## Atmosphere & style
The session has an open, conversational, and highly interactive atmosphere, sparked by Greenfield's choice to invite spontaneous audience interjections from the start rather than saving questions for the end. Playful banter and friendly wagers keep the room engaged while panelists share candid technical details about edge-case handling, acoustic sensing, and foundation models. The dynamic balances startup agility with OEM pragmatism, resulting in a grounded yet forward-looking discussion on bridging the trust gap with the driving public.
## Key takeaways
- [00:48](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=48s) There is a 40-point public enthusiasm gap regarding AI, requiring automotive leaders like Toyota to build trust through dual-track strategies that blend internal R&D with external startup investments.
- [06:48](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=408s) The next frontier of automotive AI involves turning vehicles into agentic personal assistants and leveraging AI co-pilots like TRI's 'Driving Sensei' to coach human drivers rather than solely eliminating them.
- [13:30](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=810s) May Mobility achieved dramatic complexity gains in autonomous planning by combining offline learned models with online reasoning, needing only ~20,000 miles of driving data by learning from surrounding vehicles.
- [17:13](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=1033s) Tensor Auto addresses consumer privacy in Level 4 robocars by processing all biometric and multimodal natural language inputs locally on the vehicle's edge compute rather than streaming to the cloud.
- [18:55](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=1135s) Diffusion policies trained on just 60 to 100 human demonstrations allow manufacturing robots to learn physical assembly line workflows, a technology spun out into Walden Robotics.
- [21:56](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=1316s) Widespread autonomous vehicle fleets could reclaim 15% to 20% of urban land currently dedicated to parking lots and convert commutes into productive or hospitality-integrated travel time.
- [24:42](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=1482s) Commercial freight and highway trucking present one of the clearest near-term economic ROIs for autonomy through automated logistics and multi-truck platooning.
- [30:09](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=1809s) Vehicle-to-Everything (C-V2X) and mobile network integration are replacing slow-to-adopt dedicated V2V hardware to facilitate multi-agent intersection and hazard negotiation.
- [33:31](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=2011s) Dealership business models are shifting toward overnight autonomous self-servicing, AI-driven diagnostic triage, and doorstep sales walkthroughs initiated directly by the vehicle.
- [36:48](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=2208s) Level 4 liability models cleanly separate risk: manufacturers assume full liability and offer lower dynamic insurance pricing during autonomous operation, while drivers assume liability during manual mode.
- [40:06](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=2406s) To resolve non-deterministic AI edge cases, autonomy stacks run rapid multi-trajectory simulation 'tournaments,' choosing conservative deceleration or avoidance actions when outcome uncertainty spikes.
- [41:40](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=2500s) Acoustic perception—spanning external microphones to detect sirens and auditory monitoring of tire-road friction—serves as a vital sensory layer for Level 4 safety and dynamic vehicle stabilization.
- [44:54](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=2694s) Panelists predict that only 10% to 25% of global new vehicle sales will be fully autonomous in 15 years, citing regulatory fragmentation, roadway infrastructure disparities, and complex homologation processes as primary bottlenecks.
Moderator Steve Greenfield opens the session by welcoming the attendees tucked away in the far corner of the Palazzo. Acknowledging that they stuck around until the very end of the event, he decides to shake things up: instead of holding questions until the end, he invites the audience to raise their hands and jump in throughout the discussion. Steve emphasizes that the stage holds an exceptionally diverse set of perspectives across automotive autonomy, technology, and commercialization, spanning the world's largest automaker to disruptive startups.
[00:48](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=48s) Meet the Panelists: May Mobility, Tensor Auto, and Toyota Research Institute
Steve turns first to Jacob Crossman, Senior Vice President of Autonomy at May Mobility, following up on his keynote presentation from the previous session. Jacob oversees technical development at the Ann Arbor-based autonomous vehicle company. May Mobility operates in several cities—quipping about an abundance of "A" cities like Atlanta, Arlington, and Ann Arbor, alongside operations in Minneapolis. The company is actively partnering with major rideshare and mobility giants, including Uber, Lyft, and Grab (an early investor). On a day-to-day basis, Jacob focuses on mitigating operational risks while diving deep into AI architecture, specifically May Mobility's hybrid architecture that combines online reasoning with offline learned models.
Next, Steve introduces Amy Luca, Chief Marketing Officer at Tensor Auto, joking that she might hold more frequent flier miles than him as a United Airlines million-miler. Amy shares that Tensor Auto, roughly ten years old, was formerly known as AutoX. About a year prior, the company unveiled the Tensor Robocar, dubbed the world's first personal robocar, and is currently working to deploy it in Dubai despite regional geopolitical friction. The goal is to place the first privately owned autonomous vehicles in individual consumer garages by the end of the year. Amy highlights that the Tensor vehicle is built from the ground up rather than retrofitted, engineered as an embodied AI agent featuring natural language processing (NLP) and a sensor suite exceeding 100 sensors, including 5 LiDARs, 11 radars, and 22 cameras. As CMO of a lean, startup-minded outfit, Amy handles both marketing and the hands-on commercialization strategy.
Steve then welcomes Avinash Balachandran, Vice President at Toyota Research Institute (TRI), remarking on how hard it is to follow the sheer scale of the world's largest automaker by volume. Avinash explains that TRI functions as Toyota's advanced exploratory arm, established roughly ten years ago. While its early research focused on full self-driving—efforts that eventually spun off into Woven by Toyota for commercialization—TRI has broadened its mandate to include robotics, energy, materials, and human-machine collaboration. Avinash conducts advanced driving research focused not solely on replacing drivers, but on how intelligent physical AI systems can collaborate with people.
To illustrate the broader industry challenge, Avinash polls the audience on whether they feel excited or terrified by AI. He notes that while 57% of AI practitioners express overwhelming excitement, only 17% of the general public shares that enthusiasm. For a company like Toyota that sells over 11 million vehicles annually across the globe, bridging that 40-point trust gap is crucial. Because no single entity has all the answers, Toyota explores multiple parallel paths: TRI operates an internal venture fund that invests in companies like May Mobility, while simultaneously developing internal AI capabilities across engineering, design, manufacturing, sales, and warranty.
[06:48](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=408s) Priority AI Initiatives for the Next 6 to 12 Months
Steve asks the panelists to pinpoint their primary AI initiative over the coming 6 to 12 months. Jacob explains that May Mobility’s ultimate north star is expanding autonomous "drive-out" service to as many geographic domains as possible. AI sits at the center of their driving stack, combining transformer-based models and large language model (LLM) architectures with online reasoning. However, AI has also rapidly infiltrated their software development workflows. Jacob recounts an internal hackathon during "May Days" in Ann Arbor, where teams competed to build center-console games for their vehicles; the winning model was built entirely with AI tools by their chief of staff for communications—a non-engineer. Jacob notes how empowering it is to watch product and non-technical staff directly contribute functional code.
Amy outlines Tensor Auto's dual focus: aggressive commercialization alongside building intuitive, agentic AI features into the car. She contrasts their vision with existing Level 4 ride-hailing services like Waymo, where rider interaction is largely confined to rigid smartphone apps. Tensor envisions the vehicle as an ambient, embodied personal assistant that understands the user's daily life. For instance, the car can review daily calendars, analyze real-time traffic, text the passenger to wake up early because of congestion, and proactively suggest routing via Starbucks. Internally, multi-agent AI systems simultaneously manage core vehicle subsystems, such as power optimization, transforming the vehicle into an indispensable rolling companion.
Avinash structures TRI's roadmap into three core areas:
1. **Product integration:** Embedding intuitive agents and advanced autonomy directly into vehicles.
2. **Business process acceleration:** Using AI tools to condense the traditional vehicle engineering design cycle, as well as collaborating with teams from Toyota Motor North America to analyze warranty and recall data.
3. **Human amplification and agency:** Rather than focusing solely on removing the driver, TRI is pioneering systems that empower drivers. Avinash highlights project "Driving Sensei," an AI co-pilot designed to coach and train drivers over time. Given that motor vehicle crashes remain the leading cause of death among teenagers in the United States and globally, TRI believes AI can save lives by augmenting human skills and teaching safer habits, rather than simply stripping away human agency.
Steve humorously validates the need for Driving Sensei, remarking that after recently driving in Atlanta, he felt lucky to be alive considering the reckless driving risks he took in his younger years.
[13:30](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=810s) Breakthroughs and Accomplishments from the Past 18 to 24 Months
When Steve prompts the panel for their proudest granular achievements over the past 18 to 24 months, Jacob focuses on May Mobility's breakthrough in fusing LLM-inspired architectures into real-time autonomy. In 2023, May Mobility had an operational driving capability within limited operational design domains (ODDs), but AI was largely confined to perception rather than motion planning and policy generation. In short order, the team converted this into a hybrid system marrying offline learned policies with real-time online reasoning. Remarkably, this leap required only about 20,000 miles of driving data because the system learned not only from its own actions, but also by observing the behaviors of other vehicles tracked by its sensor suite. Combined with their existing reasoning engine, this approach yielded orders-of-magnitude improvements in the complexity of scenarios the vehicle could navigate.
For Tensor Auto, Amy points to two landmark achievements:
- **Clean-Sheet Hardware Design:** Six years after operating an experimental fleet of roughly 1,000 retrofitted robotaxis in China, founder Dr. Jianxiong Xiao returned to the United States to rebuild from scratch. The Tensor Robocar was designed using AI from the ground up around its sensor suite, eliminating blind spots entirely instead of tacking sensors onto existing vehicle chassis.
- **The Tensor World Foundation Model:** Tensor openly shares its foundational architecture on YouTube, detailing how it leverages real-world road footage paired with extensive synthetic edge-case simulation. This synthetic generation exposes the policy engine to far more rare edge cases than a human driver would encounter in a lifetime. Amy notes that because their Level 4 vehicle eliminates the steering wheel and pedals entirely, absolute passenger trust is paramount—making open safety validation and shared simulation models essential for widespread adoption.
Amy Luca emphasizes Tensor Auto's open-source mindset designed to build consumer trust and make autonomous vehicles safer. The Tensor vehicle is equipped with a massive perception array comprising over 100 sensors in total: 5 LiDARs, 11 radar units, 22 cameras, and more than 20 microphones, granting the vehicle a complete 360-degree awareness both outside and inside the cabin. This comprehensive sensing architecture underpins an agentic in-cabin experience that interprets multimodal natural language commands. For instance, an occupant can point at a window and say, "Roll that window down," or instruct the car to "turn left here" or "go to the front door of that building in the front, let me out, and park."
Addressing consumer data protection in Level 4 autonomous systems, Luca stresses that Tensor’s founder prioritized strict on-device data processing. Because the vehicle continuously records biometrics and interior audio, all processing takes place locally at the edge within the vehicle rather than streaming to the cloud. Luca draws an analogy to the privacy framework of an iPhone, where data stays siloed on the device unless explicitly permitted by the user, ensuring passenger privacy while maintaining natural language capability.
- **Total Sensor Complement**: Over 100 sensors across the vehicle.
- **Sensor Suite Breakdown**: 5 LiDAR units, 11 radar units, 22 cameras, and 20+ interior microphones.
- **Privacy Architecture**: Full local edge computing for biometric and voice data with zero mandatory cloud syncing.
- **Interior Controls**: Retractable, collapsible steering wheel and pedals allowing users to choose between driving or being driven.
[18:55](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=1135s) Diffusion Policies, Human-Centric AI in Manufacturing, and TRI's Spinout
Avinash Balachandran highlights seminal robotics research pioneered by the Toyota Research Institute (TRI) approximately 24 months earlier around diffusion policies. Serving as a foundation for vision-language-action (VLA) models, this approach applies the underlying generative mechanics behind large language models to physical robotics. By gathering a modest dataset of 60 to 100 teleoperated demonstrations from human operators, TRI demonstrated that robots could learn complex physical behaviors rapidly without explicit hand-crafted code, publishing these findings in a widely cited *Science Robotics* paper.
Rather than keeping the technology inside the lab, TRI adapted it directly into Toyota's manufacturing facilities with a focus on preserving human agency. Instead of using AI to teach humans, the workflow flipped the paradigm: human assembly line workers demonstrate ergonomically difficult or repetitive tasks to robotic assistants, delegating lower-level labor and freeing technicians for higher-value responsibilities. This technology was subsequently spun out into Walden Robotics, which went public and raised substantial capital to deploy physical AI at scale, beginning directly inside Toyota assembly plants. Balachandran notes that TRI is now investigating the next frontier: seamless, intuitive human-robot collaboration, comparing it to two people silently coordinating to move a heavy table across a room without explicit verbal communication.
- **Diffusion Policy Demonstration Scale**: Effective behavioral learning achieved with only 60 to 100 teleoperated runs.
- **Publication**: Seminal robotics paper published in *Science Robotics*.
- **Industrial Deployment**: Real-world trial deployments assisting factory operators with physically taxing manufacturing workflows.
- **Commercialization**: Spun out as Walden Robotics to scale factory integration across Toyota and broader industrial environments.
---
[21:56](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=1316s) Transforming Travel, Commutes, and Urban Real Estate
In response to a question from Jesse Brady of the American Hotel and Lodging Association regarding long-distance travel, the panel outlines how autonomous systems will restructure personal mobility and municipal footprints. Amy Luca argues that the most profound benefit of autonomous vehicles is reclaiming lost productivity and personal time during daily commutes, while also automating vehicle maintenance so that cars can independently travel to service centers for sensor recalibration overnight.
Jacob Crossman of May Mobility describes how autonomous fleets can fundamentally reshape urban planning. In cities like Ann Arbor, Michigan, an estimated 15% to 20% of the municipal land mass is currently dedicated to parking lots. Widespread on-demand autonomous fleets would eliminate the need for personal parking, allowing prime urban space to be converted into community parks, green spaces, and residential housing. Balachandran adds that autonomy transforms the journey into a destination in its own right, creating commercial synergies for the travel and hospitality sectors where in-cabin experiences seamlessly merge with lodging, dining, and recreation.
- **Urban Land Reclamation**: May Mobility estimates 15%–20% of urban real estate in cities like Ann Arbor is dedicated solely to parking structures and surface lots.
- **Automated Fleet Maintenance**: Edge-connected self-driving vehicles capable of autonomous nocturnal calibration and maintenance cycles.
- **Hospitality Integration**: In-transit connected environments linking vehicle infotainment directly with hotel and travel destinations.
---
[24:42](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=1482s) Autonomous Trucking: Long-Haul, Platooning, and Business Viability
Answering a question from Taylor, an operator at a Nebraska trucking firm, regarding whether material-transport heavy trucks are automating alongside passenger vehicles, the panel affirms that commercial freight automation is accelerating rapidly. Crossman notes that while May Mobility focuses on passenger shuttles and micro-transit, heavy commercial trucking has seen aggressive development due to a highly defined return on investment.
Balachandran explains that although Toyota does not sell heavy commercial trucks in the United States, commercial freight represents one of the strongest economic cases for autonomy. Highway freight routes exhibit fewer complex edge cases than dense city centers, and international markets—particularly in Europe—are demonstrating multi-truck autonomous platooning to dramatically reduce aerodynamic drag and fuel consumption. Beyond vehicle control, significant venture investment and technological development are pouring into autonomous fleet management and automated logistics distribution networks.
---
[26:17](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=1577s) Youth Mobility, Parental Trust, and Edge-Case Safety Regulations
Audience member Daniel shares that he made a wager when his daughter was 7 on whether she would need a driver's license by age 17; with her now 12, he asks about regulatory hurdles facing youth autonomy. Luca recalls showing the Tensor concept at Carmel's Quail Motorsport event, where a child admired the multi-screen, steering-wheel-free cockpit and hoped to own it at 16, prompting her to point out that age restrictions may no longer dictate vehicle ownership. In cities like San Francisco, parents are increasingly choosing autonomous ride-hailing over traditional human-driven rideshare for their teenagers, viewing the absence of a stranger behind the wheel as a major safety advantage.
Balachandran and Luca note that evolving regulatory frameworks will determine when and how minors travel alone. Recent regulatory rulings around robotaxis like Zoox restrict unattended transport for children under eight years old. Advanced in-cabin safety systems provide real-time parental monitoring and facial recognition lockouts that prevent children from opening doors at intersections or exiting the car before reaching authorized destinations like a relative's house or school. Luca notes that Tensor is launching its luxury autonomous platform in Dubai, where affluent families seek automated transport for children and pets, though she cautions regulators against overreacting to isolated edge cases.
- **Consumer Adoption**: Parents demonstrate a preference for autonomous ride-hailing over human-driven rideshares for unaccompanied minors.
- **Regulatory Precedent**: Autonomous passenger operations facing minimum-age stipulations (e.g., eight-year-old minimums for solo travel in select jurisdictions).
- **Cabin Edge-Case Safety**: Interior facial recognition prevents unauthorized exit at traffic stops and enables secure end-to-end guardian tracking.
- **Market Launch**: Tensor luxury consumer models launching in Dubai targeting family and domestic transport.
---
[30:09](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=1809s) V2V, V2X, and Multi-Agent Traffic Optimization
Addressing audience questions about multi-vehicle coordination to resolve traffic bottlenecks across competing automotive brands, Balachandran details the progress and persistent roadblocks in Vehicle-to-Vehicle (V2V) and Vehicle-to-Infrastructure (V2I) communication. A foundational application involves aggregating fleet hazard data—such as instantly broadcasting localized warnings when a lead car detects black ice on an off-ramp. A second application coordinates vehicle acceleration curves through urban corridors to eliminate stop-and-go waves at traffic signals.
The central barrier to traditional dedicated V2V hardware has been the "chicken-and-egg" network effect: early adopters realize minimal value until a critical mass of the global fleet is equipped with compatible transceivers. Consequently, the industry is transitioning toward Cellular Vehicle-to-Everything (C-V2X) and standard cellular networks. This allows vehicles to interface directly with pedestrian smartphones at intersections to predict crossing intent. Balachandran envisions a future multi-agent ecosystem where agentic AI models on cars, infrastructure, and mobile devices negotiate safe passage and optimal traffic flow dynamically.
[32:16](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=1936s) Impact on Automotive Dealerships and Fixed Operations
An audience member working in dealership software asks how emerging automotive AI and autonomy will impact retail dealerships in fixed operations, service, and maintenance across short, medium, and long horizons.
Balachandran explains that Toyota maintains close operational contact with its dealer network, which is actively pulling for AI integration to alleviate labor bottlenecks. In the near term, dealerships face intense friction in fixed operations—specifically service triage, diagnostics, predictive parts maintenance, and the administrative overhead of complex warranty claim processing. Automotive AI models are being applied directly to these operational pain points to streamline shop capacity, enhance warranty tracking, and reduce vehicle turnaround times.
[33:31](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=2011s) Dealerships, Overnight Service, and Autonomous Sales Demos
Avinash Balachandran opens with how artificial intelligence and physical robotics can transform dealership service bays. Rather than bolting AI piecemeal onto legacy processes, Toyota Research Institute approaches the problem by asking how the dealership workflow can be completely reimagined to amplify human technicians. Amy Luca emphasizes that Tensor Auto is not a direct-to-consumer brand and is actively working through dealer networks. Autonomy fundamentally upends the traditional service relationship: an owner may never need to set foot inside a dealership. Instead, the vehicle can independently drive itself in for routine maintenance, sensor calibration, and cleaning in the middle of the night while the customer sleeps, communicating directly with technicians about required repairs.
The sales model undergoes an equally radical shift. With a personal autonomous vehicle, the car can literally drive itself to a prospective buyer’s driveway, conduct its own walkthrough of interior features, and guide the customer through the buying process. While human connection remains critical from a marketing standpoint, dealers are no longer constrained by physical lot footprints or geographic boundaries. Amy notes she will be addressing these exact paradigm shifts—around evolving owner experience and dealership commercial models—at the upcoming California New Car Dealers Association event.
Jacob Crossman highlights that May Mobility approaches maintenance from a fleet perspective rather than through consumer dealerships. Because autonomous vehicles combine mechanical components with intricate compute and sensor stacks that require regular calibration and maintenance, May Mobility relies heavily on ecosystem partnerships with fleet managers and specialized service providers. Avinash chimes in to point out that AI also unlocks previously untapped revenue streams for dealers, particularly through AI-driven personalization and aftermarket customization options.
- Dealership workflows are being reimagined with physical AI systems and robotics to amplify human labor rather than replacing it with piecemeal software add-ons.
- Tensor vehicles can self-deliver to service facilities overnight and conduct remote, doorstep sales demonstrations for prospective car buyers.
- May Mobility outsources fleet upkeep and complex sensor/AI calibration to dedicated fleet management partners.
- AI personalization creates high-margin aftermarket sales opportunities for automotive dealership networks.
---
[36:48](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=2208s) Level 4 Liability and Dynamic Insurance Pricing
An audience member asks how liability will be apportioned when a Level 4 autonomous vehicle causes a crash: will legal responsibility fall on the vehicle owner or the manufacturer? Amy Luca explains that Tensor Auto partners directly with Marsh to establish clear liability boundaries. When a Tensor robocar operates in Level 4 autonomous mode, the human passenger has zero operational control and therefore carries zero liability; Tensor absorbs full responsibility for any incident. Conversely, when the vehicle is operated in lower modes such as Level 2, the licensed human driver remains fully liable. To make this operational divide unambiguous, the steering wheel and pedals are absent or retracted during Level 4 operation and only deployed when human driving is required.
This clear distinction enables dynamic insurance pricing. Because onboard vehicle computers track every mile traveled, underwriters can precisely split a customer’s monthly mileage between manufacturer-assumed Level 4 autonomous travel and human-driven travel. Miles driven under Level 4 autonomy are anticipated to be significantly cheaper to insure because the autonomous software is dramatically less crash-prone than human operators. Jacob Crossman confirms that May Mobility collaborates closely with insurance partners to share operational safety data, though the regulatory and underwriting framework remains an evolving landscape across the commercial sector.
[40:06](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=2406s) Non-Deterministic AI and Tactical "Tournaments"
A question from the audience raises the challenge of managing non-deterministic AI decisions in volatile driving environments, such as reacting to rapidly changing traffic lights. Jacob Crossman describes how driving frequently introduces sudden bursts of uncertainty where an autonomous vehicle must evaluate ambiguous sensor signals. Humans handle these edge cases by mentally simulating multiple hypothetical outcomes in split seconds and erring on the side of caution.
May Mobility mirrors this cognitive process by having its inference system generate competing trajectory options and running an on-the-fly simulation—what Jacob describes as an internal "tournament" to see which path wins. In moments of heightened uncertainty where projected outcomes diverge sharply, the planner automatically selects conservative actions: shedding speed or veering slightly away from potential conflict zones. Once the burst of ambiguity clears within a fraction of a second, the state space collapses back into high certainty, allowing the vehicle to resume standard driving behavior in a natural, human-like cadence.
---
[41:40](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=2500s) Acoustic Sensing: From Emergency Sirens to Tire Skid Dynamics
An audience member named Matt expresses concern over whether autonomous vehicles have sufficient external auditory sensing. Pointing to San Francisco’s municipal emergency siren tests every Tuesday at noon, he poses an edge case: how would a robocar respond if public outdoor loudspeakers suddenly blasted an earthquake or tsunami evacuation alert on an otherwise empty street? Amy Luca clarifies that Tensor vehicles feature an extensive array of external microphones alongside cabin microphones. External audio inputs allow the vehicle’s AI to detect and localize emergency vehicle sirens long before human passengers can hear them. For bizarre edge cases like an acoustic civil defense siren, the vehicle combines acoustic recognition with real-time 5G cloud connectivity and multimodal context checking rather than relying on brittle rule-based triggers.
Avinash Balachandran reinforces the broader value of acoustic perception for driving safety. Skilled human drivers rely heavily on auditory feedback—such as the subtle friction sound of tires losing traction on ice, snow, or during sharp emergency lane changes. Toyota Research Institute has actively researched integrating tire and road surface audio data into dynamic chassis control models to stabilize vehicles at their physical handling limits. Panelists agree that comprehensive autonomy requires the system to utilize every available sensory modality, mirroring the holistic perceptual awareness of expert human drivers.
---
[44:54](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=2694s) The 15-Year Horizon: Predicting Global Autonomous Adoption
Steve Greenfield wraps up the session by placing a friendly $100 wager on each panelist, demanding a single forecast number: out of roughly 90 million new passenger vehicles sold worldwide each year, what percentage will be fully autonomous 15 years from now? The panelists hesitate, prompting banter from Greenfield as they attempt to qualify their reasoning before committing to a figure.
Jacob Crossman estimates 25%, predicting commercial freight, logistics, and delivery fleets will lead the transition because eliminating driver overhead yields immediate economic ROI. Avinash Balachandran takes a more conservative stance, estimating under 20%. He notes that Toyota operates globally across markets that lack basic infrastructure and lane discipline, environments where autonomous stacks cannot reliably function. Amy Luca initially suggests 20% to 25% before recalibrating downwards toward 10%. She stresses that technological feasibility will not be the primary bottleneck in 15 years; rather, fragmented municipal regulations, national vehicle homologation requirements, and bureaucratic red tape will severely slow global deployment. Waymo has paved the legal pathway, but navigating validation across disparate jurisdictions remains an exhaustive challenge for OEMs and autonomous startups alike.
- **Jacob Crossman (May Mobility):** Forecasts 25% global adoption, propelled by delivery, logistics, and high-utilization commercial transport.
- **Avinash Balachandran (Toyota Research Institute):** Forecasts under 20%, citing global roadway variations and regions lacking basic lane discipline.
- **Amy Luca (Tensor Auto):** Forecasts approximately 10% (adjusting down from an initial 20–25%), identifying fragmented international homologation standards and regulatory approval bottlenecks as the true limiting factors over the next 15 years.
## Notable quotes
> [17:13](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=1033s) Roll that window down — Amy Luca
> [17:13](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=1033s) turn left here — Amy Luca
> [17:13](https://www.youtube.com/watch?v=eLgm-nWKdMU&t=1033s) go to the front door of that building in the front, let me out, and park. — Amy Luca
## Mentioned
Steve Greenfield, Automotive Ventures, Avinash Balachandran, Toyota Research Institute, Amy Luca, Tensor Auto, AutoX, Jacob Crossman, May Mobility, Uber, Lyft, Grab, Woven by Toyota, Toyota Motor North America, Tensor Robocar, Dr. Jianxiong Xiao, Tensor World Foundation Model, Science Robotics, Walden Robotics, Jesse Brady, American Hotel and Lodging Association, Zoox, Waymo, Marsh, California New Car Dealers Association, Matt
## Video description
Steve Greenfield - General Partner, Automotive Ventures
Avinash Balachandran - Vice President, Toyota Research Institute
Amy Luca - CMO, Tensor Auto
Jacob Crossman - Sr. VP of Autonomy, May Mobility
Vehicles are rapidly becoming intelligent edge devices. In this panel, experts from top automotive OEMs and suppliers discuss how AI is redefining everything from driver experience to fleet safety. We'll look at how data from cameras, sensors, and ECUs is being turned into real-time insights and how AI is shortening design cycles, improving safety, and laying the groundwork for true autonomy. Join this panel to see the future of the AI powered automotive industry!
Autonomous vehicle developers are transitioning from rigid automation toward multimodal, human-collaborative artificial intelligence, seeking to bridge a steep public trust gap while navigating commercial integration, dynamic liability models, and uneven global infrastructure.
Hybrid Reasoning and Multimodal Edge Perception (13:30)
Autonomy stacks are moving away from brittle, rules-based programming toward hybrid architectures that pair offline learned models with real-time online reasoning. Jacob Crossman explains that May Mobility expanded its driving capabilities using only 20,000 miles of training data by designing models that learn from observing surrounding vehicles, resolving split-second uncertainty through on-the-fly simulation 'tournaments' that default to cautious maneuvers. At the physical layer, Toyota Research Institute (TRI) adapted generative diffusion policies from large language models to robotics, mastering complex manipulation tasks with only 60 to 100 human demonstrations—a breakthrough published in Science Robotics and commercialized through spinout Walden Robotics.
Perception hardware is similarly diversifying beyond standard computer vision. Tensor Auto engineered a purpose-built robocar featuring over 100 sensors—including 5 LiDARs, 11 radars, 22 cameras, and over 20 microphones—to capture environmental context like emergency sirens and acoustic tire friction. To protect consumer biometrics and voice interactions, Tensor executes all natural language and biometric processing locally on vehicle edge processors rather than the cloud. Avinash Balachandran notes that integrating auditory friction data directly into dynamic chassis control allows vehicles to maintain control at their physical handling limits, mirroring expert human driving.
Bridging Public Mistrust and Augmenting Drivers (6:48)
A critical barrier to autonomous adoption is public hesitation. Balachandran cites survey data revealing a 40-point trust deficit: while 57% of AI practitioners report excitement about AI, only 17% of the general public shares that view. To build trust, TRI prioritizes human-machine collaboration over outright driver replacement. Its 'Driving Sensei' initiative develops AI co-pilots that actively coach motorists, targeting vehicle crashes as the leading cause of death among teenagers globally by augmenting human competence rather than removing agency.
Generational adoption is also reshaping passenger safety standards. Amy Luca notes that parents in cities like San Francisco increasingly favor autonomous ride-hailing over human-driven rideshare for unaccompanied minors to avoid placing children with strangers. Manufacturers are addressing this segment with edge-case controls, such as interior facial recognition lockouts that prevent children from exiting at intersections before reaching authorized drop-off points, while adapting to emerging municipal frameworks that restrict solo travel for children under eight.
Reimagining Dealerships, Fleets, and Urban Land (21:56)
Autonomy is poised to disrupt retail distribution networks and municipal infrastructure. Rather than bypassing franchise dealerships, Tensor Auto operates within dealer channels to automate service cycles: vehicles can independently drive themselves to dealership bays overnight for sensor calibration and maintenance. Dealerships can also dispatch autonomous vehicles to prospective buyers' driveways for self-guided sales demonstrations, removing geographic lot limitations. For shared passenger transport, May Mobility relies on specialized fleet management partnerships to maintain complex compute and sensor stacks.
At the municipal scale, shared autonomous fleets could transform urban land allocation. Crossman notes that between 15% and 20% of urban real estate in cities like Ann Arbor is dedicated to parking; widespread on-demand transit could repurpose these spaces for green areas and housing. Concurrently, commercial freight is automating rapidly due to clear economic returns, with European freight operators deploying autonomous multi-truck platooning on highways to reduce aerodynamic drag and fuel consumption.
Operational Liability and Dynamic Insurance Pricing (36:48)
Commercial deployment requires establishing unambiguous legal liability when autonomous systems fail. Luca explains that Tensor Auto and insurance broker Marsh separate responsibility by operational mode: during Level 4 autonomous travel—where pedals and steering wheels retract or are absent—passengers carry zero operational control, and Tensor absorbs 100% of vehicle liability. Conversely, when a user engages manual or Level 2 driving controls, legal liability returns entirely to the human driver.
This division facilitates dynamic, usage-based insurance underwriting. Because onboard vehicle computers log operational states mile by mile, insurers can split monthly premiums between manufacturer-backed autonomous miles and driver-operated miles. Luca anticipates that Level 4 miles will be substantially cheaper to insure due to lower software accident rates compared to human error, creating economic incentives for autonomous transit while industry players continue sharing safety data to guide underwriting standards.
Looking ahead 15 years, panelists anticipate that fully autonomous vehicles will represent a modest share of the 90 million passenger vehicles sold annually worldwide—ranging from Amy Luca's conservative forecast of 10% to Avinash Balachandran's projection of under 20% and Jacob Crossman's 25%. The panel concludes that technological readiness is no longer the primary hurdle; instead, fragmented municipal regulations, disparate international homologation requirements, and regions lacking baseline roadway infrastructure will dictate the speed of global deployment.
[17:13] Amy Luca: Roll that window down
[17:13] Amy Luca: turn left here
[17:13] Amy Luca: go to the front door of that building in the front, let me out, and park.
[6:48] Avinash Balachandran: Driving Sensei
[40:06] Jacob Crossman: tournament
[6:48] Jacob Crossman: drive-out
[6:48] Jacob Crossman: May Days
[0:48] Amy Luca: Tensor Robocar
[30:09] Avinash Balachandran: chicken-and-egg
Original transcript
[0:04] We're going to do things a little different. Since
you found us in the far corner of the palazzo here
[0:10] and you stuck around to the very end, we'll take
questions throughout. Right? Don't start right
[0:15] now. I got a little bit of a preamble to do. But
if you if you have questions, there's a reason why
[0:20] you're in the room today. If you have questions,
raise your hand. I'll I'll watch the audience here
[0:24] and uh we'll take questions throughout. So,
um, let's do that and we'll get started. So,
[0:30] um, spend a little time introducing yourself, your
company, and your role a little bit. You know,
[0:35] I had a chance to talk to all of you ahead of
time and like we've got good good diversity up
[0:39] here in terms of what they're actually working
on, different philosophies around um um autonomy
[0:45] and technology uh in general. But maybe Jacob,
start with you. For those that were here on the
[0:49] last session, you were the keynote, so thank you
for that. He had some cool videos. If you missed
[0:54] his videos, he had some great videos. talk a
little bit about your role May and uh what you
[0:59] work on day-to-day. Uh sure. My role I'm a senior
vice president of autonomy. I lead the technology
[1:04] development at May. May is an autonomous vehicle
company based out of Ann Arbor and we're deployed
[1:10] in several cities. Um most notably uh uh uh
sorry Atlanta, Arlington, a lot of A's. We we
[1:18] also drive around in Ann Arbor around our our uh
headquarters in Minneapolis. So we're partnered
[1:23] with uh a lot of uh of the people that you would
know Lyft Uber uh recently we announced a deal
[1:29] with Chowochow uh as well as Grab who is a
uh investor in May. So terms of day-to-day
[1:36] um I lead all the technological development uh at
my role as you can probably imagine uh mostly I
[1:41] deal with problems coming up uh risks etc. But
what I really like to do is to dig into the AI
[1:47] technologies. uh we have a unique technology
I just talked about in the previous uh session
[1:51] uh where we combine online reasoning with offline
uh learning uh and that's fascinating and kind of
[1:57] diving into how that can help us scale our uh our
autonomy. Very cool. Thank you. Um Amy may have
[2:04] more air miles than me which is pretty awesome or
not depending on who you are but I'm a United dog
[2:11] waiting for you at home. I believe I'm a million
mileer. Yes. Yeah. Yeah. Yeah. U Amy Luca. I'm the
[2:16] chief marketing officer for Tensor Auto. Uh you
may have heard of us. Uh we're about 10-year-old
[2:21] company. You may have heard of our previous name,
which was Auto X. Um and we launched uh last year,
[2:27] almost uh a year ago exactly, the world's first
personal robo car. Um the Tensor Robocar. And
[2:34] we are in the middle right now of deploying in
Dubai. uh little challenging at the moment for
[2:40] for geopolitical reasons but uh hopefully uh
you'll be hearing about uh the first personal
[2:47] robocars in someone individual garage by the end
of this year. Uh we are focused around the idea of
[2:56] uh a fully autonomous and AI agentic vehicle.
So we have natural language processing. You can
[3:02] talk to the car as if it's a human being to give
it commands. Um, and it is built from the ground
[3:07] up. So there's no retrofit. Um, it actually has
a lot of AI design in it. Um, over 100 sensors
[3:14] including five LAR, 11 radar, um, 22 cameras, um,
lots of other technology on board as well. And,
[3:22] uh, yeah, hopefully you'll have your own roboc
soon. And your role and your responsibilities.
[3:27] I am the chief marketing officer. So I
handle a lot of obviously the marketing,
[3:31] but also commercialization. Uh we are a small and
mighty startup-minded company still so we have
[3:36] a lot of hands- on deck uh when it comes to the
commercialization aspect of the brand. Uh so yeah
[3:42] that's my my role. Avan you work for the largest
automaker on earth you know that that's hard to
[3:51] follow. Uh but yes Toyota is the largest automaker
in the world by by volume. My name is Avvin uh and
[3:56] I work at the Toyota Research Institute. So we
are the part of Toyota that's really looking at
[4:01] the at the future and trying to figure out what's
next for Toyota. So we've been around for about 10
[4:05] years and so 10 years ago we were actually working
on full self-driving kind of technologies. That
[4:10] was the main focus of our research efforts. Since
then you know we've evolved that that part of of
[4:15] TRRI has spun off into woven by Toyota. That's
commercializing that efforts. Uh we've started
[4:21] doing a lot more work in robotics in energy and
materials in all kinds of different areas trying
[4:26] to figure out what's next. So that's TRI's role
and I'm a vice president in there. I I basically
[4:32] uh continue our advanced driving research. So
these are things beyond sort of full self-driving
[4:37] and I'll be excited to talk more about that in as
this panel progresses but really around ideas of
[4:42] how do we have people and these intelligent uh
physical uh AI systems whether they be cars or
[4:48] robots collaborate and work more closely together.
So I have teams working in the automotive space as
[4:53] well as in sort of robotics uh and and doing that
kind of stuff. And so kind of just to maybe zoom
[4:58] out and give you a little bit of context about
Toyota uh and how we think about this uh I guess
[5:03] you know maybe just as a general raise of hands
here how many people are super excited about AI
[5:08] and and its applications in the world today and
how many people are are very terrified of this
[5:15] and so you see there's a mix here and actually
if you look at statistics in the US about 57% of
[5:21] AI practitioners are super excited and about 17%
of the actual public is super excited. 17 or 7D
[5:28] 17 17. So there's this gap, right? And Toyota is
a company that sells roughly, you know, over 11
[5:33] million cars a year all over the world. And we're
really concerned about this gap. How do we build
[5:37] products that work for everyone? And so in order
to do that, uh, we actually believe that there's
[5:42] nobody really knows the answer. And the thing that
we can do is try as many different pathways as
[5:47] possible through as many different means. And as
a specific example, within TRRI, we have a venture
[5:52] fund. that fund invests in companies including May
mobility which is one of our portfolio companies
[5:57] and helps us explore with them this opportunity
that they they're doing internally we're looking
[6:01] at developments around using AI to really amplify
the person and using that both in the vehicle as
[6:07] well as more holistically across the automotive
process from engineering design manufacturing
[6:13] sales warranty etc. So, we've got um a good
diverse uh perspective up here. You've got
[6:19] the largest automaker in the world and their
perspective on autonomy. We've got Tensor who
[6:24] wants to democratize ownership. We're all going
to own fully autonomous vehicles that will take
[6:28] us around, but then at night they're going to go
into the Uber fleet and generate revenue for us
[6:32] overall. And then we've got May over here who
in the short term is testing AVs on the roads.
[6:37] But long term, I'm assuming if I ask Jacob,
probably more of a software technology play.
[6:43] um getting their technology within other
automakers maybe Toyota auto or not. So um we're
[6:49] at an AI conference. So my qu first question I
guess is um you know what's top of mind for you in
[6:55] terms of initiative? So over the next like 6 to 12
months what's the number one AI based initiative
[7:01] that your company has? And Jacob maybe I'll start
with you. Sure. Um our our goal really is is drive
[7:08] route in as many places as we can. So we we focus
our attention on the things that make that happen.
[7:14] AI is a critical piece of this, not only in our
stack. AI is central to the stack, both the things
[7:19] that most people think of as AI, uh the learned
models, uh from, you know, transformer-based
[7:24] things, things based off of LLMs, as well as our
online reasoning capabilities. Um we're also,
[7:29] uh beginning to use AI processes a lot more in
terms of actually developing the software. Um,
[7:35] one really cool thing, slightly tangential, but
um, we had our May days, which is when we all get
[7:40] together for a few days and, uh, at May in Ann
Arbor, and we had a little competition where,
[7:46] um, we we were going to build a new game that you
could play in the center console for our cars. And
[7:54] in the team that I was on, it was actually our
chief of communications or our chief of staff
[7:59] for communications who actually built that
model using AI. she built the actual game and
[8:06] I thought that was really really cool. So this
is really opening up new possibilities to have
[8:09] maybe people in product and other roles that maybe
haven't traditionally been able to add to our our
[8:15] uh our uh tools and to our capabilities the
ability to start directly contributing. So
[8:21] uh that's been interesting as well. So AI is at
the center of how the car drives and it always has
[8:26] been and now we're beginning to bring uh AI into
how we develop the software for the car. Cool.
[8:31] Amy, same question for you. I think right now
we're we're headlong into the commercialization
[8:38] part of our business. Um, but I think the focus
from an AI perspective is really around the
[8:42] agentic features of the vehicle and building out
more of those so they're intuitive. I think when
[8:48] you earn a Whimo or you're any in any sort of a
level four car right now, a lot of it is based
[8:53] on an app or you know it's it's input. it's not
natural language talking to the car or having that
[8:59] car really understand from an agentic perspective
your life um and how it can help you and be more
[9:06] of a personal assistance. So we think of that
technology of how do we build AITIC systems
[9:11] within the car that are actually more than just a
point A to point B but actually helping you with
[9:15] your daily life. Um a lot of our technology
right now is focused on how does it integrate
[9:20] with other applications uh say on your phone.
So for instance um in the morning your tensor
[9:28] could text you and say you have a meeting at this
time traffic conditions are this you know a little
[9:34] heavier wake up wake up we got to go earlier we
got to go earlier and hey by the way do you want
[9:39] to stop at Starbucks on the way there we'll plan
that into your day so if you think about that as
[9:43] like your personal assistant and that's really
what we're trying to to build um a robo car to
[9:48] be more than just a point A to point B. So a lot
of our technology innovation is really around
[9:54] um how do we make this rolling personal assistant
uh to be indispensable to your daily life more
[9:59] than a vehicle and actually we were talking
about it earlier in this conference. I almost
[10:03] think like talking about autonomous vehicles is
almost not enough. It's really embodied AI and
[10:10] these AI agents that are going to be helping to um
do more than just manage your life but also like
[10:17] in our car for instance it manages power systems.
you know those different there's different agents
[10:22] that are playing different roles within the
vehicle at any given time. Um but yeah that's
[10:26] what we're working on. Average TRRI's priority.
Yeah. So I think um there's kind of three parts to
[10:32] this this answer that I'll give. One is you know
like many of the panelists here I think there's
[10:36] various ways we're thinking about how we can use
AI in the business and that's kind of twofold.
[10:40] One is the most obvious. How do we integrate
it into our products that we have integrate
[10:44] you know agents autonomy other features more
directly into the vehicle make it more seamless.
[10:50] uh and and these are things that we're working on
right now. The second one is how do we incorporate
[10:55] it into our business processes uh and you
know examples of that you know we see in our
[10:59] design process we're looking at using AI tools to
accelerate and condense the vehicle engineering
[11:04] cycle so that that can be done a lot faster. We
actually have a team right here from Toyota Moans
[11:09] North America Muhammad and team that are looking
at using AI for warranty and recall information
[11:14] and so just everywhere across the business we're
asking ourel hey can we make use AI in a way that
[11:19] makes this this business more efficient uh but
sort of sort of zooming out you know we're what
[11:24] we're really thinking about here is in the age
of AI as you think more deeply about it the real
[11:30] kind of challenge is in human agency autonomy
and purpose and how do we build AI initiatives
[11:37] that empower those things. And so to give you a
specific example, as we think about autonomy in
[11:42] cars, you know, a lot of the discussion is around
pulling the driver out and there are lots of good
[11:46] reasons and use cases for where that's uh useful.
Uh but as a company that sells 11 million cars
[11:51] all over the world, uh most of our consumers are
in places where this access to this technology
[11:56] doesn't exist. But we do want to provide them
the benefits of this technology as soon as we
[12:00] can. So cars can be safer, uh more enjoyable.
And so one of the metrics we're looking at,
[12:05] one of the paradigms we're looking at is instead
of thinking about just AI sort of replacing
[12:09] the driver, is there a way that we can use AI to
amplify the driver? And we're looking specifically
[12:14] at this idea of teaching the driver. So imagine
that we are building really performant AI systems
[12:19] that can drive super well. Is there a way that we
can use that uh and we call this project driving
[12:23] sense to teach, for example, teenage drivers
to get better with driving over time. So, I
[12:28] don't know how many of you have teenage kids, but
certainly I'm sure you worry about them getting
[12:32] their driver's licenses. And unfortunately,
in the US, as in many parts of the world,
[12:36] car accidents are the leading cause of death of
teenagers. And so, can we use AI and these these
[12:41] AI systems not just purely from a way of removing
uh agency from the human and and taking over the
[12:47] driving task? Are there ways we can augment it in
places where that that kind of capability doesn't
[12:51] exist? It's interesting. In the last like 3 days,
I was driving somewhere in Atlanta. I was like,
[12:57] I shouldn't really be alive. The risks
that I've taken driving over the years,
[13:02] especially when I was younger, I mean, just take
undo risks, right? So, it would be great if the
[13:06] cars could protect the drivers from doing
stupid things because as males specifically,
[13:11] we do a lot of stupid things when we're young. So,
I think that's that's pretty exciting. So, let's
[13:15] transition to the third question I would have
here, which is um I guess what are you proudest
[13:21] of or what stands out? If you look back over the
last 18 months, two years, some AI initiative
[13:26] within the company that's really stood out and
the more granular you can be for the audience,
[13:30] the better. But the example, the granularity,
what did it achieve and why are you proud of that?
[13:38] So um for us the last two years uh have been about
how to take the newest learnings uh uh that we see
[13:46] in AI the large language models etc and how to
adapt them to cars and um we had a drive route
[13:54] capability uh in 2023 worked in smaller domains
uh it was pretty exciting uh it was primarily
[14:01] it did it did have some AI capabilities in the
perception system but not necessarily in the the
[14:06] driving components, the policy generation,
etc. And we were able to very very rapidly
[14:12] uh convert that to a hybrid system that we use
today, uh which uses both capabilities. And we
[14:17] were really surprised at how fast we were able to
get that system to work. Uh and really the secret
[14:23] of that was that we we learned on about 20,000
mi of driving. Uh we we did some really clever
[14:29] things. We didn't just learn by what our car did,
we also learned by the other cars that our sensors
[14:33] picked up. So, we were able to learn from that. Uh
but when with that very little amount of driving
[14:38] because we already had this robust decision-making
engine, we were able to get literally uh orders
[14:45] of magnitude improvements on the the complexity we
could drive in and the situations we could handle.
[14:49] Um and it all happened very very fast. And uh as
as the leader of all the engineers, I was quite
[14:54] proud of the team for uh what they were able to
accomplish doing that. Um, and it's just setting
[14:59] the stage for uh the next year, which where we've
got many more advances uh in in uh in line for
[15:04] that. And I think we're going to we're going
to have another couple of orders of magnitude
[15:07] improvement as well. Nice. Thanks, Jacob. Maybe I
mean, I think there are a couple things. I mean,
[15:12] for us, it was a huge achievement to launch our
car last year. We went stealth six years ago
[15:18] um after doing robo taxis in China. We had about a
thousand robo taxis, retrofitted cars um in China.
[15:24] and our founder came back to the United States
and said, "Okay, let's start from scratch." Um,
[15:29] so we used AI in a lot of the design process for
what the Tensor Robocar looks like. And I think
[15:34] it's one of the things that people don't realize
when they look at the car that the car is actually
[15:38] designed around the sensor suite, not the sensor
suite put onto a car. Um, and people say, why does
[15:43] the car look that way? And so I think one of the
things that our engineers are really proud of is
[15:46] how they've used AI in that design process to make
a car that really um has no blind spots. I think
[15:55] the other thing too is we our world foundational
model similar to u what you're talking about with
[16:00] your model was taking lots of and by the way
you can see all about our our founder believes
[16:05] in sharing everything with the world. So our
tensor foundational model is actually on our
[16:10] YouTube channel explains what it is. Um but it
was really around the idea that we can take these
[16:16] um clips of um real road activity, real road
cases and augment that with a lot of synthetic
[16:24] um scenarios so that we can actually have every
single edge case, not every but like you know lots
[16:29] and lots of edge cases way more than any human
driver will ever inter uh interact with. um and
[16:36] kind of continually building that model and just
similar to what you said like learning from others
[16:41] um being able to make these cars as safe as
possible because the biggest factor in level
[16:47] four autonomy for consumers and I think you
talked about you know are we fearful of AI
[16:52] well people are really fearful of giving their
life to a car and our car in level four has no
[16:57] steering wheel so when there's no steering wheel
and there's no pedals in level four you're really
[17:02] trusting a vehicle uh and so all of those um AI
simulation models. Um sharing that with the world,
[17:10] helping other companies and learning from
other companies, I think is going to just
[17:13] um you know, we're really proud of of that sort
of open-source mindset that we have in our company
[17:19] uh to hopefully make cars um safer and more
trusted by the people that will eventually own
[17:24] them. If you haven't Googled tensor, the tensor
car, Google the tensor car and take a look at
[17:30] it. How many sensors on the car total? It's over
100. um five LAR, 11 radar, 22 cameras um of think
[17:38] over 20 microphones. So the car literally um you
know is looking seeing everywhere all at once and
[17:46] inside. So for it to be an AIC vehicle that has
uh can listen to your voice for instance you can
[17:53] point to the window and say roll that window down
and it will roll that window down or turn left
[17:58] here or go to the front door of that building you
know in the front and and let me out and park. So,
[18:04] it does understand natural language. And by the
way, I know it sounds crazy, but as the marketing
[18:08] person, they actually let me play with it and it's
pretty amazing. And I every time I have to drive
[18:14] long distances, I'm like, why can't we have this
now? Um, but yeah, it's it's it's very rich from a
[18:19] sensor suite perspective. And I think the other
thing that our founder really believed in was
[18:23] privacy because one of the other factors when you
have a level four vehicle and all of these sensors
[18:29] and taking all this biometrics and listening to
everything you have to say is is it private? And
[18:33] so actually all of our processing happens um in
the car. So we're not connected to a cloud for any
[18:39] of your biometrics and nothing is shared. So think
about it like an iPhone. Um, lots of data goes in
[18:44] your iPhone, but Apple doesn't necessarily get it
unless you get good permission. And so our safety
[18:48] and security or privacy is based on that as well.
Very cool. Arash. Yeah, great question. And I
[18:55] think there's lots to be be proud of at Toyota and
TRRI. I think the example I'll pick is, you know,
[19:00] roughly about 24 months ago. Uh, TRRI was the
pioneer in a in a technology called diffusion
[19:05] policies. It was really sort of the precursor
for vision language action models and all the
[19:10] growth you see in robotics. recently uh and so
the the team there did really good work to kind
[19:15] of build that out. Basically, can we use the same
technology that powers chat GPT and use that for
[19:20] robotics and um you know was based on collecting
demonstration data you know collecting relatively
[19:26] small quantities of it 60 to 100 demonstrations
of a teley operator doing something with a robot
[19:32] and then very quickly without any code training
a model to allow the robot to do that. TRI did
[19:37] that pioneering work. We published uh you know a
seminal paper in this in science robotics that's
[19:41] highly cited and so from a research perspective
it was awesome you know we did we did this good
[19:46] thing but the team didn't stop there they really
focused then on how do we apply this to Toyota
[19:50] and in a way that's consistent with our values
and so there you know we work very closely with
[19:55] manufacturing and once again looking at you know
uh the the points that I made earlier around human
[20:01] agency you know what is the most useful way we
can combine this technology with the people in
[20:05] Toyota and we looked at things like having our
manufacturing [clears throat] team demonstrate
[20:10] to robot tasks that were either difficult or uh
uh stuff that was harder for them to do so that
[20:16] they could focus on higher value tasks. And so
earlier I mentioned this paradigm of having an
[20:21] AI teach a human. In this way we are actually
looking at the opposite. Can a human teach an
[20:25] AI have an assistant that you can show tasks to
and have the robot go off and do that. And so
[20:30] they actually worked with several uh parts of the
factory do that. there there are trial deployments
[20:35] that are going going down with that as well. Uh
but also what we did was we actually ended up
[20:40] uh spinning that out. So that just got spun out uh
and went public about 3 weeks ago. Walden Robotics
[20:45] uh and uh so they've raised a large amount of
money and now can pursue this at a really massive
[20:49] scale and they're starting with integrations in
Toyota factories which I think is really really
[20:54] cool. And the last thing I'll add is so this
team has kind of published some seminal work
[20:57] actually done deployments in the factory and tried
to incorporate it what's unique about Toyota which
[21:02] is our specific way of thinking about how we
can incorporate humans people in this process
[21:07] uh but also in trying to capture expertise which
is what is our real advantage at Toyota it's not
[21:12] data it's sort of the expertise uh but now the
team is moving on to the next frontier and what do
[21:17] you see missing in a lot of these robotics kind of
demonstrations is any interaction with a person so
[21:22] these are all happening in isolation and so We're
saying well you know if you really want robotics
[21:26] to unlock value for people right now how do we
think about ways in which people in robots can
[21:31] can interact in a more intuitive way. So imagine
you know you need to move a large table me and
[21:35] Steve could probably do that without talking to
each other but if I had a robot instead of Steve
[21:39] as my partner there would need to be some sort of
technology that allows us to really intuitively be
[21:44] able to move a table uh you know 10 feet or
whatever it is and so those are kind of the
[21:47] problems that we're looking at. Very cool. Very
cool. Um, questions for the audience. Got one.
[21:56] Mic's coming. There you go. Thank you. Fire away.
Hi there. Uh, my name is Jesse Brady. I'm with
[22:01] the American Hotel and Lodging Association.
Uh, thought this was really insightful. I
[22:06] noted a comment about, you know, what about when
we'll be able to use this to drive long distances
[22:11] and just interested in how you think these
technologies will change the future of travel.
[22:19] I mean I think that it's going to change travel
fundamentally in every single way. Uh we were
[22:24] actually talking earlier about smart cities.
So when you have agentic or autonomous vehicles
[22:31] um they could traffic management could be very
very different because the cars can actually
[22:36] you know talk to a stoplight or you know how does
it talk to other you know smart safety gates and
[22:42] parking all those sorts of things. We would talked
about how it will change um just maintenance in
[22:48] general. Like my if I have my car and it needs
to sensor recalibration, it can go do that in
[22:54] the middle of the night while I'm sleeping um
and not then come home and be ready. But I think
[22:59] um travel efficiency, us being able to get our
time back. I mean, I think the biggest and most
[23:05] impactful thing that autonomous vehicles are going
to do for us is give us our time back. I mean,
[23:10] if you think about just if you commute
to work and you have an hour commute,
[23:14] think about lost productivity because you actually
have to focus on the road. Um, getting connection
[23:18] back with your family, talking to your kids, um,
you know, all those sorts of things. I think from
[23:23] a transport perspective, just, you know, I don't
even know if we can possibly understand today all
[23:29] the impact that's going to happen, but, um,
it's pretty exciting to think about. At May,
[23:34] uh, we've always had this vision that autonomous
vehicles are going to transform cities. So just
[23:39] imagine for a minute all the parking lots become
parks instead of parking lots or perhaps you get
[23:45] more residential space. You think of how much of
cities I think I want to say like Ann Arbor where
[23:50] where we're located like I don't know like 15 20%
of the land mass is used for parking lots. So when
[23:56] you can start calling vehicles they can always
take you where you want to go. That's a huge
[24:00] change. So, not only will it change the individual
uh life who's who's using the autonomous vehicles,
[24:05] it will change the communities in which uh the
vehicles are being used. To add something really
[24:12] quick, I think these are excellent points.
I think one of the interesting things if you
[24:15] think about autonomy in vehicles as it relates
to travel is that the journey itself now becomes
[24:20] a bigger part of the experience. And so, you
can think about that in various ways. You know,
[24:25] getting you more time in the vehicle, etc.
But you know if you're coming from sort of
[24:28] the hotel industry you can imagine that the now
the destination is just as important as the ride
[24:33] right there ways in which you can connect both
of those things. So where you're going and the
[24:37] experience in the car linked in some way and
you're able to capture more value for the for
[24:42] the consumer d in that interaction. Great question
up here. Oh he sorry. My name is Taylor. I'm with
[24:50] a small trucking company out of Nebraska. Uh, I
guess I'm curious if you guys have a perspective
[24:54] on the process of like these like actual trucks
that transportate like that transport materials
[24:59] like are those being autonomized at the same
time as cars like in tandem? Is it a separate
[25:05] thing? Like what's your guys' perspective on
that? Long haul or mid-h hall trucking? So,
[25:11] while May in specifically is not uh automating
those right now, uh they are being automated.
[25:16] I I'm going to guess that you're going to have
uh some ideas as well there. So uh so yeah I'll
[25:21] let my colleagues or the others here talk. Yeah I
mean so certainly you know Toyota doesn't sell any
[25:27] any heavy trucks in the US uh but you see a lot
of companies that are involved in in automated
[25:32] trucking and I think in in many cases you know
the one of the reasons that that was an earlier
[25:37] uh one of the reasons that that thing developed as
fast as it did was because the business case was a
[25:42] lot clearer in terms of you know the the value you
could capture if you were able to automate some
[25:46] of these routes. And so I think we're seeing both
of those and we're seeing that internationally as
[25:50] well in Europe there huge um demonstrations of
of not just autonomous trucking but platooning
[25:56] for the purposes of saving fuel efficiency. Uh
and so um along with that I think so there's a
[26:01] whole bunch of work in automated truck trucking.
I think we're also seeing a lot of interest in
[26:05] then sort of the fleet management distribution of
these as well. And so there's a lot of interesting
[26:09] companies and and work that's happening in
that area. Great. Hi, my name is Daniel. Um,
[26:17] when when my daughter was seven, I placed a little
bet with a friend uh whether she'll have to get a
[26:23] driver driver license when she'll get to be 17 and
uh now she's 12 already and my time is running and
[26:31] I was wondering how are you tackling this all the
regulations? We saw a tensor. [laughter] I mean,
[26:38] it was interesting last year the brand at
the Quail Motorsport um event which is in
[26:44] Carmel and there was a kid that came up and got
in the car and his dad was there and he's like,
[26:48] "This is so cool. There's screens all over and
there's no steering wheel and this is great." And
[26:52] he told it to his dad, he's like, "I want this car
to be my first car when I'm 16." And I was like,
[26:57] "You don't have to be 16 to have this as your
first car." Um, and if you actually see right now
[27:01] like in San Francisco Whimos, parents are more apt
to put their kid in a Whimo than an Uber because
[27:06] there is no driver because it's safer than having
a stranger drive them. Um, so they put their
[27:11] teenagers in an Uber or in a Whimo than over an
Uber. So I think it's interesting. Uh, we believe
[27:18] though that people still want to and will continue
to want to drive when they want to drive. So we
[27:24] say drive or be driven. Our car has a collapsible
steering wheel and pedals, but if you want to
[27:30] drive, you can drive it just like a regular car
because I think there's still some enjoyment we
[27:33] have in driving. So, will your your uh daughter
have a driver's license? I hope so. Um I because
[27:40] it's it's fun to drive, but I think most people um
we make it to a world where people fewer and fewer
[27:46] people will actually have a driver's license.
So, go ahead. I I'll just add one note which
[27:50] I think a lot of this is also driven by policy
and regulation. So you may have seen this week I
[27:55] think there's some regulations around zuks and its
deployment and one of the stipulations for example
[28:00] is I think there's some limitation on age limit
so they can't take uh kids under the age of eight
[28:05] alone and things like that and so um you know
to to your question I think some of this is also
[28:10] driven by sort of regulation over time and we're
seeing you know the regulations that are required
[28:14] for AVs are not the same as a teen driver right
a teen driver can take an 80ole without without
[28:19] needing any any permission so I think uh you know
we'll kind of see have to see how that evolves
[28:23] there's like certain safety things. Actually,
we were talking about uh issues with some Whimos
[28:27] sometimes an edge case where they locked. But I
mean, when parents can actually observe their kids
[28:32] in the car while they're being taken to grandma's
house, for instance, or somewhere, and they're not
[28:37] allowed to get out because they know the car knows
through facial recognition that it's the child
[28:42] in the car. They can't just stop at a stoplight
and accidentally get out. Those are the sorts of
[28:47] things that we have to think through when you're
thinking of autonomous vehicle technology that
[28:51] you know we're not thinking about now. Um and so
that's the exciting part is we have to all these
[28:56] things to figure out. Begs an interesting question
that I hadn't thought about before. Right. So at
[28:59] least in America what are you like 16 17 before
you can get a driver's license and that before
[29:04] that age even if your parents bought you a car
you couldn't drive the car but are we going to see
[29:09] especially for like more affluent families that
kids that are four years old own a car? I don't
[29:14] know if a four-year-old is gonna I don't know if
it's funny actually we are launching in Dubai and
[29:19] we are we are a luxury vehicle right and so a lot
of the customers we've talked to and things like
[29:24] that are for family transport um and you know you
don't need a parent to transport your kids or your
[29:31] pets by the way um so you know can you know take
your doggy a dog to doggy daycare um but I think
[29:38] those are it really does come down to regulation
it depends on the city the municipality the
[29:44] country how they're going to regulate um autonomy
and always there's going to be that one case
[29:49] that's going to pop up um that kind of like oh wow
you know maybe we should regulate it more but I
[29:54] think um you know hopefully we don't overregulate
um too much and we we learn from uh the edge cases
[30:02] and and make the software and the hardware
better interesting I had a question regarding
[30:09] uh what one of you said in the introduction I
think uh Abanach you mentioned mentioned that
[30:14] um cars can interact with each other auto like and
what I'm interested in is like reducing traffic
[30:22] especially like within Toyota cars but also like
within cars from different companies. Have you
[30:27] worked or is there work being done on that right
now? Yeah, there's there's a lot of work being
[30:32] done on that uh not just by Toyota but by by
lots of lots of other folks. Uh and so yeah,
[30:37] you're you're mentioning this notion of vehicle to
vehicle or vehicle infrastructure communication.
[30:41] That's been an area of investigation quite some
time and I think there's a couple of different
[30:45] use cases. One is can we use that information to
basically aggregate information from the fleet to
[30:50] give you more useful data. So for example, you're
driving on a road and you know the off-ramp has
[30:54] like a a bunch of black ice at least you can
be warned ahead of that because another car
[30:59] experienced that. The second one is can we use
that to improve traffic traffic flow. So can we
[31:03] for example uh you know when you're when you're
going through an urban area you know can we time
[31:08] your speed etc. so that we are able to actually
go through these lights you know with the least
[31:12] amount of of backflow and stuff and people are
working on that. I think the challenge to that is
[31:16] uh actually being able to get vehicle-to- vehicle
uh infrastructure and and hardware hardware into
[31:21] the cars. And the big problem here is the benefits
really acrew only when a significant amount of
[31:26] the fleet has it. And so for the early adopters,
they're not really getting any benefit for quite
[31:30] some time. Uh and then you know how do you create
benefit that is valuable enough that people want
[31:35] to do it? More recently, people are looking uh
rather than a specialized hardware and specialized
[31:39] bands can we use uh cellular networks and things
like that. So there's a lot of work looking at
[31:43] that and looking as at that as a way of you know
creating safer intersections for example so you
[31:50] can connect to people's phones and and they know
cars are coming and they can indicate to you you
[31:54] know maybe you should cross or you shouldn't
cross or convey your intent. You can imag even
[31:58] imagine a crazy world with agents where you
know car has agent your phone has agent and
[32:02] they all know what you're trying to do and these
agents interact and can kind of figure out what
[32:06] the optimal thing to do is in any specific you
know environment to to maintain maintain safety.
[32:12] uh and so um yeah I think there's there's lots
of ways in in which people are investigating this
[32:16] uh though there's still some challenges with the
implementation other questions yeah uh so I work
[32:23] in the uh dealership side of automobiles uh so I
was curious uh based on what you're seeing with
[32:29] AI we've been building software to help them with
fixed stops and all their dealership kind of stuff
[32:35] a lot of what you're mentioning obviously is going
to have an impact on dealers so could you comment
[32:40] on maybe some short, medium, and long-term
things that uh all of us you have maybe you
[32:45] can start uh cuz you have you know obviously
hundreds of dealers to deal with uh um but
[32:50] then everybody else if you have some comments on
what does what does any of this mean good or bad
[32:56] uh for automotive dealerships? Yeah, so we we
keep in close contact with our dealers. We have
[33:02] uh you know significant engages with them and
one of the the main themes we've heard is this
[33:07] huge desire to pull AI. They're like how can
we use it? tell us you know what are the ways
[33:11] in which it's useful. I think the big pain points
we've heard from dealers are things around vehicle
[33:16] service and maintenance uh warranty information
and and keeping track of that. And so there's a
[33:21] bunch of I think in the short term use cases
that dealers themselves have identified that
[33:25] I think you know AI could uh produce some real
tangible results and I think longer term there's
[33:31] opportunities for us to think about you know
physical AI systems uh robots etc that can help
[33:36] with some of these service tasks and and other
things within the dealerships as well and so uh
[33:40] I don't have all the answers here but I think it's
a continual conversation with the dealers and like
[33:44] I mentioned earlier our philosophy in case I uh
you know you missed it is really around amplifying
[33:49] the person and so the dealers, you know, what
would be the most useful in their context and
[33:53] how do we rethink the dealership workflow in the
context of AI rather than just sort of adding AI,
[33:59] you know, peace meal into existing processes.
And so this is something that we're trying to
[34:02] work most closely with our dealers to figure out.
We're selling through dealers as well. We're not
[34:07] we're not a direct consumer brand. Um, and the
thing the conversations we're having aside from
[34:12] the maintenance side of it, right? meaning um
sensor maintenance and sensor cleaning and all
[34:17] the things that have to happen is the time, right?
So, if my if my car doesn't have to go in with me,
[34:23] a dealer may never interact with the owner of
the car. Uh the car may bring itself in for the
[34:30] service and tell the technicians or whoever has to
work on it all the things that need to be done can
[34:35] be done at night while the the owner is sleeping.
The other thing we talk a lot about is the sales
[34:39] process changes fundamentally. When you're talking
about a personal vehicle, that vehicle can go sell
[34:43] itself. It can drive itself to your house and
take you through all the features and actually
[34:49] go through that sales process. Now, hey, I'm a
marketing person. So, do I believe humans are
[34:54] going to be cut out completely? No, because we
still want to have that human connection. But,
[34:59] do we have to be limited by a dealership location
footprint? it changes things a lot because if the
[35:06] cars can go out to customers as opposed the
customers have to come to the cars um it's a
[35:12] different model. So we're playing around with a
lot of the different commercialization aspects
[35:17] for dealers. Um as a matter of fact I'm speaking
at the California New Car dealers association.
[35:21] And there have an event um in October and we're
going to talk about those sorts of things is how
[35:26] do dealers have to think about autonomous vehicles
differently and how does the customer experience
[35:32] the owner experience um change and evolve uh in
the world of autonomy. May mobility is a little
[35:39] different in that we operate with fleets. Uh so we
don't deal directly with uh dealerships. However,
[35:45] May is a company that really focuses on
partnerships. So we'll partner with fleet
[35:50] managers. we partner with other uh entities that
help us maintain the vehicles etc. That's going
[35:55] to be a big deal too right and now your vehicles
uh not only do they have the mechanical electrical
[35:59] but they got these really complex AI systems that
have to be maintained uh calibrated etc. So uh May
[36:06] has always been a company that we we don't try
to do everything ourselves we have the core uh
[36:10] and that we partner with uh with others to help
us and part of that is uh people who can help us
[36:15] uh maintain the vehicles and keep them uh on the
road. And I'll just say one more thing. Sorry,
[36:21] I should have mentioned it earlier as well. I
think we see a lot of opportunities for dealers to
[36:24] capture additional value because of AI. So value
that you're not capturing today, but that AI would
[36:30] enable true personalization and customization uh
options that allow you to then maybe, you know,
[36:34] one of the things we're looking at is can we use
AI to basically uh increase aftermarket sales by
[36:40] allowing people to customize things. And so
there additional value streams that we think
[36:44] AI will unlock that will be beneficial uh not
just for the OEM but for the dealers as well.
[36:48] Other questions? Yeah. Uh, thank you for taking my
question. How do you see the liability environment
[36:57] evolving? For example, if I'm in a level four
autonomous vehicle, it's in a crash, it's found
[37:02] liable. Am I liable, the manufacturer? What how
do you see that playing out? Thank you. We I
[37:08] can actually speak to that. We actually partner
with Marsh, uh, which is our insurance provider.
[37:12] This is actually a really really interesting
area because for instance with a tensor robbo
[37:17] car when it's in level four mode the owner has no
liability. It's it's a sorry liability. The owner
[37:22] can do nothing. You can't operate the car. You
can tell it where to go but the operational um
[37:29] you know function of the car is is ours. It's our
software. It's it's it's uh we're controlling the
[37:34] car. So liability is with tensor in level four.
anything under level four because we also you can
[37:40] drive the car. So level two for instance then it
is the liability of the owner or the driver uh the
[37:47] person with the license in the car who's operating
the car and that's one of the reasons why we do
[37:51] not have a steering wheel when we're in level
four but all other modes obviously have to have
[37:54] a steering wheel and pedals. What's interesting
about insurance though is Marsh and we've talked
[37:59] about it. We had to see uh at CES we did a whole
session on it and it's actually on our our YouTube
[38:04] um uh channel as well and you can so you can hear
about it. But dynamic insurance pricing becomes a
[38:10] real thing because the car's computer can actually
inform the insurance company how much of the
[38:16] travel that month or that period that quarter was
done by the car liability on tensor and how much
[38:24] of it was done by the owner. And so theoretically
you could have very dynamic insurance pricing
[38:30] based on how you're operating the vehicle. And
I think those are some interesting things and
[38:34] obviously because there's an onboard computer and
you're can pull that information. Even now I think
[38:40] some insurance companies you get you know safe
driver discounts for you know being able to share
[38:44] some of the data but dynamic insurance pricing is
a real thing and will need to be uh accommodated
[38:49] for level four. you or is the implication from
what you said that a mile on level four will be
[38:55] cheaper to ensure than a mile driven by a human.
A mile in level four would be cheaper because
[39:00] there is no driver liability at all. So less
likely to incur an accident and less likely to
[39:07] incur an accident which is we're willing to take a
liability, right? Because we trust our technology.
[39:11] So any sort of level four vehicle or car in a
level four mode, you would hope that the company
[39:18] that uh you're buying that vehicle from uh backs
their technology and so we do um and that's the so
[39:24] we we take the uh insurance liability uh for uh
any sort of accident if it's level four. Jacob,
[39:32] can you can you uh talk publicly about you guys
self-insure? Uh we do work with insurance partners
[39:38] uh that work with us and and that includes both
insuring us as and our vehicles as well as we have
[39:44] partnerships where we share data with them etc.
So it's an evolving landscape. I'm not an expert
[39:48] on it but we do have partnerships. Do you guys
publish your your safety numbers like compared
[39:54] to like regular miles driven by humans? Um I
don't think we publish them publicly right now
[39:59] but yeah I know Whimo does but um other questions.
Hi uh thank you for all the great information very
[40:06] stimulating thought question I had was how do you
take into account the non-deterministic nature of
[40:13] AI into your decision-m say for example you're
going through a yellow or red light that may
[40:18] change vary based on the the situation and in your
simulations curious how you handle that so sure um
[40:25] I I talked a little bit about this earlier in my
talk there's a lot of uh situations uh where the
[40:31] uncertainty is high there's bursts of uncertainty
you while you're driving. And in those times,
[40:36] um, it's important to, you know, as a human, what
we do is we we'll like visualize the different
[40:42] things that could happen like on the fly. And
we'll say, okay, uh, if I do this, if I do that,
[40:46] you're it's very very fast and you'll make a
decision that's generally a little bit more
[40:50] cautious than say if you were certain about what
was going on. And that's the kind of technologies
[40:55] that you need. Everybody's kind of moving more
and more toward especially with these AI models
[41:00] uh giving uh the inference system options and we
take that to its extreme at May where we actually
[41:05] play out the options in a little simulation or a
little tournament sometimes we call it you know
[41:10] who's going to win in a situation. So if there's
a lot of uncertainty that means there'll be a lot
[41:14] of outcomes that are different from each other and
we're going to tend to pick options that slow down
[41:19] maybe veer a little bit or etc. and and that will
happen for fractions of a second or a few seconds
[41:26] and then everything clears up and and things
become much more um deterministic and then you
[41:32] can kind of proceed with the your normal driving.
It's very humanlike in a way. Question. Uh hi,
[41:40] my name is Matt and I'm from a different I work
for a different industry but I'm interested in
[41:45] autonomous vehicle. Uh thank you for the
great session. Uh [sighs] actually when it
[41:51] comes to this make the AI powered vehicle safer
it raised a big concern for me which is lack of
[41:57] microphone in the you know autonomous cars. In the
previous session, Jacob pretty well explained the
[42:05] uh use of the evidence from lighter, radar, and
cameras to train the AI model. And I'm glad that
[42:12] uh Amy mentioned that uh they use 20 microphone,
but I assume that they are uh inside the car and
[42:20] for you know the passenger. Uh I'm coming from San
Francisco and in San Francisco you know there are
[42:27] hundreds of speakers around the city and every
Tuesday at noon they uh announce something and
[42:34] they are for um uh alerting people about the
tsunami earthquake and something like that.
[42:41] Imagine an slow day and no one in the street,
the passenger in the robo car and uh there's
[42:48] no sign of tsunami but the speakers started
announcing the tsunami and to me the car should
[42:56] uh pull over and shout the passenger just run
you save your life or go to the elevated area
[43:05] uh to you know to save the passenger's life. So
uh I would like to know how the robo car handled
[43:12] this situation. Who wants that one? I mean we we
have speakers inside the car and out external. So
[43:20] the the AI system or our technology is listening
externally. So, for instance, emergency vehicles
[43:29] are an autonomous vehicle can hear an emergency
vehicle way before a human passenger would ever
[43:35] hear it inside and process those sounds. I can't
speak to a tsunami that's not a tsunami. Um,
[43:41] but I would imagine that um, you know, in those
sorts of scenarios, it's not just the car. Um,
[43:48] and we're not a rules-based AI system. So, it's
got to not only understand what it was saying, but
[43:54] understand the context of what's going on in the
environment. So, um you know, our LLM is connected
[44:02] and our car is connected to to the internet to
through 5G. So, I would hope that in those very
[44:09] strange edge cases that the car did validate that
there was indeed a tsunami uh warning and not tell
[44:15] its passenger to jump out. I I'll just add a quick
note. I think the meta point you're making is that
[44:21] good drivers use sound. So I don't know how many
of you have been in a situation where your car
[44:25] has started skidding uh and uh what do you hear
you know usually you know the sound from your
[44:30] tires. So we've actually done work uh because
I uh on on how we can utilize that to kind of
[44:35] improve vehicle control at the limits uh you
know especially when you're driving on snow or
[44:39] you're doing aggressive lane change or something
like that. But I think your point is well taken,
[44:43] right? The best human drivers utilize all senses
at their at their disposal and I think we want
[44:49] the AI to do the same. Okay. So time has come. I
have one last question for each of you. I'm going
[44:54] to bet each of you individually 100 bucks and you
have to give me a number. So 15 years from now,
[45:01] we're going to abstract away from current. Uh
there are 90 million new cars more or less sold on
[45:06] the face of the earth every year. What percentage
of new car sales 15 years from now are fully
[45:12] autonomous globally? I will see what they really
believe. I mean, I would love to be optimistic,
[45:21] but I think 15 years from now, I would hope we're
approaching 20 25%. Okay, good number. I think
[45:30] it's hard because um it's it's pe the the drivers
with their individual cars that they switching
[45:37] cars takes a long time. Maybe 10 years, 15 years.
You never know. I keep cars for 10 years. Give
[45:42] us a number. Give us a number. I'm thinking I
justifying I'm giving him my chain of thought.
[45:47] I I'm thinking that it's going to be the places
where delivery logistics where things will move
[45:52] the fastest because there's a lot of advantages
to just taking the drivers out. Um you want his
[45:57] number? Do you want his number? I want the number.
Come on, baby. I'll say uh you're in Vegas from
[46:02] now 25%. Okay. 25 and yeah. Um so I think at you
know uh at Toyota we sell all over the world and
[46:11] certainly in certain markets there is appetite for
this stuff. Uh but we see you know obviously huge
[46:16] challenges you know imagine places that don't have
lane discipline. There aren't any autonomy systems
[46:20] for for those places right. My feeling is you guys
don't like giving me numbers. Yeah. Yeah. Well you
[46:25] know I think the real answer is I don't know. And
so I'm going to tell you what I I can speculate,
[46:30] but my guess is less than 20%. Less than less
than 20%. I don't I don't think it's going to
[46:35] be a case of in 15 years whether the technology
is viable, right? It's going to be a case. So I
[46:41] think especially like Toyota and bigger OEMs will
be they will have level four systems in their car.
[46:47] Um and that's not going to be the problem. The
problem is regulations, not even just consumer
[46:53] adoption, but all the different policies. Even now
we're we're launching in Dubai. Our headquarters
[46:58] is in San Jose. So we have California where you
know we have a driverless permit in California.
[47:04] We're trying to launch in Europe. Europe
every single country and every city decides
[47:08] they want to have a different way of testing and
validation. So you know for companies launching
[47:14] Toyota probably is going to be one of the leaders
because they do have the scale and the budget. But
[47:19] for us we're a small relatively small startup. We
have to go through all that process. Um and it's
[47:25] Whimo is paving the way. I mean they've been
really good with working with policy makers
[47:29] and trying to figure out how do they validate
level four technology and especially as we have
[47:35] like for our in our case it's a brand new car.
So homologation was a big issue related to all
[47:41] these new sensors and making sure the car is safe
not just the software is safe. Um all of those
[47:46] process take time. So yeah I mean I would love
to be optimistic and say 25% but I think you're
[47:51] right. It's probably going to be closer to minus.
Yeah. 10 plus or minus. Yeah. Not not a whole lot.
[47:57] Yeah. Well, you've been a great audience. Great
engaged questions. Thank you. Round of applause
[48:01] for our panelists, please. And if you if you got
questions, I'm sure you can grab them as they come
[48:06] off stage here. But thank you very much for having
us and uh have a good rest of the conference.