Ai4
Organizations waste millions by buying AI models before establishing operational need, whereas empirically validating the single riskiest assumption on low-cost hardware prevents failed deployments.
AI-assisted summary of Panel 3 - 2: AI-Driven Person Detection for Maritime Search and Rescue: The Value of Product-Based — original source. Check the original for full context.
Source published:
Detailed notes
## Background Published on YouTube by Ai4 on August 14, 2026, this panel presentation features Thomas Wilson, founder of Coal Face AI and a 21-year Royal Navy veteran. The talk uses his master's research into AI-driven maritime search and rescue to demonstrate how grounding AI development in deeply understood operational problems prevents organizations from chasing shiny objects and building the wrong products.
## TL;DR Wilton argues against the pervasive 'technology-first' trap—in which organizations acquire AI models and then search for problems to solve—advocating instead for a disciplined product-based research framework centered on validating the single riskiest assumption first. Grounded in the stark reality that over 40% of maritime man-overboard incidents end in fatalities, he details the development of Vantage, an AI system that pairs drone thermal imaging with computer vision for rapid ocean casualty detection. By collecting and manually labeling over 10,000 thermal frames in freezing field conditions at Manvers Lake, the project achieved 97% precision and 96% recall while executing locally on commodity edge hardware. He concludes that sustainable AI adoption requires clear UI/UX context, edge feasibility, and designing strictly around human operators in the loop rather than autonomous hype.
## Atmosphere & style The presentation carries a grounded, candid, and refreshingly pragmatic tone that cuts through Silicon Valley buzzwords with no-nonsense military realism. Wilton speaks with the quiet authority of a seasoned naval operator, blending dry humor about defense bureaucracy asking for 'magic AI dust' with visceral recollections of staring off pitch-black flight decks into freezing waters. Watching the talk feels like receiving an urgent, hard-won briefing from an operational pragmatist who cares far more about saving a drowning casualty than flattering executive tech enthusiasm.
## Key takeaways - [00:04](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=4s) Organizations frequently fall into the technology-first trap, buying AI models or capabilities before proving an acute operational need exists. - [03:05](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=185s) Asking 'How can we use AI?' leads to wasteful shiny-object adoption; teams should instead ask if a specific AI capability solves an authentic, validated problem. - [05:20](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=320s) The product-based research framework focuses on identifying frontline operational friction, formulating testable product hypotheses, and isolating the single riskiest assumption. - [05:20](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=320s) The greatest economic value of applied AI research is preventing organizations from spending millions building the wrong product, rather than merely validating initial intuition. - [06:53](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=413s) Over 40% of maritime man-overboard incidents result in loss of life, with the primary bottleneck being the human visual difficulty of spotting a person in open water. - [09:05](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=545s) Empirical testing under authentic environmental stressors—such as freezing winter water and real human swimmers—is essential to validate core AI detection assumptions. - [12:20](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=740s) Manual data annotation and analyzing diminishing returns in dataset scaling help teams optimize resource allocation when collecting expensive domain data. - [12:20](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=740s) Maritime search and rescue AI must execute inference locally on commodity edge hardware to eliminate dependence on cloud connectivity in remote ocean environments. - [12:20](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=740s) Computer vision models achieved 97% precision and 96% recall in detecting open-water casualties on low-cost edge platforms. - [14:25](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=865s) AI systems must be designed as assistive tools that provide clarity, speed, trust, and context, keeping human operators in control of life-or-death decisions. - [16:08](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=968s) Transitioning research prototypes to production requires testing varied sea states and integrating thermal computer vision with radar, GPS, and AIS navigation feeds. - [17:17](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=1037s) Adoption barriers regarding confidence, cost, and trust are overcome by starting with the operator's problem, deploying to low-cost hardware, and providing transparent model context.
## Detailed walkthrough ### [00:04](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=4s) Introduction: Coal Face AI and Shifting from Technology to Problem
Tom Wilton opens the session by introducing his background and his venture, Coal Face AI. Deeply rooted in the industrial coal-mining heritage of South Yorkshire in the UK, the company derives its name from its mission: delivering artificial intelligence where it matters most, directly at the coal face. Before founding the company, Wilton served for just over 21 years in the Royal Navy, concluding his military career in the Navy's AI transformation cell. Having spent countless years deployed at sea and working directly alongside maritime search and rescue organizations, he witnessed firsthand the immense operational difficulty of spotting and recovering an individual lost in the vast, open ocean.
His master's research, titled around AI-driven person detection for maritime search and rescue utilizing YOLO object detection, initially looked like a standard engineering project combining drones, thermal imaging, and computer vision. However, during the course of the project, Wilton realized that the algorithms and hardware were not the most critical or interesting takeaways. The truly transformative revelation was understanding why the solution was built in the first place. That shift in perspective reshaped how organizations ought to approach AI adoption. Rather than simply showcasing technical benchmarks, the goal of his talk is to outline a mindset that can prevent organizations from burning through millions of dollars and years of wasted effort chasing hype.
- **Background:** Founder of Coal Face AI, veteran with 21+ years in the Royal Navy, formerly in the Royal Navy AI transformation cell. - **The Core AI Dilemma:** Every week delivers a new model release, monthly AI strategies, and endless conference demos, yet organizations continuously fail to extract tangible business value. - **The Anti-Pattern:** "They've bought the hammer, and now they're desperately looking for nails."
---
[03:05](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=185s) The Technology-First Trap and "Magic AI Dust"
Whenever enterprise leadership and public organizations discuss artificial intelligence, the conversation almost universally starts with the same question: "How can we use AI?" While this inquiry sounds rational on the surface, Wilton argues it is one of the most financially ruinous questions an organization can ever ask. It assumes by default that AI inherently belongs somewhere in the tech stack, forcing adoption from the top down. The far more rigorous, value-driven question is: "Does this specific AI capability solve a real-world problem, and can we demonstrate that before we invest?" That subtle reframing forces AI to earn its place inside an organization based on merit rather than executive enthusiasm.
To illustrate how pervasive this upside-down thinking has become, Wilton recounts a memorable exchange from his time in the Navy's AI transformation cell. Representatives from the UK's Submarine Delivery Agency approached him while designing the operating system for the Dreadnought class—the nation's next-generation nuclear deterrent ballistic missile submarines. Their inquiry was simply: "What AI can I put in it? What magic AI dust can I sprinkle in there?" Instead of identifying an acute operational hurdle and assessing whether AI offered an effective remedy, the desire was simply to check an AI box on a flagship defense program. Wilton likens this behavior to a magpie drawn to glittering trinkets: "AI is today's shiniest object. But organizations don't fail because they bought AI. They fail because they bought AI before proving that they actually needed it."
```mermaid flowchart TD accTitle: Technology-First vs Problem-First AI Adoption subgraph Bad["Flawed Approach: Shiny Object Adoption"] B1["Buy AI / Model First"] --> B2["Hunt for Internal Problems"] B2 --> B3["Costly Integrations & Unused Tools"] end subgraph Good["Product-Based Research Framework"] G1["Identify Operational Problem"] --> G2["Form Product Hypothesis"] G2 --> G3["Isolate Riskiest Assumption"] G3 --> G4["Low-Cost Empirical Test"] G4 --> G5["Evidence-Driven Investment"] end ```
---
[05:20](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=320s) The Product-Based Research Framework
To combat shiny-object syndrome, Wilton presents an alternative disciplined methodology called "product-based research." The framework begins not with an open software license, a vendor demo, or an executive returning inspired from a tech conference, but with an authentic, painful operational bottleneck experienced by frontline human operators. From this validated friction, teams formulate a product hypothesis: "I believe this capability might solve this specific problem." Crucially, a real hypothesis must welcome the possibility of being proven completely wrong.
The next step demands isolating the single riskiest assumption underlying the entire concept. In Wilton's research, the critical unknown was neither whether drones could achieve stable flight, nor whether commercial thermal cameras existed, nor whether the YOLO architecture was sound. The single existential question was: *Can AI detect a human in open water reliably enough to be operationally useful?* If that assumption fails, the product is dead on arrival, meaning teams should never spend capital building full end-to-end architectures before validating that core unknown. Wilton emphasizes that rigorous research does not exist to flatter egos and prove initial intuition right; its greatest economic value lies in preventing organizations from wasting years building the wrong product.
- **Real-World Problem:** Anchor strictly to an observable operational pain point. - **Product Hypothesis:** Define a testable assertion linking a specific capability to a specific outcome. - **Riskiest Assumption:** Isolate the single failure point that could completely invalidate the concept. - **Empirical Validation:** Test the assumption under raw, representative conditions before writing production software. - **Evidence-Driven Investment:** Require each experimental milestone to earn the subsequent tranche of funding.
---
[06:53](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=413s) The Reality of Maritime Search and Rescue
Drawing directly from his 21 years at sea, Wilton grounds the framework in the visceral realities of naval operations. Royal Navy regulations permit off-watch personnel to consume alcohol during downtime, and Wilton recalls standing on the pitch-black upper decks of warships at night—where exterior deck lighting is strictly absent—staring into the dark water and wondering: "If I fell in, is anyone coming? Did anyone see me fall in? And if they did, are they going to reach me in time?"
This hazard is backed by grim statistics. Between 2015 and 2023, the UK registered over 300 reported man overboard incidents. In the United States, 2023 alone saw more than 200 occurrences. Most devastatingly, over 40% of all recorded man overboard incidents result in loss of life. When surveying the maritime domain to understand why modern AI adoption remains stubbornly low, three recurring barriers emerged: lack of confidence in AI systems, the daunting perceived cost of integrating AI into complex shipboard hardware, and a lack of trust from deck operators. Furthermore, experienced search and rescue personnel confirmed that the primary operational bottleneck is not navigation, fleet communication, or multi-asset coordination; it is the sheer physical difficulty of spotting a human head bobbing in open water.
| Search and Rescue Challenge | Operational Reality | |:--- |:--- | | **Search Area & Environment** | Vast ocean expanses, freezing temperatures, rough sea states, darkness | | **Human Sensor Limitations** | Visual fatigue, limited line of sight, high wave occlusion | | **UK Man Overboard (2015–2023)** | Over 300 reported incidents | | **US Man Overboard (2023)** | Over 200 reported incidents | | **Fatality Rate** | Over 40% of incidents result in loss of life | | **Core Maritime Adoption Barriers** | Operator confidence, integration costs, trust |
---
[09:05](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=545s) Designing the Experiment at Manvers Lake
Armed with the problem, Wilton defined the product hypothesis: a drone-mounted thermal camera paired with a computer vision object detection model can reliably locate a person in distress at sea faster and under conditions where human visual scanning degrades. Because the riskiest assumption was whether the model would miss targets in real water, testing required authentic environmental stressors: true thermal sensors, wild water, cold weather, and living human subjects.
The field trials were conducted roughly three miles from Wilton's home at Manvers Lake in South Yorkshire, a body of water reclaimed from an old colliery site. In February, under freezing conditions with a surface temperature of -2°C (translated with a brief aside for American listeners as 28.4°F), local open-water swimmers volunteered to enter the freezing lake for drone thermal passes. Over 70 minutes of raw thermal video were captured from the aerial platform.
Rejecting automated shortcut tools in favor of creating a gold-standard, trustworthy dataset, Wilton hand-labeled every single frame himself, generating over 10,000 annotated images. The resulting dataset captured varied target signatures: lone human swimmers, humans equipped with flotation devices, background distractors like abundant ducks and swans, and even a waterside igloo sauna on the jetty. When evaluating initial model training performance across dataset sizes, training on an initial batch of 50 images yielded poor detection, whereas scaling to 1,000 images sparked a dramatic surge in accuracy, laying the empirical groundwork for how data volume directly drives model utility.
- **Trial Setting:** Manvers Lake (reclaimed colliery site, South Yorkshire, UK) in February winter conditions (-2°C / 28.4°F). - **Data Capture:** Over 70 minutes of continuous aerial thermal drone footage. - **Manual Annotation:** 10,000+ hand-labeled frames to guarantee data integrity and eliminate label hallucination. - **Dataset Diversity:** Open-water swimmers, flotation aids, false-positive distractors (wildlife such as swans and ducks), and thermal anomalies (igloo sauna on the jetty). - **Initial Training Progression:** Poor accuracy at 50 images, followed by steep, dramatic performance gains at the 1,000-image threshold.
[12:20](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=740s) Evaluation Metrics, Diminishing Returns, and Edge Inference
When analyzing the scaling of the training dataset, doubling the dataset size yielded an initial performance leap, but subsequent doublings produced significantly smaller gains. From an engineering standpoint, identifying this point of diminishing returns is vital because collecting and annotating maritime data is labor-intensive and expensive. Recognizing where additional financial and time investment begins to offer progressively smaller benefits allows teams to budget resources effectively.
```mermaid flowchart LR accTitle: Maritime SAR Edge AI Pipeline subgraph DataEdge["Edge AI Pipeline"] A["Thermal Sensor Feed"] --> B["Jetson Xavier / Edge Unit"] B --> C["Object Detection Model"] end subgraph OutputMetrics["Operator Delivery"] C --> D["Confidence & Context"] D --> E["Human Operator Decision"] end ```
The model's performance was evaluated across standard computer vision metrics. Rather than focusing purely on abstract statistics, each metric corresponds to an operational reality: precision answers how often the system is correct when it claims to have detected someone, recall measures how many people actually in the water were successfully spotted, and the F1 score provides a balanced composite of the two. Mean average precision (mAP) scores confirmed the accuracy of the bounding box placements. Finding people, however, is only half the battle; latency and deployability dictate operational survival. Because vessels operating in remote environments—such as the middle of the Atlantic or Arctic Ocean—lack reliable high-bandwidth connectivity, cloud processing is unviable. The inference must occur locally on commodity edge hardware, specifically tested on platforms like the NVIDIA Jetson Xavier. The experimental results confirmed the core hypothesis:
- **Precision:** 97% - **Recall:** 96% - **F1 Score:** 96% - **Edge Feasibility:** Low-cost edge devices deliver real-time inference without cloud connectivity, establishing that the core detection mechanism is credible enough to justify further development.
[14:25](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=865s) Human-Centric UI/UX and the Concept of Operations
Validating the algorithm does not guarantee operational adoption. Building an effective system requires addressing how human operators interact with the output under extreme stress. Four core pillars define this interface: clarity (understanding the AI output instantly), speed (enabling decisions in seconds rather than minutes), trust (believing recommendations enough to take immediate action), and context (understanding *why* the AI flagged a specific target). The system is deliberately designed not as an autonomous replacement, but as an assistive tool where human judgment remains firmly at the center of the loop.
The operational reality in modern maritime services highlights the need for technological intervention. When a man-overboard alarm sounds—even on modern Royal Navy vessels—standard procedure still relies on shipwide personnel rushing to the upper deck to scour the ocean with binoculars and the naked eye. An AI-assisted Concept of Operations (CONOPS) introduces a structured, automated response:
```mermaid flowchart TD accTitle: Man Overboard Automated Response Workflow subgraph AlertPhase["Alert & Dispatch"] A["Man Overboard Alert Triggered"] --> B["Automated Drone Launch"] B --> C["Autonomous Search Path Execution"] end subgraph DetectionPhase["Detection & Navigation"] C --> D["Thermal Detection & Tracking"] D --> E["Operator Alert + Course-to-Steer Recommendation"] end ```
- When an incident occurs, a drone launches immediately and calculates an optimal search trajectory. - The drone scans the water, detects the casualty using real-time computer vision, alerts the bridge, and calculates an exact course to steer for recovery.
[16:08](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=968s) Research Limitations and Roadmap for Maturation
Rigorous research requires transparency regarding boundary conditions and what has not yet been proven. The initial project did not evaluate detection performance across violent sea states, severe meteorological obstructions (such as fog, heavy haze, and sea frets), or diverse sensor payloads and airframes. It is not intended as an immediate, turnkey replacement for existing naval search-and-rescue drills.
To advance the system from a research prototype to an operational capability, three development milestones must be met:
- **Dedicated Edge Validation:** Transitioning the model from simulated compute benchmarks onto hardened, flight-ready edge hardware payloads. - **Dataset Diversification:** Expanding the data repository not merely in raw volume, but across environmental variables—including differing sea states, ambient water temperatures, salinity levels, diurnal cycles, lighting conditions, and diverse human subjects. - **Sensor Fusion:** Integrating thermal video feeds with onboard navigational and radar systems, including Radar, GPS, and Automatic Identification Systems (AIS), so multiple data streams synthesize into a unified operational picture for the operator.
[17:17](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=1037s) Overcoming Adoption Barriers and the Product-First Framework
Surveys of maritime search-and-rescue stakeholders revealed three recurring barriers preventing the operational adoption of AI: confidence, cost, and trust. The project was explicitly structured to dismantle each hurdle:
| Adoption Barrier | Root Cause in Industry | Practical Solution Implemented | |:--- |:--- |:--- | | **Confidence** | Models trained on synthetic or unrepresentative toy data. | Tested with real-time thermal video collected via live drones over open water under realistic field conditions. | | **Cost** | Assumption that AI demands multi-million dollar cloud GPU clusters. | Engineered natively for low-cost, off-the-shelf commodity edge hardware. | | **Trust** | Skepticism of opaque "black-box" decision engines. | Exposing model confidence and contextual metadata directly to the operator so they can independently assess validity. |
The resulting system, named **Vantage**, demonstrates that an organization can design operationally viable, edge-deployable, life-saving AI starting from zero domain data by adhering strictly to product-first principles.
Rather than following the common tech-industry anti-pattern of building an arbitrary capability and searching for a problem to apply it to, practitioners should invert the paradigm: "Start with the person in the water and everything else follows." Organizations must first deeply understand the operational problem, systematically validate the riskiest assumptions, engineer for the physical environment of deployment, and only then commit capital to scaled production.
## Notable quotes > [00:04](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=4s) They've bought the hammer, and now they're desperately looking for nails. — Tom Wilton
> [03:05](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=185s) How can we use AI? — Tom Wilton
> [03:05](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=185s) Does this specific AI capability solve a real-world problem, and can we demonstrate that before we invest? — Tom Wilton
> [03:05](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=185s) What AI can I put in it? What magic AI dust can I sprinkle in there? — Tom Wilton
> [03:05](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=185s) AI is today's shiniest object. But organizations don't fail because they bought AI. They fail because they bought AI before proving that they actually needed it. — Tom Wilton
> [05:20](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=320s) I believe this capability might solve this specific problem. — Tom Wilton
> [06:53](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=413s) If I fell in, is anyone coming? Did anyone see me fall in? And if they did, are they going to reach me in time? — Tom Wilton
> [17:17](https://www.youtube.com/watch?v=N8_cPkXcAiI&t=1037s) Start with the person in the water and everything else follows. — Tom Wilton
## Mentioned Tom Wilton, Coal Face AI, Royal Navy, Royal Navy AI transformation cell, Submarine Delivery Agency, Dreadnought class, YOLO, Manvers Lake, NVIDIA Jetson Xavier, Automatic Identification Systems (AIS), GPS, Radar, Vantage
## Video description Thomas Wilson, Founder, Coal Face AI
What if the greatest value of AI research is not proving that a product will work, but preventing you from building the wrong one? Drawing on more than 20 years of Royal Navy operational experience, I will use my research into AI-driven person detection for maritime search and rescue to show how a deeply understood real-world problem can be translated into a product hypothesis and tested before major investment is committed. The talk will explore how organisations can identify the riskiest assumptions, choose meaningful measures of success and distinguish a promising model from a genuinely valuable product. Attendees will leave with a practical, problem-led framework for moving from research to prototype, trial and informed AI investment. Join this session to learn how to avoid shiny-object adoption and make evidence, rather than enthusiasm, the basis for your next AI decision.
[Source](https://www.youtube.com/watch?v=N8_cPkXcAiI)