Ai4
Autonomous AI systems will fail to achieve collective intelligence through basic message passing alone because cross-vendor agents lack the standardized semantic grounding and cognitive protocols required to align intent.
AI-assisted summary of How AI Agents Think: The Architecture Behind Collective Intelligence With Cisco — original source. Check the original for full context.
Source published:
Detailed notes
## Background Published on YouTube by Ai4 on August 19, 2026, this presentation features Julu Panat, Director of Product Management at Outshift by Cisco. According to the session description, it explores the foundational architecture behind agent cognition, detailing shared memory layers, semantic alignment, reasoning protocols, and dynamic knowledge systems designed to enable multi-agent collaboration.
## TL;DR Panat maps the shift from deterministic enterprise computing to probabilistic multi-agent ecosystems, analyzing how systems evolve across topology, execution dynamics, and autonomous agency. He emphasizes that raw message passing is insufficient for true collaboration and introduces Project Agntcy, an open standard contributed to the Linux Foundation covering verifiable identity badges, fine-grained access control, directory discovery, and observability telemetry. To resolve semantic grounding disparities across cross-vendor agents, Panat details a stack featuring Layer 8 (the Internet of Agents) and Layer 9 (the Internet of Cognition). This architecture combines cognition state protocols, shared memory fabrics, and runtime mediation engines to transform isolated foundation models into scalable distributed superintelligence.
## Atmosphere & style The presentation carries a visionary yet grounded architectural tone, blending enterprise systems pragmatism with forward-looking engineering philosophy. Panat speaks with clear, methodical authority, enlivening technical protocol concepts with relatable operational analogies like human product teams, late-night SRE war rooms, and Cisco's historical role in birthing the internet. Watching the talk feels like sitting in on an executive technical briefing that moves briskly from current industry bottlenecks to an inspiring, structured roadmap for collective intelligence.
## Key takeaways - [00:04](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=4s) Outshift by Cisco is applying the lessons of the early internet to create an 'internet for agents,' shifting focus from merely scaling foundational models to standardizing communication, governance, and architectural substrates. - [02:06](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=126s) Enterprise computing is transitioning from deterministic to probabilistic paradigms, where identical inputs produce nuanced outputs, demanding new frameworks for trust, validation, and operational governance. - [03:29](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=209s) Enterprise AI is advancing across four stages—from basic chat prompts and single-agent tool use to multi-agent orchestration and an imminent surge in open, cross-vendor agent networks as hardware bottlenecks ease. - [05:59](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=359s) Agentic system architectures evolve across three key axes: Topology (centralized to decentralized), Execution (static to dynamic), and Agency (human-in-the-loop to autonomous). - [07:30](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=450s) Multi-agent topologies range from centralized supervisor models to decentralized, peer-to-peer structures that mirror human team dynamics such as cross-functional product teams or SRE incident war rooms. - [09:22](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=562s) Dynamic execution coupled with automated guardrails is necessary to prevent human operators from becoming systemic bottlenecks when handling edge cases in scaled multi-agent deployments. - [11:34](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=694s) Simple network message passing between heterogeneous agents does not equal collaboration; genuine collaboration requires shared context, semantic negotiation, and persistent memory across vendor silos. - [14:03](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=843s) Project Agntcy, donated to the Linux Foundation by Cisco, establishes open standards for agent identity badges, short-lived granular access controls, directory discovery via OASF, and cross-vendor MELT telemetry. - [17:20](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=1040s) Open ecosystem standardization across OpenTelemetry and LF AI & Data supports diverse messaging topologies beyond simple request-response, including pub/sub and fire-and-forget patterns for streaming telemetry. - [18:18](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=1098s) Operating above the OSI Application layer (Layer 7), Layer 8 defines the 'Internet of Agents' for A2A and MCP discovery and transport, providing the foundational plumbing for agent connectivity. - [19:07](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=1147s) Cross-agent collaboration faces a major semantic grounding barrier when agents from different domains or vendors interpret identical terms (such as a 'P1 SLA') with conflicting operational definitions. - [21:10](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=1270s) The Internet of Cognition introduces a three-tiered architecture: Cognition State Protocols for intent negotiation, Cognition Fabric for shared auditable memory, and Cognition Engines for real-time security and mediation. - [24:20](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=1460s) Layer 9 (L9) represents the shift from connecting machines to connecting intelligence, enabling disparate AI agents to collectively reason and align context rather than just exchange raw data.
## Detailed walkthrough ### [00:04](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=4s) Outshift by Cisco and the Internet for Agents
Julu Panat introduces the session by inviting the audience to look around the corner and peek into the future of collective intelligence. While much of the enterprise focus at the conference centers on tactical problem-solving for today, the broader vision mirrors the dynamic of the room itself: individual practitioners bringing unique experiences who, when gathered together, feed off each other and grow collectively. The mission is to replicate that exact dynamic across artificial intelligence agents.
Panat represents Outshift by Cisco, the company’s emerging technology incubation engine. Outshift operates with a charter to identify, explore, and shape nascent technologies across business, community, and open standards perspectives long before they reach mainstream enterprise markets. Their research teams are concentrated on three primary technological pillars: Agentic AI, Distributed Super Intelligence, and Quantum computing.
Drawing a historical parallel to Cisco’s founding heritage, Panat reflects on the inception of modern networking:
> "25 years ago, you know, we connected computers, the machine, and internet was born. Now we are at a place where we have agents getting connected and we need to build an internet for agents so that they can talk amongst themselves."
Achieving this vision requires far more than merely scaling up foundational models; it demands an entirely reinvented substrate encompassing communication protocols, governance frameworks, and system-level architectures.
[02:06](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=126s) The Paradigm Shift: Deterministic to Probabilistic Computing
The industry is undergoing a foundational transition from deterministic computing to probabilistic computing. In traditional deterministic systems, providing an identical input guarantees an identical output every single time—a predictability upon which conventional enterprise software workflows have long relied. In contrast, probabilistic agentic computing processes inputs through subjective intent interpretation, contextual reasoning, and dynamic problem-solving.
Much like asking the same question to several different humans yields nuanced, varied responses, two agents processing the same prompt may arrive at divergent solutions. While this flexibility unlocks immense problem-solving capabilities, it introduces severe operational hurdles around validation and verification. Transitioning workloads from standard cloud architectures to agentic computing requires fundamentally rethinking trust, governance, enterprise security, orchestration, and operational runtime controls from the ground up.
[03:29](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=209s) The Four Phases of Enterprise AI and the Coming Agent Surge
The enterprise adoption curve of artificial intelligence spans four distinct evolutionary buckets. The journey started with the widespread arrival of consumer chat interfaces like ChatGPT, enabling rapid text prompting and instantaneous content generation such as automated blog writing. That baseline expanded into single-agent implementations capable of reasoning over complex tasks and executing targeted actions by retrieving data through Model Context Protocol (MCP) tooling.
``` +-------------------------------------------------------------------+ | ENTERPRISE AI EVOLUTION PATH | | | | [1. Chat & Prompts] --> [2. Single Agents + Tools] | | Ad-hoc assistance Doc summarization, MCP calls | | | | | v | | [4. Open Agent Networks] <-- [3. Multi-Agent Orchestration] | | Cross-vendor protocols Domain workflows (Finance/Mktg) | +-------------------------------------------------------------------+ ```
Enterprises are currently navigating the third stage: multi-system orchestration. Because an individual generalist LLM cannot master every vertical enterprise function, organizations build specialized agents—such as dedicated finance or marketing agents—and orchestrate them across enterprise workflows in pilots or early production runs. However, Panat emphasizes that the most critical frontier is the fourth bucket: the imminent arrival of cross-vendor, interconnected agent networks.
- Current enterprise adoption is artificially constrained by infrastructure bottlenecks in compute, high-bandwidth memory, and data center capacity. - As hardware supply catches up with exponential enterprise demand, agent deployments will hit a sharp "hockey stick" surge. - This explosion of agents from competing vendors will immediately expose acute gaps in interoperability, security, cross-agent trust, and ecosystem-wide observability.
[05:59](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=359s) The Three Architectural Axes: Topology, Execution, and Agency
Modern agentic systems evolve across three independent dimensions, each shifting from early, constrained paradigms toward scalable, autonomous designs.
``` TOPOLOGY: Centralized ----------> Decentralized EXECUTION: Static (Hardcoded) ----> Dynamic (Adaptive) AGENCY: Human-Triggered -------> Fully Autonomous ```
The first axis is Topology, which transitions from centralized, orchestrator-heavy designs to decentralized, distributed structures. The second axis is Execution, evolving from rigid, static, step-by-step task sequences into dynamic, adaptive execution where agents autonomously formulate plans. The third axis is Agency, moving away from human-in-the-loop prompt triggers toward background autonomous execution where agents proactively initiate and complete workflows without human intervention.
[07:30](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=450s) Topology Patterns: Single Agent, Supervisor, and Peer-to-Peer War Rooms
Architectural topologies across multi-agent environments fall into three distinct implementation models:
1. **Single Agent Pattern**: Suited for straightforward, localized tasks such as document summarization or isolated tool queries over an MCP server. 2. **Supervisor Pattern**: Operates akin to a human project manager sitting at the center of a task. When a request arrives, the central supervisor decomposes the problem, delegates individual work items to specialized sub-agents or skills (such as engineering or design), and collects the outputs. This pattern provides strong determinism, clear audit trails, and strict organizational accountability. 3. **Decentralized / Peer-to-Peer Pattern**: Unites a team of equals collaborating side-by-side without routing every message through a central bottleneck.
Panat illustrates this peer-to-peer structure with real-world human collaboration analogies, such as cross-functional product teams—where design, engineering, and product marketing openly bounce ideas off one another—or an urgent incident war room where Site Reliability Engineering (SRE), project management, and developer agents swarm together to solve critical outages in real time.
[09:22](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=562s) Dynamic Execution and Autonomous Incident Response
Static execution models work well for standard, linear operations—such as bank account opening workflows that sequentially mandate identity ingestion, background screening, and risk scoring. However, static logic fails the moment an agent encounters an unhandled exception or an edge case absent from its pre-programmed rulebook. Halting execution to wait for a human supervisor creates an unsustainable operational bottleneck:
> "When you have millions of agents running and now human becomes a roadblock... all the benefits that you got from the agent is now stuck behind a human."
The solution lies in dynamic workflows equipped with automated guardrails that empower agents to make bounded decisions autonomously.
``` +-------------------------------------------------------------------+ | AUTONOMOUS SRE INCIDENT RESPONSE | | | | [SLA Anomaly Detected] | | | | | v | | [Auto-create Ticket in ServiceNow] | | | | | v | | [Dispatch Triage Agent] ---> [Pull & Analyze Logs] | | | | | v | | [Reason & Root-Cause] | | | | | v | | [Engineer Wakes to Fix] | +-------------------------------------------------------------------+ ```
Panat points out the practical quality-of-life impact of moving to autonomous agency. Instead of being awakened at 2:00 AM by a pager for a frantic incident triage call, autonomous systems can proactively detect SLA degradations, open tickets in ServiceNow, spin up diagnostic triage agents to parse logs, and complete the underlying investigative grunt work while the engineer sleeps peacefully.
[11:34](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=694s) The Silo Trap: Message Passing vs. True Collaboration
As multi-agent deployments multiply across enterprises, organizations inevitably end up with a fragmented tapestry of agents built across differing cloud infrastructures, varied identity providers like Okta or Microsoft Entra ID, and mixed model providers ranging from Anthropic and OpenAI to proprietary in-house models. Simply establishing a network connection between these heterogeneous entities does not constitute meaningful collaboration.
Panat highlights a fundamental distinction in agentic communication:
> "Message passing is not collaboration. Message passing is just putting stuff out the window and assuming that person understood it and acts on it."
True collaboration demands shared context, mutual intent alignment, dynamic semantic negotiation, and persistent shared memory. Without standardized protocols to establish this deep alignment, enterprises risk buying into isolated "pockets of intelligence" on vendor exhibition floors, where every proprietary platform demands that customers import their data and custom agents into yet another walled garden, creating severe vendor lock-in.
[14:03](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=843s) Project Agntcy: Identity, Access, Directory, and Observability
To overcome the silo trap and deliver a vendor-agnostic foundation for an open internet of agents, Cisco's Outshift created Project Agntcy (spelled without the letter "e") and contributed it to the Linux Foundation. Supported by over 90 industry partners—including Google, Oracle, Dell, and Red Hat—the initiative standardizes open multi-agent interoperability across four core pillars:
``` +-------------------------------------------------------------------+ | PROJECT AGNTCY ARCHITECTURE | | | | 1. IDENTITY & BADGES 2. FINE-GRAINED ACCESS CONTROL | | - Verifiable credentials - Short-lived scoped permissions | | - Capabilities & vetting - Tool/task/transaction limiting | | - Traditional IDP + DID - Beyond coarse RBAC | | | | 3. AGENT DIRECTORY (OASF) 4. AGENT OBSERVABILITY (MELT) | | - Open standardized discovery - Distributed tracing | | - Standardized agent schemas - Unified evaluation metrics | | - Linux Foundation adoption - Cross-vendor fleet telemetry | +-------------------------------------------------------------------+ ```
- **Identity & Verifiable Credentials**: Replaces dangerous, all-access user or service account delegations with dedicated "verifiable credential identity badges." These badges explicitly declare an agent's identity, scoped capabilities, vetting lineage, and cryptographic backing via traditional enterprise IDPs (like Okta) or decentralized identity frameworks. - **Fine-Grained Access Control Management**: Moves beyond coarse role-based access control (RBAC) to enforce transaction-specific, tool-specific, and task-specific runtime boundaries that are strictly short-lived to minimize security blast radiuses. - **Discoverability & Agent Directory**: Establishes a standardized directory format (such as the Open Agent Schema Format / OASF) so heterogeneous agents can discover each other, parse metadata regarding agent creators, verify provenance, and negotiate communication parameters. - **Agent Observability**: Standardizes full-stack MELT (Metrics, Events, Logs, and Traces) telemetry and evaluation metrics specifically tailored for cross-vendor multi-agent interactions, moving beyond isolated single-agent or basic LLM tracing.
[17:20](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=1040s) Standardizing Messaging Patterns and Donating to Open Ecosystems
Building an open multi-agent ecosystem requires moving past proprietary silos and single-pattern communications. In collaboration with partners like Microsoft, these foundational specifications have been contributed to OpenTelemetry (OTel) and the Linux Foundation (LF AI & Data). The underlying philosophy is straightforward: when every participant speaks the same structural language, the entire industry benefits. While early Agent-to-Agent (A2A) interactions relied almost exclusively on basic request-response mechanisms, complex enterprise use cases demand far greater flexibility. Transmitting data-heavy streams, such as video packages or continuous telemetry, requires robust asynchronous channels rather than blocking calls.
To address this diversity of workloads, the platform standardizes multiple core messaging topologies:
- **Request-Response:** Synchronous two-way exchanges suitable for deterministic queries and straightforward transactional commands. - **Publish-Subscribe (Pub/Sub):** Asynchronous topic-based distribution enabling agents to broadcast and ingest continuous or high-volume data streams without tight coupling. - **Fire-and-Forget:** One-way messaging patterns designed for alerts, heartbeats, or background event emission where receipt confirmation is unnecessary.
---
[18:18](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=1098s) Layer 8: The Internet of Agents and the Limits of Basic Plumbing
To structure agent communication cleanly within existing networking paradigms, Cisco Outshift conceptualizes this interface as an extension of the classical OSI seven-layer model. Positioned directly above the Layer 7 Application layer sits **Layer 8: The Internet of Agents**. This layer does not replace standard network protocols; rather, it specializes them to manage Agent-to-Agent (A2A) and Agent-to-Model Context Protocol (MCP) interactions.
``` +---------------------------------------------------------+ | Layer 9: Internet of Cognition (Reasoning & Intent) | +---------------------------------------------------------+ | Layer 8: Internet of Agents (A2A, MCP, Discovery) | +---------------------------------------------------------+ | Layer 7: Application Layer (HTTP, gRPC, WebSockets) | +---------------------------------------------------------+ | Layers 1-6: Standard OSI Transport & Physical Stack | +---------------------------------------------------------+ ```
While Layer 8 successfully handles discovery, connection handshakes, and message transport, it only solves the "basic plumbing." Establishing raw connectivity does not guarantee effective collaboration. The deeper, unresolved challenge is cognitive: how disparate agents align their internal goals, establish common intent, share working memory, and co-reason through ambiguous objectives.
---
[19:07](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=1147s) Human Evolution as a Blueprint and the Semantic Grounding Dilemma
The evolution of human collective intelligence offers a clear architectural blueprint for multi-agent systems. Individual human capability has expanded over time, but individual intellect alone did not drive civilizational breakthroughs. The exponential acceleration of human progress occurred only after the creation of shared tools—language, books, and educational institutions—that enabled cross-generational knowledge sharing and collective innovation. In the AI domain, model providers in Silicon Valley are rapidly pushing the boundaries of individual model capability; however, without cognitive protocols that allow these models to share context and reason collectively, that individual power remains isolated.
``` INDIVIDUAL INTELLIGENCE COLLECTIVE INTELLIGENCE +------------------------------+ +---------------------------+ | Smarter Foundation Models | | Cognitive State Protocols | | - Fast local reasoning | + | - Shared vocabulary | | - Tool use & execution | | - Semantic grounding | +------------------------------+ | - Distributed memory | +---------------------------+ │ ▼ Distributed Superintelligence ```
The core barrier to cross-agent collaboration is semantic grounding. When agents built by different vendors (for example, Acme and Outshift) or operating across different domains attempt to collaborate, they often lack a shared operational vocabulary. A prime example is the interpretation of a "Priority 1 (P1) SLA":
- **Engineering Operations Context:** Interprets a "P1 SLA" as a high-priority software ticket requiring resolution or mitigation within a one-hour window. - **Healthcare & Hospital Context:** Interprets a "P1 SLA" as an immediate life-and-death emergency demanding intervention within seconds.
If agents do not establish common grounding and align their contextual definitions *before* beginning execution, they inevitably arrive at conflicting or catastrophic results.
---
[21:10](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=1270s) The Architecture of Distributed Superintelligence: Protocols, Fabric, and Engines
To bridge this coordination gap, Cisco is developing the **Internet of Cognition**—an open, interoperable fabric designed to support distributed superintelligence. This framework provides formal mechanisms for grounding, conflict resolution, automated negotiation, distributed coordination, and cross-agent evaluation.
``` +---------------------------------------------------------------+ | COGNITION ENGINES | | [Security Monitor] [Negotiator/Mediator] [Context Router] | +---------------------------------------------------------------+ │ +---------------------------------------------------------------+ | COGNITION FABRIC | | (Shared Context, Memory Layers, Decision Audits) | +---------------------------------------------------------------+ │ +---------------------------------------------------------------+ | COGNITION STATE PROTOCOLS | | (Shared Intent, Negotiation, Semantic Grounding) | +---------------------------------------------------------------+ ```
The architecture is built on three core pillars:
1. **Cognition State Protocols:** Standardized protocols that define how agents establish shared intent, synchronise state, and execute negotiation strategies. Different domains demand distinct bargaining dynamics; a buyer-seller interaction requires negotiation mechanics to close a commercial transaction, whereas a security agent needs strict guardrails (for example, interpreting a "rollback" command according to compliance policies rather than simple code reversal). 2. **Cognition Fabric:** The shared memory and context plane. High-fidelity agent collaboration collapses without rich context; the fabric ensures that cross-agent interactions, underlying decision intents, and state histories are persistent, visible, and fully auditable across enterprise boundaries. 3. **Cognition Engines:** Specialized runtime intelligence modules that observe agent-to-agent transactions and intervene when necessary: - *Security & Access Control Engines:* Actively inspect active transactions, instantly blocking attempts to access private data or export sensitive corporate assets out of bounds. - *Negotiation & Mediation Engines:* Step in as independent third-party arbitrators when two autonomous agents become trapped in circular negotiation loops. - *Context Building & Memory Routing Engines:* Dynamically assemble relevant background knowledge and route context across distributed nodes based on organizational policy.
---
[24:20](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=1460s) Layer 9 and the Shift from Connecting Machines to Connecting Intelligence
The culmination of this architecture is the formalization of **Layer 9 (L9): The Internet of Cognition**, which layers cognitive state protocols on top of the Layer 8 agent messaging stack. Cisco Outshift is actively driving open research, technical webinars, white papers, and community newsletters to advance these standards across the broader industry.
The fundamental paradigm shift in modern computing centers on the nature of connectivity:
> "The last generation was probably about connecting computer machines together. This generation is about connecting intelligence together. And the difference that you would see which makes a company successful is when you can get these AI agents to reason together. Just connection is not enough. You have to build this collective intelligence together."
## Notable quotes > [00:04](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=4s) 25 years ago, you know, we connected computers, the machine, and internet was born. Now we are at a place where we have agents getting connected and we need to build an internet for agents so that they can talk amongst themselves. — Julu Panat
> [09:22](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=562s) When you have millions of agents running and now human becomes a roadblock... all the benefits that you got from the agent is now stuck behind a human. — Julu Panat
> [11:34](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=694s) Message passing is not collaboration. Message passing is just putting stuff out the window and assuming that person understood it and acts on it. — Julu Panat
> [24:20](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=1460s) The last generation was probably about connecting computer machines together. This generation is about connecting intelligence together. And the difference that you would see which makes a company successful is when you can get these AI agents to reason together. Just connection is not enough. You have to build this collective intelligence together. — Julu Panat
> [24:20](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=1460s) The last generation was probably about connecting computer machines together. This generation is about connecting intelligence together. — Julu Panat
> [24:20](https://www.youtube.com/watch?v=4HeFv-pr3VU&t=1460s) Just connection is not enough. You have to build this collective intelligence together. — Julu Panat
## Mentioned Julu Panat, Ai4, Cisco, Outshift by Cisco, ChatGPT, Model Context Protocol (MCP), ServiceNow, Okta, Microsoft Entra ID, Anthropic, OpenAI, Project Agntcy, Linux Foundation, Google, Oracle, Dell, Red Hat, Open Agent Schema Format (OASF), OpenTelemetry (OTel), LF AI & Data, Microsoft, OSI model
## Video description Julu Panat - Director of Product Management, Outshift by Cisco
What does it take to build AI agents that can think, reason, and collaborate? This session breaks down the core architecture behind agent cognition—shared memory layers, semantic alignment, reasoning protocols, and the knowledge systems that make multi-agent collaboration work.
You’ll see how agents use dynamic, auditable knowledge systems to create persistent memory, reusable context, and trustworthy decisions. We’ll also cover how agents exchange meaning—not just data—to speed up collaboration and reduce rework.
Whether you’re exploring or deploying multi-agent systems, you’ll leave with clear patterns and practical guidance for designing true collective intelligence.
[Source](https://www.youtube.com/watch?v=4HeFv-pr3VU)