Ai4
Enterprises must centralize model governance and data indexing under a unified hub to block non-compliant queries at the gateway before they consume expensive LLM compute.
AI-assisted summary of Delivering and Governing Trustworthy GenAI Capabilities At Scale with Outshift by Cisco — original source. Check the original for full context.
Source published:
Detailed notes
## Background Published on YouTube by the Ai4 channel on September 5, 2024, this presentation features Tushar Agrawal, Senior Director of Product Management for Generative AI at Outshift by Cisco. The session addresses the gap between enterprise urgency and readiness for generative AI, exploring how standardized architectures and governance tools can expedite the delivery of trustworthy AI capabilities across business functions.
## TL;DR Tushar Agrawal introduces Motific, Cisco Outshift's generative AI hub designed to scale custom assistant deployment while maintaining centralized enterprise governance. He outlines the challenges of managing multi-tool workflows, model costs, and security risks, proposing a unified platform that connects IT administrators, citizen developers, and business leaders. Through architectural walkthroughs and a live product demonstration, the talk illustrates practical capabilities such as recency-aware RAG with Mistral AI, pre-LLM policy filtering to block off-topic queries, and intelligence dashboards measuring concrete ROI and employee time saved.
## Atmosphere & style The presentation maintains a polished, authoritative, and pragmatic enterprise tech tone, balancing high-level organizational strategy with practical software workflows. Agrawal speaks with clear product leadership expertise, grounding the discussion in common pain points like data leakage, token overruns, and fragmented custom bots. Watching the session feels structured and efficient, moving seamlessly from strategic conceptual frameworks and audience polling to a tangible product interface demo that clearly illustrates governance mechanisms in action.
## Key takeaways - [00:04](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=4s) Outshift serves as Cisco's incubation engine, productizing emerging frontiers like AI and quantum computing through Cisco Research and Cisco Investments. - [03:07](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=187s) Cisco's overarching strategy for the AI era focuses on connecting and protecting AI workloads while leveraging acquisitions like Splunk for observability. - [04:00](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=240s) Enterprise GenAI adoption rests on three hypotheses: step-function productivity gains, cross-tool workflow automation via custom assistants, and scaling to hundreds of governed tools. - [08:34](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=514s) Building GenAI assistants on an isolated, bot-by-bot basis is unscalable due to fragmented integrations, governance risks, and lack of visibility. - [11:20](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=680s) A centralized Generative AI Hub connects central IT, citizen developers, end users, and CXOs across data indexing, policy management, and ROI tracking. - [17:29](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1049s) Outshift launched Motific as Cisco's Generative AI hub to deliver Cisco-grade security guardrails, token budget controls, and 'what-if' model simulations. - [19:20](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1160s) Centralized model routing allows organizations to dynamically swap foundational models to optimize for accuracy, latency, and cost without modifying application code. - [20:00](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1200s) Motific enables recency-aware RAG pipelines, such as pairing with Mistral AI on Cisco Press archives to answer time-sensitive queries accurately. - [22:18](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1338s) The platform automates assistant creation by integrating corporate data repositories like SharePoint and exposing both developer APIs and out-of-the-box conversational interfaces. - [24:20](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1460s) Motific's pre-execution policy engine intercepts off-topic or restricted prompts at the gateway before they consume LLM resources, logging violations for auditing. - [25:45](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1545s) Motific Intelligence delivers telemetry dashboards that track model cost efficiency and quantify ROI through estimated hours saved.
## Detailed walkthrough ### [00:04](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=4s) Introduction and Outshift’s Role at Cisco
Tushar Agrawal, Senior Director of Product Management for Generative AI at Cisco's incubation engine Outshift, opens the presentation with a brief background on his career. Prior to his current role at Cisco, he led product management at Amazon Web Services (AWS) and held similar leadership positions across several Bay Area startups. He frames the core mission of his talk: exploring how enterprises and organizations with sizable employee populations can think about generative AI from both delivery and governance standpoints as AI assistants scale.
Outshift operates as Cisco's internal incubation engine, granted the "license to do a lot of cool things." While the organization focuses broadly on emerging frontiers like AI and quantum computing, Agrawal clarifies that this session centers entirely on AI. Outshift's primary charter is to incubate and productize emerging technologies to expand Cisco into new markets and business domains.
```mermaid flowchart TD accTitle: Outshift Incubation Ecosystem subgraph Core["Outshift Incubation Core"] A["Emerging Tech Focus: AI & Quantum"] --> B["Productize New Offerings"] B --> C["Expand Cisco into New Markets"] end
subgraph Pillars["Supporting Pillars"] D["Cisco Research"] -- "Publishes GenAI, CV, & NLP Papers" --> Core E["Cisco Investments"] -- "Tracks & Partners with Startups" --> Core end ```
- **Academic & Industry Research:** Outshift houses Cisco Research, whose scientists frequently publish papers on generative AI, computer vision, and natural language processing (NLP) at major conferences. - **Venture Ecosystem:** Outshift works side-by-side with Cisco Investments to monitor startup activity, identifying complementary technologies and potential strategic partnerships.
---
[03:07](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=187s) Cisco’s AI Strategy and the Core Hypotheses
Agrawal outlines Cisco’s high-level corporate strategy for the AI era: "connecting and protecting the AI era." This overarching vision spans building the underlying infrastructure that powers AI workloads, securing AI systems, using AI to simplify cybersecurity operations, and harnessing telemetry and observability data through recent strategic acquisitions like Splunk to drive better decision-making.
To frame the operational challenge, Agrawal polls the audience. The room reflects a strong cross-section of IT and Chief Data & Analytics Officer (CDAO) teams alongside line-of-business leaders (HR, Sales, Finance). He then presents three foundational hypotheses driving enterprise adoption:
1. **Step-Function Change in Productivity:** Generative AI is fundamentally different from past waves of automation and abstraction because systems can now "reason, create, and dynamically discover and interact." 2. **Work Automation via Custom Assistants:** Work rarely happens inside a single application; it crosses multiple disparate tools. For instance, sending a promotional email requires a human worker to context-switch across CRM platforms, order systems, and email dispatch tools. Custom assistants and intelligent agents act as the bridge to automate this cross-tool workflow. 3. **Mass Scale and Governance:** As custom assistants expand beyond a few company-wide bots to hundreds or thousands of specialized tools tailored to specific job functions, enterprises must govern and deliver them in a standardized, templatized fashion.
---
[08:34](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=514s) Anatomy of a GenAI Assistant and the Need for a Hub
Building even a basic enterprise AI assistant requires navigating a complex web of technical dependencies. Currently, many organizations attempt this process on an isolated, assistant-by-assistant basis—an approach Agrawal stresses is completely unscalable for the enterprise.
```mermaid flowchart LR accTitle: Challenges in Building Enterprise GenAI Assistants subgraph Integration["1. Connectivity"] A["Model Access"] B["Data Sources<br/>(CRM, ERP, SharePoint)"] C["Identity & RBAC"] end
subgraph Trust["2. Governance & Safety"] D["Data Leakage Guards"] E["Topic Restrictions & Harms"] end
subgraph Value["3. Optimization & Value"] F["Prompt Tuning & Model Selection"] G["ROI & Time-Saved Metrics"] end
Integration --> Trust --> Value ```
To resolve these recurring bottlenecks, Agrawal proposes the deployment of a **Generative AI Hub**—a central platform uniting the key enterprise personas involved in AI creation, delivery, and consumption:
- **Central IT & Admin Teams:** Maintain custody over model providers, index shared corporate data sources once rather than redundantly across hundreds of bots, enforce global safety/security policies, and manage identity frameworks. - **Citizen Developers:** Non-technical business users across Marketing, HR, Sales, Legal, and IT who pick approved models and datasets to rapidly assemble and test custom assistants without writing complex code. - **End Users:** Consume the provisioned assistants in their daily workflows. - **CXOs & Business Leaders:** Gain macro-level visibility into audit logs, policy violations, total usage metrics, and concrete ROI (such as estimated hours saved).
---
[17:29](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1049s) Introducing Motific: Cisco’s Generative AI Hub
To operationalize this architecture, Cisco launched **Motific**, a generative AI hub developed by Outshift designed to orchestrate delivery and governance across all enterprise personas. Motific abstracts the underlying technical complexity, allowing central IT to set global guardrails while granting business teams the agility to build tailored tools.
```mermaid flowchart TD accTitle: Motific Platform Architecture subgraph Platform["Motific Generative AI Hub"] direction TB subgraph Connections["Integration Layer"] M["Leading Model Providers"] D["Enterprise Data Sources"] I["Identity Systems"] end
subgraph Guardrails["Cisco Security & Control Layer"] S["Adversarial & Hallucination Checks"] U["Malicious URL Filtering"] C["Token & Cost Controls"] A["Access Control"] end
subgraph Insights["Observability & Analytics"] T["Audit Trails & Policy Flags"] R["ROI & Time-Saved Tracking"] O["What-If Model Simulations"] end end
Connections --> Guardrails --> Insights ```
- **Cisco-Grade Guardrails:** Motific leverages Cisco's deep expertise in security and network telemetry to inspect model inputs and outputs for hallucination risk, adversarial prompt injection, malicious URLs, and unauthorized data access. - **Cost & Token Management:** Admins can enforce granular limits on token usage and operational spending across departments. - **Simulation & Optimization:** Beyond tracking active usage, the platform enables "what-if" simulations, allowing IT teams to test how switching underlying models or refining system prompts impacts response accuracy, latency, and cost efficiency.
[19:20](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1160s) Optimizing Model Selection, Latency, and Costs
Standardizing enterprise Generative AI workflows provides a centralized mechanism for evaluating and swapping models based on performance and budget. Instead of remaining locked into a single provider, organizations can evaluate trade-offs: "Model X versus Model Y right would it be more accurate for this use case would it be lower latency would it be lower cost." If end-user queries within a department can be answered just as effectively by a smaller, lower-cost model, administrators can seamlessly redirect that traffic rather than overpaying for heavyweight foundational models.
Having a standardized, centralized management layer eliminates the friction of modifying individual application codebases. IT and platform teams can reconfigure routing dynamically behind the scenes, ensuring the entire fleet of internal AI tools maintains peak cost efficiency and low latency without sacrificing the quality of responses.
[20:00](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1200s) Enterprise Use Cases and Recency-Aware RAG with Mistral AI
Since announcing Motific, Cisco's Outshift team has seen strong interest from organizations grappling with enterprise-scale GenAI adoption. The core challenge across enterprises is balancing the distinct priorities of IT teams, business units, and executive leadership within a unified, full-stack platform. Deployed use cases span public-facing website assistants, internal HR policy self-service, IT support desks, and sales lead acceleration—all relying on consistent guardrails, compliance controls, and unified auditing.
```mermaid flowchart TD accTitle: Motific Recency-Aware RAG Architecture subgraph Ingestion["Data Ingestion & Indexing"] A["Cisco Press & Cisco Blogs"] --> B["Motific Knowledge Base"] end subgraph QueryEngine["Query Understanding & RAG"] C["User Query\n(e.g., 'recent acquisitions')"] --> D["Recency & Intent Reasoning"] B --> E["Context Retrieval"] D --> E end subgraph Governance["Governance & Generation"] E --> F["Guardrails & Token Budget Checks"] F --> G["Mistral AI LLM"] G --> H["Audited, Recency-Accurate Answer"] end ```
A prime implementation involves connecting Motific to a Mistral AI model to process Cisco Press and Cisco blog archives. The challenge centered on handling time-sensitive queries, such as identifying "recent acquisitions made by Cisco." Motific's Retrieval-Augmented Generation (RAG) framework reasons over the intent and recency of user prompts, retrieving the freshest documents rather than returning obsolete historical announcements. Alongside high accuracy, Motific layered on strict enterprise controls before exposing the system to external audiences.
- **Adversarial and Toxic Content Filtering:** Intercepts harmful prompts and prevents brand damage before requests reach the model. - **Token Budgets:** Imposes hard usage ceilings to ensure individual users or automated scripts do not cause billing overruns. - **Comprehensive Monitoring:** Full auditing trails capture all interactions for governance and compliance.
[22:18](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1338s) Product Demo: Connecting Data Sources and Deploying Motific Assistants
The video transitions to a recorded walkthrough of the Motific platform interface. To instantiate a new assistant—termed a "motif"—the administrator configures usage limits and operational parameters to keep the model aligned with corporate governance. The assistant is then tethered to relevant organizational data by constructing an application knowledge base.
Motific natively ingests internal repositories, such as corporate SharePoint sites, alongside selected public-facing domains to enrich the model's factual context. Within a few clicks, the knowledge base is compiled and linked. The final deployment generates standard API endpoints ready for developer integration, while simultaneously offering an out-of-the-box conversational AI interface for business end users.
[24:20](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1460s) Policy Enforcement, Off-Topic Interception, and Audit Monitoring
The demonstration moves into Motific's automated policy engine, highlighting how governance rules intercept unauthorized interactions before they consume LLM resources. An off-topic detection policy assigned to a marketing motif is configured with a blocklist of forbidden words and categories. In the administrative monitoring console under "Track my user," the dashboard initially displays eight logged policy flags.
```mermaid flowchart LR accTitle: Motific Pre-Execution Policy Enforcement A["User Input Query"] --> B{"Motific Policy Engine"} B -- "Forbidden / Off-Topic" --> C["Query Blocked at Gateway\n(Traffic does NOT reach LLM)"] C --> D["Audit Log Updated\n(+1 Policy Flag)"] C --> E["Standard Policy Violation Response\nShown to User"] B -- "Compliant" --> F["Forwarded to LLM"] ```
When an operator tests the assistant in the sandbox with an off-topic query—"Can you recommend a good shopping place"—the policy intercepts the prompt immediately: - The request is completely blocked at the gateway, meaning "the traffic doesn't reach the LLM." - The monitoring panel instantly updates from eight to nine recorded policy flags. - When an end user attempts a restricted prompt in the live interface, such as "Can you point me to a good online gambling casino," Motific suppresses the model output and returns a standardized enterprise message: *"I'm sorry, but this query is not in line with your organization's policies. Please try again."*
[25:45](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1545s) Motific Intelligence: Measuring ROI, Time Saved, and Model Optimization
The final segment of the platform demo focuses on Motific's built-in Intelligence and analytics suite. Navigating to the Intelligence section reveals a fleet overview of all active motifs, populated with usage statistics and operational telemetry. Drilling into an individual motif provides deep business intelligence regarding actual productivity gains and compute efficiency.
The overview tracks total prompt counts, per-prompt task usage, and quantifiable time-saving metrics that evaluate how effectively the assistant aids staff. A dedicated "time-saving dashboard" models the operational hours saved by generating materials through Motific compared to authoring complex documents from scratch. In parallel, optimization metrics highlight which underlying GenAI models deliver the highest quality at the lowest cost, guiding future infrastructure routing decisions.
[26:40](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1600s) Wrap-Up, Live Demonstrations, and Free Access
Following the video, Tushar Agrawal returns to address the audience, apologizing for the brief audio hiccup at the start of the recording. He emphasizes that the recorded snippet is only a preview of the platform's broader feature set.
He directs attendees to visit Outshift by Cisco at Booth Number 220 for hands-on, full-fledged live demonstrations. Agrawal notes that Motific can be evaluated for free immediately via a quick QR code scan and simple email sign-up, inviting attendees to connect on-site for technical Q&A and architecture discussions.
## Notable quotes > [00:04](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=4s) license to do a lot of cool things — Tushar Agrawal
> [03:07](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=187s) connecting and protecting the AI era — Tushar Agrawal
> [03:07](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=187s) reason, create, and dynamically discover and interact — Tushar Agrawal
> [19:20](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1160s) Model X versus Model Y right would it be more accurate for this use case would it be lower latency would it be lower cost — Tushar Agrawal
> [20:00](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1200s) recent acquisitions made by Cisco — Tushar Agrawal
> [24:20](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1460s) Track my user
> [24:20](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1460s) Can you recommend a good shopping place
> [24:20](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1460s) the traffic doesn't reach the LLM
> [24:20](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1460s) Can you point me to a good online gambling casino
> [24:20](https://www.youtube.com/watch?v=LEfKbM4zzwI&t=1460s) I'm sorry, but this query is not in line with your organization's policies. Please try again.
## Mentioned Tushar Agrawal, Cisco, Outshift, Amazon Web Services (AWS), Cisco Research, Cisco Investments, Splunk, Motific, Mistral AI, Cisco Press, Cisco Blogs, SharePoint
## Video description Tushar Agrawal, Sr. Director, Product Management - GenAI, Outshift by Cisco
Abstract: Business leaders recognize that Generative AI is causing a fundamental shift in organizations, by improving employee productivity, reducing operational costs, and driving superior customer experiences. While 97% of companies feel an increased urgency to deploy GenAI technologies, just 14% feel ready to integrate AI successfully into their businesses, per Cisco's latest AI Readiness Index. Transitioning GenAI assistants from concept to production at scale demands a meticulous focus on safety, trust, compliance, security, cost, privacy, and ROI considerations. Further, utilization of organizational data with GenAI models is imperative to extract valuable business insights. This presentation delves into how IT and business function teams can expedite the delivery of trustworthy GenAI capabilities through standardized, scalable tools and architectures within their organizations
[Source](https://www.youtube.com/watch?v=LEfKbM4zzwI)