Ai4
New York Public Library delayed AI software deployment for a year to establish governance policies and eliminate model hallucinations in its collection search tool.
AI-assisted summary of Building a Responsible AI Playbook at NYPL With New York Public Library — original source. Check the original for full context.
Source published:
Detailed notes
## Background Published on YouTube by Ai4 on August 15, 2026, this presentation features Garvita Kapur, Senior Director of Artificial Intelligence and Software Engineering at the New York Public Library (NYPL). The video covers NYPL's unconventional strategy of prioritizing governance, policy, and principles over initial use cases to establish a responsible AI framework for a public institution.
## TL;DR Garvita Kapur outlines how the New York Public Library developed a responsible AI strategy centered on public trust, veracity, privacy, and digital equity before deploying tools to staff. To combat potential AI hallucinations and protect institutional ethics, NYPL established parallel working groups, benchmarked policies against NIST standards, paused unauthorized 'shadow AI,' and surveyed staff to implement a tiered software rollout starting with Google Workspace tools. The institution successfully trained 92% of its workforce on AI guidelines in 2025 and is expanding into public literacy initiatives for 2026. Additionally, Kapur presents NYPL's in-house 'Enhanced Search' prototype—a retrieval-augmented system covering 1,000,000 public domain books that strictly avoids AI summarization to guarantee factual accuracy.
## Atmosphere & style The presentation carries a professional, grounded, and institutional tone that balances technological innovation with public responsibility. Kapur presents with an engaging, transparent, and thoughtful narrative style, using relatable anecdotes like the Reading Room hallucination incident to vividly illustrate high-stakes library ethics. Watching the talk feels like an insightful look into enterprise governance, characterized by structured pragmatic planning and a strong commitment to public service values.
## Key takeaways - [00:04](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=4s) An incident involving an AI-generated false citation highlighted the necessity for NYPL to approach artificial intelligence with caution to uphold institutional veracity. - [01:50](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=110s) NYPL spent 12 full months developing governance principles and guidelines before releasing any AI tools to staff members. - [01:50](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=110s) The library's AI strategy is anchored on three core institutional commitments: Veracity, Privacy, and Access and Equity. - [03:40](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=220s) Rather than starting with a low-risk use-case pilot, NYPL established governance, board-level accountability, and four parallel working groups first. - [05:12](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=312s) NYPL benchmarked 40 external policies and built a prescriptive framework around the NIST GovAI foundation, defined by 3 Core Objectives and 12 Principles. - [07:15](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=435s) Leadership temporarily paused all staff access and unvetted 'shadow AI' tools to implement a formal intake review process, which has vetted approximately 100 requests. - [08:44](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=524s) An internal survey of ~480 staff members generated nearly 100 use cases, showing that 30% could be met by Google Workspace AI tools like Gemini. - [08:44](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=524s) NYPL ran a controlled pilot with 250 employees to test training, guidelines, and support processes before rolling out tools broadly across the institution. - [10:35](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=635s) To address employee concerns regarding AI and job security, NYPL implemented a two-way engagement strategy including town halls, office hours, and policy updates. - [12:21](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=741s) During Phase 1 (2025), 92% of staff completed mandatory AI training, and over 2,000 active users adopted Google and Gemini tools within the first 3 months. - [12:21](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=741s) In Phase 2 (2026), NYPL plans to launch public AI literacy programs across New York City boroughs in partnership with Queens and Brooklyn public libraries. - [15:09](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=909s) NYPL developed an in-house 'Enhanced Search' prototype using a vector index and RAG over 1,000,000 public domain digitized books. - [15:09](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=909s) To prevent AI hallucinations, the 'Enhanced Search' system intentionally refrains from generating AI prose summaries and strictly outputs direct links to catalog sources. - [18:00](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=1080s) All internal AI initiatives are strictly prioritized based on alignment with NYPL's 5-year institutional strategic plan and its 3 core AI objectives. - [18:00](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=1080s) NYPL does not build or train custom foundation models, relying instead on classical vector retrieval, RAG, and third-party productivity tools.
## Detailed walkthrough ### [00:04](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=4s) The Rose Main Reading Room Hallucination Incident
Garvita Kapur, Head of Software Engineering and AI at the New York Public Library (NYPL), opens her talk with an iconic image of the Rose Main Reading Room on 42nd Street in New York City. She shares the fun fact that this vast hall spans the length of two New York City blocks or an entire football field. Every day, countless writers, scholars, and students gather in this space to consult NYPL’s vast research repository of roughly 57 million items.
She recounts a telling anecdote: a patron once walked up to the reference desk and requested a specific author and reference material. The librarian searched everywhere—catalog, databases, journals—and came up empty-handed. Given NYPL’s 130-year legacy of finding answers or directing researchers to the right source, the librarian pressed the patron on where they got the citation. As it turned out, the citation was entirely AI-generated; neither the author nor the work existed. This incident highlights why an institution rooted in trust and veracity must approach artificial intelligence with utmost caution.
- The NYPL research collection housed for patrons at the 42nd Street building contains roughly 57 million items. - NYPL has been serving the public for over 130 years.
---
[01:50](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=110s) Grounding AI Strategy in Public Trust and Institutional Values
Introducing herself as Senior Director of Artificial Intelligence and Software Engineering at NYPL, Kapur explains that the library spent 12 full months developing governance principles and guidelines before releasing a single AI tool to a single staff member. Rather than following conventional corporate advice, NYPL prioritized caution because "we are a public library and the stakes matter."
Across its 92 physical locations, NYPL receives about 16 million visits annually and hosts 55,000 free public programs. For many New Yorkers, the library serves as the last free public institution available to them. Consequently, NYPL anchored its AI strategy around three pre-existing institutional commitments:
1. **Veracity:** A absolute commitment to truth. Librarians must provide verifiable source material or explicitly admit when they do not know an answer. 2. **Privacy:** Treated not as a mere legal compliance checkbox, but as a core professional ethic—what patrons read remains strictly their own business. 3. **Access and Equity:** Historically, when groundbreaking technologies like the internet arrived, communities on the wrong side of the digital divide turned to libraries for access. AI presents a critical digital equity challenge, making public access and AI literacy essential.
- NYPL network size: 92 locations across New York City. - Annual foot traffic: Approximately 16 million visitors per year. - Annual programming: 55,000 free events and classes offered.
---
[03:40](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=220s) Establishing Governance Structure and Parallel Working Groups
Conventional technology wisdom dictates finding a high-value, low-risk use case, running a pilot, scaling it, and only then drafting governance policy. NYPL flipped this approach by establishing accountability and governance structure first.
Accountability sits with the Chief Digital Officer and the VP of IT, who report on AI strategy directly to the NYPL Board, the President, and executive chiefs. Under them, three Responsible AI working group leads were appointed: the Head of Infrastructure and Operations, the Director of Copyright and Information Policy, and the Head of Software Engineering and AI (Garvita Kapur).
Rather than running a slow sequential waterfall process, NYPL established four parallel working groups to involve staff cross-functionally from across the entire institution: - Policy and Guidelines - Vendor Evaluation - Staff Engagement - Use Case Development
---
[05:12](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=312s) Benchmarking Policies and Defining Core Objectives
To draft their internal policy, the team benchmarked 40 different policies across diverse sectors—including big tech firms, regulated industries, peer libraries, government bodies, and the public sector—to spot trends and gaps. Recognizing that general guidelines were too vague, NYPL built a highly granular and prescriptive framework anchored on the NIST GovAI structural foundation.
To ensure the policy remained closely tied to daily operations, NYPL grounded its framework in 3 Core Objectives and 12 Principles:
**Core Objectives:** 1. **Empower through Education:** Bridging the AI literacy gap for both library staff and patrons. 2. **Enhance and Not Replace:** Using AI strategically to support and augment staff capabilities rather than replace human workers. 3. **Advance Library-Centric Solutions:** Responsibly leveraging AI to unlock library collections and improve patron services.
**12 Core Principles:** Included foundational rules such as *Human-First*, *Accountability*, *Security*, *Privacy*, and *Transparency*. Kapur emphasizes that while technical rules and tools will change over time, these core principles remain constant across every iteration.
---
[07:15](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=435s) Pausing "Shadow AI" and Creating an Intake Vetting Path
As governance planning progressed, "shadow AI" emerged as staff began experimenting with unvetted tools or using software that silently integrated generative AI features. To maintain governance, leadership took the difficult step of pausing all staff access and tool rollouts.
NYPL built a meticulous, repeatable intake review process involving working group members, legal counsel, privacy experts, compliance officers, and cybersecurity teams. Every vendor's terms and conditions were examined with a fine-tooth comb to clarify exact data usage. Under this model, requests are evaluated case-by-case: tools aligning with strategic goals are approved, while non-compliant or unnecessary tools are denied.
- Since launch, the vetting committee has processed approximately 100 software requests.
---
[08:44](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=524s) Surveying Staff Use Cases and Launching the Google Workspace Pilot
To understand organizational demand before procuring software, NYPL distributed an institution-wide survey. Approximately 480 staff members responded, generating nearly 100 distinct use cases. Comparing these requests against vendor capabilities revealed that 30% of the identified use cases could be satisfied by Google's suite of AI tools, such as Gemini. Since NYPL was already a "Google shop," integrating Gemini offered lower friction, simpler rollouts, and built-in adherence to privacy, security, legal, and procurement requirements.
Before releasing AI tools across the entire system, NYPL conducted a controlled pilot with roughly 250 employees. The primary goal of the pilot was not testing vendor software stability, but validating institutional processes: testing whether training programs, guidelines, and support workflows were frictionless for staff.
Following the pilot, NYPL deployed a tiered toolset: - **General Staff Rollout:** Google Gemini, Gemini for Workspace, and NotebookLM. - **Specialized Workflows:** Target tools for technical teams, such as GitHub Copilot (software engineering), Figma AI (design), and Atlassian AI (product management).
---
[10:35](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=635s) Two-Way Communication Strategy and Policy Updates
To address widespread staff anxieties regarding AI technology and job security, NYPL instituted a multifaceted, two-way communication strategy. The engagement working group facilitated transparent dialogue and active feedback loops across the organization.
Engagement activities included: - 4 full-staff Town Halls - 10 targeted Information Sessions - Support sessions for senior leaders to equip them to lead their units - Live training sessions, recorded walkthroughs, live demos, and regular email updates - One-on-one office hours speaking directly with roughly 200 staff members
This continuous feedback loop directly informed policy refinements, leading to an updated set of staff guidelines released in May 2026.
---
[12:21](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=741s) Phase 1 Impact vs. Phase 2 Roadmap
NYPL structured its AI roadmap into two distinct calendar phases: - **Phase 1 (2025):** Establishing internal governance, training staff, and releasing approved tools internally. - **Phase 2 (2026):** Expanding AI literacy programs to patrons and deploying custom library-centric search tools.
**Phase 1 Achievements (2025):** - **Staff Training:** 92% of all NYPL staff successfully completed mandatory training on AI guidelines—a notable achievement given that many operational staff members lack dedicated daily computer access. - **Foundational Adoption:** Optional foundational AI literacy classes were delivered to enthusiastic staff responses. - **Active Usage:** Within the first 3 months of rollout, over 2,000 active staff users routinely utilized Google and Gemini tools, with specialized tools (GitHub Copilot, Figma AI, Atlassian AI) showing particularly high engagement for domain-specific tasks.
**Phase 2 Goals (2026):** - **Public AI Literacy:** Launching pilot public programming (hackathons, guest lectures, community classes). In Fall 2026, NYPL will launch a comprehensive tri-borough public AI literacy initiative in partnership with Queens Public Library and Brooklyn Public Library. - **Enhanced Search:** Releasing an in-house developed, AI-enabled search interface to help patrons explore physical collections.
---
[15:09](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=909s) Building "Enhanced Search": Eliminating Hallucinations by Design
Kapur detail NYPL's prototype project, **Enhanced Search**, built strictly in-house to fulfill the objective of advancing library-centric solutions. She lightheartedly catches herself after accidentally saying "copyright" instead of "public domain," calling it a major faux pas before confirming that the search corpus consists exclusively of public domain materials.
**System Design & Architecture:** - **Corpus:** Approximately 1,000,000 digitized public domain books from NYPL's collections. - **Vector Index & RAG:** Text from the corpus is vectorized. Queries utilize Retrieval-Augmented Generation (RAG) to locate matching text segments. - **LLM Role:** Large Language Models are used strictly for interpreting user query intent and structuring responses. - **No Summarization Policy:** By intentional design, the system **never generates text summaries**. Instead, search results are returned as a ranked list pointing directly to original source materials.
**Engineering Justification:** Refusing to generate AI summaries structurally eliminates hallucinations. From a verification standpoint, an automated system can easily test whether a returned link resolves to an existing book in the catalog, whereas verifying the factual accuracy of AI-generated prose summaries at scale is impossible. This design translates NYPL's core principles of *Veracity* and *Human-First* directly into product architecture. As Kapur summarizes, when the system has no matching source material in the catalog, "it says nothing. And for us, nothing is a legitimate answer."
- Enhanced Search is currently in prototype testing with research librarians and internal staff.
---
[18:00](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=1080s) Q&A: Prioritization Framework, Rare Books, and Tech Stack
Following her talk, Kapur addresses several questions from the audience:
**Prioritizing Initiatives:** An audience member asks how NYPL decides which projects to fund and build first. Kapur explains that every AI initiative must align directly with NYPL's 5-year institutional strategic plan and its 3 core AI objectives. Proposed projects failing to align are immediately rejected. Approved ideas are then prioritized per department based on available funding.
**Rare Book Digitization Practices:** An audience member asks if NYPL has a view on rumors that private AI companies purchase and destructively scan rare books. Kapur notes she cannot speak on corporate behaviors outside NYPL, but clarifies that NYPL strictly adheres to **non-destructive digitization** techniques for all archival materials in its care.
**In-House Technical Architecture & Staff Workflows:** A librarian from Bethpage Public Library on Long Island asks whether NYPL trains its own models and what specific daily use cases staff prefer. Kapur clarifies: - **No Custom Models:** NYPL does not train custom foundation models. They digitize books, generate vector embeddings, and perform vector retrieval (e.g., matching a search for "Brooklyn Bridge" to catalog vectors). She notes the underlying architecture relies more on classical machine learning and retrieval than generative AI. - **Staff Use Cases:** Daily adoption centers around productivity—summarizing meeting transcripts, drafting follow-ups, managing information retrieval, and testing upcoming AI features within digital asset management systems.
## Notable quotes > [01:50](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=110s) we are a public library and the stakes matter. — Garvita Kapur
> [15:09](https://www.youtube.com/watch?v=L3MfbX3Uhiw&t=909s) it says nothing. And for us, nothing is a legitimate answer. — Garvita Kapur
## Mentioned Garvita Kapur, New York Public Library, Ai4, Rose Main Reading Room, NIST, Google, Gemini, NotebookLM, GitHub Copilot, Figma AI, Atlassian AI, Queens Public Library, Brooklyn Public Library, Bethpage Public Library
## Video description Garvita Kapur - Senior Director of Artificial Intelligence and Software Engineering, New York Public Library
Most AI strategy advice tells you to start with use cases. We did the opposite. We started with governance, policy, and principles — before we let anyone touch a tool. It sounds backwards. I'll make the case for why it was exactly right for a public institution.
[Source](https://www.youtube.com/watch?v=L3MfbX3Uhiw)