
VP, AI Engineering, PIMCO
About the Speaker:
Anupama Garani is VP, AI Engineering at PIMCO, where she has led production GenAI since 2023. She leads architecture, evals, and products that help sales and tech teams work from trusted company knowledge. Before PIMCO she was a BI Analyst at Goldman Sachs Ayco. She has spoken at 20+ AI workshops, conferences, events, and university meetups. She moderated and MC’d sessions at MLOps World | GenAI Summit 2025, and led workshops at UT Austin McCombs and Women in Data Science (WiDS). She serves as a program committee member and reviewer for AAAI/ACM AIES and ACL TrustNLP, founded the Central Texas ODSC chapter, and runs TRUST AI, her 8-week AI program for high school students across the US.
RAG systems fail in many ways. One metric at one stage cannot find them. This talk gives a full map: 33 failure modes across 7 pipeline stages: ingestion, representation, retrieval, generation, evaluation, deployment, and agentic orchestration. The map comes from a structured review of 48 sources, with a formal definition, a visible sign, and an evidence grade (Strong / Moderate / Limited) for each mode. It was published at TrustNLP 2026 (ACL). One finding matters most for agents in production: research studies retrieval and generation well, but it studies representation, evaluation, and agentic orchestration far less. 12 modes have no dedicated peer-reviewed empirical evidence, and all 8 agentic modes are in that set. You will learn to find each failure by stage, test for it before users do, and fix the stage that broke, not only the final answer.
MLOps World | GenAI Summit 2026 is a two days of case studies, workshops, and expo on taking AI/ML and agentic systems into production – at the Etter-Harbin Alumni photo – full-bleed hero or browse files.