TMLS Backstage: LLM Evals & Guardrails In Production

Discussing Best Practices for Monitoring and Improving Production GenAI Systems

Join us July 29, 2025 for the launch of TMLS Backstage, our new live podcast series featuring candid conversations between subject matter experts on the latest tech, trends, and issues impacting AI/ML practitioners. Discussions are followed by audience Q&A.

Improving Production GenAI Systems

In this first edition, host Aishwarya Naresh Reganti (Founder, LevelUp Labs) will be joined by Rachitt Kumar (Applied AI consultant) and Claire Longo (Lead AI Researcher, Comet) for a conversation on how to evaluate and monitor GenAI applications using LLM Evals and guardrails. The foundational tools for building safer, more reliable AI systems.

This will be an engaging discussion on what it really takes to move beyond vibe checks and build GenAI systems that can be trusted at scale. From aligning GenAI performance with business KPIs to deploying monitoring frameworks that catch failures before your users do, these experts will walk through actionable strategies based on real-world experience.

Whether you’re launching chatbots, automating content, or building agentic tools, this session will give you a clearer understanding of how to evaluate quality, detect issues, and reduce risk in production.

Note: This edition of TMLS Backstage is part of the up-coming Stack Session 03, a free webinar which will feature demos from AI leading vendors, including NVIDIA.

Meet The Experts

Aishwarya Naresh Reganti is the founder of LevelUp Labs. Previously, she was an Applied Science Tech Lead at the AWS Generative AI Innovation Center and led projects at Amazon Search AI on large-scale models for search and recommendations. With 9+ years in ML and 35+ top-tier publications, her work spans graph neural networks, machine translation, and human-centric AI. She collaborates widely and lectures at MIT and Oxford.

Rachitt Shah brings a unique perspective shaped by his diverse background in AI engineering, venture capital, and software development. From deploying GPT-3 in production as early as 2022 at General Catalyst, to his work with Sequoia Capital India, and advising startups through his consulting practice, Rachitt offers a comprehensive view on building and investing in emerging technologies. Join him as he shares his experiences, explores the intersection of AI and business, and discusses the future of innovation.

Learn more

Claire Longo is an AI leader with over a decade of experience across Data Science, Machine Learning, and MLOps. She’s led cross-functional AI teams at Twilio, Opendoor, and Arize AI, focusing on production-grade ML systems. Now at Comet, she researches AI trends and shares best practices with the developer community. Claire began her career as a Statistician at DOE labs, later building recommender systems at Trunk Club, and holds degrees in Applied Math and Statistics from UNM.

MLOps World | GenAI Summit 2025

Our next flagship event is taking place October 7–9 at the Austin Renaissance Hotel. Join us for real-world case studies, hands-on workshops, career-defining meetups, and more. Tickets on sale now

Stay Connected

Want more content like this, straight to your inbox? Sign up for the TMLS monthly newsletter to learn from expert voices, attend free virtual events, and get open resources including exclusive offers on leading AI/ML stack tools.

Visit: mlopsworld.com

About TMLS

TMLS is a global community for AI Engineers, Data Scientists, ML Engineers, Full-Stack Developers, infrastructure teams, and entrepreneurs. We share lessons, support each other’s growth, and stay grounded in what actually works. Through peer-curated events like TMLS Summit (June, Toronto) and MLOps World (October, Austin), free online learning sessions, and exclusive resources, we help teams deliver and scale AI projects safely and responsibly. In a space moving as fast as artificial intelligence, context is everything. Our mission is to help top practitioners find it.