How Nylas Went from Zero to Daily PRs and 20x Faster Annotation with LLMs
How fast can a lean team turn generative AI into real impact? In this talk from MLOps World | GenAI Summit 2024, Nadia from Nylas shares how her team introduced LLMs into their core ExtractAI product—not with a splashy launch, but through a series of smart, incremental experiments.
From automating tedious dev workflows to dramatically cutting annotation costs and building a fallback strategy that reduced bug tickets by 90%, the Nylas team built real value fast while keeping costs in check.
This talk was recorded during MLOps Word | GenAI Summit 2024 which took place at the Austin Renaissance Hotel.
Presentation Highlights
This talk is for ML teams, AI product managers, and data engineers looking to embed GenAI practically and cost-effectively:
- How a spike sprint helped Nylas evaluate and cost-compare LLM options like OpenAI, Meta, Mistral, and Anthropic
- Using a multi-agent system to automate weekly tasks and reduce dev time by 10 hours/month
- Replacing blind annotation with GPT-powered annotation to save 20x cost and 60x time
- Why fallback strategies (e.g., selectively reprocessing with LLMs) help maintain accuracy while controlling costs
- When and how to build your own LLM serving infrastructure with clear breakeven math
About The Speaker
Nadia Rauch is the Manager of Machine Learning and Data Engineering at Nylas, where she leads applied ML efforts on the ExtractAI platform. Her team focuses on deploying practical intelligence features for email, calendar, and contact workflows.
3 Days of Context, Insights, & Connections
The 6th annual MLOps World | GenAI Summit is taking place October 7–9, 2025 at the Austin Renaissance Hotel.
Don’t miss this chance to accelerate and de-risk your AI/ML, agentic, and infrastructure outcomes through cutting-edge strategies, real-world case studies, technical deep dives, and hands-on workshops. Every presentation is hand-picked by a committee of top AI practitioners whose primary goal is to help industry colleagues understand where the line of AI in production excellence is, right now.
The experience also includes a vibrant expo, where attendees shift from focused learning to active participation by engaging in Brain Dates, Community Stage, Startup Zone, and interactive demos with leading vendors like Weights & Measures, Outerbounds, and Data Bricks.
MLOps World | GenAI Summit is a compact, high-impact way to learn, connect, and elevate your team, projects, and career.
Early Bird tickets are on sale now and offer 15% savings when you register in advance.