Free Virtual October 6-7 | In-person October 8-9

All sessions and workshops curated by leading AI/ML practitioners

Agents in Production

Augmenting Workforces with Agents

Evolution of Agents

ML Collaboration in Large Organizations

AI Agents for Developer Productivity

AI Agents for Model Validation and Deployments

Data Engineering in an LLM era

ML Training Lifecycle

Latest MLOps Trends

LLMs on Kubernetes

Multimodal Systems in Production

Scoping and Delivering Complex AI Projects

Virtual Day

Lightning Talks

Speakers Corner

The Next Wave of AI

more coming soon

Agenda

This agenda is still subject to changes.

Join free virtual sessions October 6–7, then meet us in Austin for in-person case studies, workshops, and expo October 8–9

Powered By Whova
Best App for Conferences

Talk: Doxing Dark Money: Entity Resolution to Empower Downstream Ai Applications in Anti-Fraud

Presenter:
Paco Nathan, Principal DevRel Engineer, Senzing

About the Presenter:
Paco Nathan leads DevRel for the Entity Resolved Knowledge Graph practice area at Senzing.com and is a computer scientist with +40 years of tech industry experience and core expertise in data science, natural language, graph technologies, and cloud computing. He’s the author of numerous books, videos, and tutorials about these topics. He also hosts the monthly “Graph Power Hour!” webinar.

Paco advises Kurve.ai, EmergentMethods.ai, and is lead committer for the `pytextrank` and `kglab` open source projects. Formerly: Director of Learning Group at O’Reilly Media; and Director of Community Evangelism at Databricks.

Talk Track: Agents in Production

Technical Level: 2

Talk Abstract:
The Dark Web: an estimated $3T USD flows annually through shell companies leveraging tax havens worldwide — serving as the _perpetua mobilia_ for oligarchs, funding illegal weapons transfers, cyber attacks at global scale, human trafficking, anti-democracy campaigns, even illegal fishing fleets. The tendrils of kleptocracy extend throughout our political and economic system.

People who hunt bad guys” — investigative journalists, OSINT, regulators, gov agencies, law enforcement, FinCrime investigation units, etc. — leverage both graph analytics and downstream AI apps to contend with the overwhelming data volumes. Our team provides core technology — entity resolution — used in this work, and other public sector such as the major of voter registration in the US. Most of our use cases run in air-gapped environments, based on large-scale distributed infrastructure, streaming data from multiple sources. In these production use cases, even with several billion graph elements, decisions to “merge” or “disambiguate” known entities can be propagated with milliseconds of a new record arriving.

Among those who perform this kind of confidential work, few are permitted to speak at tech conferences. However, we can use open source, open models, and open data to illustrate these kinds of applications. We’ll show how technology gets used to stick the moves of the world’s worst organized crime rings, how to fight against oligarchs who use complex networks to hide their grift. On the flip side, similar approaches can be leveraged to find your best customers within a graph.

This talk explores known cases, the fraud tradecraft employed, open data sources, and how technology gets leveraged. There are multiple areas were multimodal agentic workflows (e.g., based on BAML) play important roles, both for handling unstructured data sources and for actions taken based on inference. Moreover, we’ll look at where data professionals are very much needed, where you can get involved.

What You’ll Learn:
How a combination of graph technologies and downstream AI applications gets leveraged for fighting FinCrime and transnational corruption in general.

Talk: Why CI/CD Fails for AI, and How CC/CD Fixes I

Presenters:
Aishwarya Naresh Reganti, Founder, LevelUp Labs, Ex-AWS | Kiriti Badam, Member of Technical Staff, OpenAI

About the Presenters:
Aishwarya Naresh Reganti is the founder of LevelUp Labs, an AI services and consulting firm that helps organizations design, build, and scale AI systems that actually work in the real world. She has led engagements with multiple Fortune 500 companies and fast-growing startups, helping them move beyond demos to production-grade AI.

Before founding LevelUp Labs, she served as a tech lead at the AWS Generative AI Innovation Center, where she led and implemented AI solutions for a wide range of AWS clients. Her work spanned industries such as ISVs, banking, healthcare, e-commerce, and legal tech, with publicly referenced engagements including Bayer, NFL, Zillow, Kayak, and Imply (creators of Apache Druid).

Aishwarya holds a Master’s in Computer Science from Carnegie Mellon University (MCDS) and has authored 35+ papers in top-tier conferences including NeurIPS, ACL, CVPR, AAAI, and EACL. Her research background includes work on graph neural networks, multilingual NLP, multimodal summarization, and human-centric AI. She has mentored graduate students, served as a reviewer for major AI conferences, and collaborated with research teams at Microsoft Research, NTU Singapore, University of Michigan, and more.

Today, Aishwarya teaches top-rated applied AI courses, advises executive teams on AI strategy, and speaks at global conferences including TEDx, ReWork, and MLOps World. Her insights reach over 100,000 professionals on LinkedIn.

Kiriti Badam is a member of the technical staff at OpenAI, with over a decade of experience designing high-impact enterprise AI systems. He specializes in AI-centric infrastructure, with deep expertise in large-scale compute, data engineering, and storage systems. Prior to OpenAI, Kiriti was a founding engineer at Kumo.ai, a Forbes AI 50 startup, where he led the development of infrastructure that enabled training hundreds of models daily—driving significant ARR growth for enterprise clients. Kiriti brings a rare blend of startup agility and enterprise-scale depth, having worked at companies like Google, Samsung, Databricks, and Kumo.ai.

Talk Track: Agents in Production

Technical Level: 2

Talk Abstract:
AI products break the assumptions traditional software is built on. They’re non-deterministic, hard to debug, and come with a tradeoff no one tells you about: every time you give an AI system more autonomy, you lose a bit of control.

This talk introduces the Continuous Calibration / Continuous Development (CC/CD) framework, designed for building AI systems that behave unpredictably and operate with increasing levels of agency. Based on 50+ real-world deployments, CC/CD helps teams start with low-agency, high-control setups, then scale safely as the system earns trust.

What You’ll Learn:
You’ll learn how to scope capabilities, design meaningful evals, monitor behavior, and increase autonomy intentionally, so your AI product doesn’t collapse under real-world complexity.

Talk: From Static IVRs to Agentic Voice AI: Building Real-Time Intelligent Conversations

Presenter:
Pablo Salvador Lopez, Principal AI Application Development Architect – AI Solution Engineering Global Black Belt Team, Microsoft

About the Presenter:
As an AI Solution Engineering Leader in Microsoft’s Global Black Belt team—the elite force driving AI and cloud application innovation within the Azure ecosystem—I design and deliver transformative Generative AI solutions for some of the world’s most complex and highly regulated industries. My work bridges deep technical skills with mission-critical execution—specializing in Retrieval-Augmented Generation (RAG), agentic AI systems, and scalable multi-agent orchestration using Azure AI, OpenAI, and frameworks like Semantic Kernel or any custom stacks.

I design intelligence from the ground up—combining LLMs and custom orchestration frameworks to create real-time, memory-aware agents that reason, act, and collaborate.

My foundation spans full-stack data science, ML engineering, and software architecture. I’ve led real-time and batch AI deployments for Fortune 500 enterprises, with expertise across MLOps/LLMOps and high-throughput inference—anchored in cloud platforms like Azure, GCP, and AWS.

Where others see ambiguity, I see momentum. I’m known for turning raw ideas into production-grade systems—either by building from first principles or rethinking the “rules” when innovation demands it. My mission is to build systems that matter—empowering teams to do their best work, and leaving every product, platform, pattern and person stronger than I found them.

Beyond industry, I’m committed to education and community. As an Adjunct Instructor in Northwestern University’s MSAI program, I teach hands-on courses in Cloud AI, GenAI, RAG, and multi-agent systems. I mentor startups, serve on advisory boards, and contribute to open-source AI—sharing ideas that move the field forward.

Explore my blog | Check out my GitHub

Talk Track: Agents in Production

Technical Level: 3

Talk Abstract:
Developers today face the challenge of transforming outdated IVRs and traditional voice systems into intelligent, responsive interactions. This session dives into the concept of agentic voice AI—systems capable of real-time reasoning, decision-making, and dynamic action execution. We’ll explore how to architect modular voice applications using Azure, orchestrate multiple autonomous agents for specialized tasks, and leverage real-time AI inference to produce fluid, human-like conversations. Attendees will learn practical strategies to design agentic voice interactions, enabling their systems to autonomously plan, act, and dynamically adapt to user contexts and needs.

What You’ll Learn:
Attendees will leave equipped with a clear understanding of agentic architecture in real-time voice applications, including practical techniques for orchestrating multiple specialized agents, integrating dynamic reasoning, leveraging memory, and optimizing speech latency. They will be empowered to move beyond static IVRs towards fully autonomous, intelligent voice experiences.

Talk: The Hard Truth About AI Agents: Lessons Learned from Running Agents in Production

Presenter:
Hannes Hapke, Principal Machine Learning Engineer, Digits

About the Speaker:
Hannes Hapke is a principal machine learning engineer at Digits, where he has spent years building production AI systems that accountants and business owners actually use daily.

Before Digits, he solved ML infrastructure problems across healthcare, retail, and renewable energy – industries where failure isn’t an option. At SAP Concur, he learned that impressive prototypes and production systems are entirely different beasts.

Hannes co-authored numerous machine learning books, including “Building Machine Learning Pipelines” and “Machine Learning Production Systems” (O’Reilly), and his upcoming “GenAI Design Patterns” book addresses the gap between AI hype and reality. As a Google Developer Expert for Machine Learning, he’s committed to sharing the hard truths about production ML.

Talk Track: Agents in Production

Talk Technical Level: 2/7

Talk Abstract:
Every conference showcases impressive agent demos. What they don’t show you are the 3 AM pages when agents go rogue, the customer support tickets when AI makes expensive mistakes, or the months of debugging why your “95% accurate” prototype becomes 60% reliable in production.

This talk cuts through the agent hype with unfiltered lessons from Digits’ journey deploying customer-facing agents that handle real financial data. Hannes will share the architectural decisions that actually matter (hint: it’s not the framework you choose), the monitoring approaches that catch problems before customers do, and the failure modes that no one warns you about.

You’ll learn why agent evaluation in development predicts almost nothing about production performance, how to build guardrails that don’t cripple functionality, and why the hardest problems aren’t technical – they’re about managing expectations and building trust.

This presentation is a field guide to the messy reality of production agents, complete with practical design patterns for Hannes’ newest O’Reilly publication “Generative AI Design Patterns” (together with Dr. Valliappa Lakshmanan), and the kind of lessons learned you only get from keeping systems running when money is involved.

What You’ll Learn:
– Production Reality Check: Why impressive demos fail spectacularly in production and how to bridge that gap

– Architecture for Reliability: The infrastructure patterns that actually matter for agent systems at scale

– Architecture for Observability: The specific ways to monitor agents in production

Talk: Building Conversational AI Agents with Thread-Level Eval Metrics

Presenters:
Claire Longo, Lead AI Researcher, Comet | Tony Kipkemboi, Head of Developer Relations, CrewAI

About the Presenters:
Tony Kipkemboi leads Developer Advocacy at CrewAI, where he helps organizations adopt AI agents to drive efficiency and strategic decision-making. With a background spanning developer relations, technical storytelling, and ecosystem growth, Tony specializes in making complex AI concepts accessible to both technical and business audiences.

He is an active voice in the AI agent community, hosting workshops, podcasts, and tutorials that explore how multi-agent orchestration can reshape the way teams build, evaluate, and deploy AI systems. Tony’s work bridges product experimentation with real-world application; empowering developers, startups, and enterprises to harness AI agents for measurable impact.

At MLops World, Tony brings his experience building and scaling with CrewAI to demonstrate how agent orchestration, when paired with rigorous evaluation, accelerates the path from prototype to production.

Claire Longo is an AI leader and Mathematician with over a decade of experience in Data Science and AI. She has led cross-functional AI teams at Twilio, Opendoor, and Arize AI and is currently a Lead AI Researcher at Comet. She holds a Bachelor’s in Applied Mathematics and a Master’s in Statistics from The University of New Mexico. Beyond her technical work, Claire is a Speaker, Advisor, YouTuber, and Poker Player. She is dedicated to mentoring Engineers and Data Scientists while championing diversity and inclusion in AI. Her mission is to empower the next generation of AI practitioners.

Talk Track: Agents in Production

Technical Level: 4

Talk Abstract:
Building modern conversational AI Agents means dealing with dynamic, multi-step LLM reasoning processes and tool calling that cannot always be predicted or debugged at the trace level alone. During the conversation, we need to understand if the AI accomplishes the user’s goal while staying aligned with intent and delivering a smooth interaction. To truly measure quality, we need to trace and evaluate entire conversation sessions.

In this talk, we introduce a practical workflow for designing, orchestrating, and evaluating conversational AI Agents by combining CrewAI as the Agent development framework with Comet Opik for custom eval metrics.

On the CrewAI side, we’ll showcase how developers can define multi-agent workflows, specialized roles, and task orchestration that mirror real-world business processes. We’ll demonstrate how CrewAI simplifies experimentation with different agent designs and tool integrations, making it easier to move from prototypes to production-ready agents.

On the Opik side, we’ll go over how to capture expert human-in-the-loop feedback and build thread-level evaluation metrics. We’ll show how to log traces, annotate sessions with expert insights, and design LLM-as-a-Judge metrics that mimic human reasoning; turning domain expertise into a repeatable feedback loop.

Together, this workflow combines agentic orchestration + rigorous evaluation, giving developers deep observability, actionable insights, and a clear path to systematically improving conversational AI in real-world applications.

What You’ll Learn:
You can’t reliably build conversational AI agents without treating orchestration and evaluation as two halves of the same workflow; CrewAI structures the agent, Comet Opik ensures you can measure and improve it.

Talk: From Vectors to Agents: Managing RAG in an Agentic World

Presenter:
Rajiv Shah, Chief Evangelist, Contextual AI

About the Presenter:
Rajiv Shah is the Chief Evangelist at Contextual AI with a passion and expertise in Practical AI. He focuses on enabling enterprise teams to succeed with AI. Rajiv has worked on GTM teams at leading AI companies, including Hugging Face in open-source AI, Snorkel in data-centric AI, Snowflake in cloud computing, and DataRobot in AutoML. He started his career in data science at State Farm and Caterpillar.

Rajiv is a widely recognized speaker on AI, published over 20 research papers, been cited over 1000 times, and received over 20 patents. His recent work in AI covers topics such as sports analytics, deep learning, and interpretability.

Rajiv holds a PhD in Communications and a Juris Doctor from the University of Illinois at Urbana Champaign. While earning his degrees, he received a fellowship in Digital Government from the John F. Kennedy School of Government at Harvard University. He is well known on social media with his short videos, @rajistics, that have received over ten million views.

Talk Track: Agents in Production

Technical Level: 2

Talk Abstract:
The RAG landscape has evolved so quickly. We’ve gone from simple keyword search to semantic embeddings to multi-step agentic reasoning. With all these approaches, we see the rise of context engineering in mastering the best RAG for the problem. This talk helps you understand the right search architecture for your use case.
We’ll examine three distinct architectural patterns, including Speedy Retrieval (<500 ms), Accuracy Optimized RAG (<10 seconds), and Exhaustive Agentic Search (10s to several minutes). You’ll see how context engineering evolves across these patterns: from basic prompt augmentation in Speed-First RAG, to dynamic context selection and compression in hybrid systems, to full context orchestration with memory, tools, and state management in agentic approaches.
The talk will include a framework for selecting RAG architectures, architectural patterns with code examples, and guidance on practical issues around RAG infrastructure.

What You’ll Learn:
RAG has matured enough that we can stop chasing the bleeding edge and start making boring, practical decisions about what actually ships.

Points:
– Attendees should leave knowing exactly when to use speedy retrieval vs. agentic search
Most use cases don’t need agents (and shouldn’t pay for them)
– As retrieval improves, managing the context window becomes the real challenge
Success isn’t about retrieving more – it’s about orchestrating what you retrieve
– Agentic search can cost 100x more than vector search
Sometimes “good enough” at 500ms beats “perfect” at 2 minutes

Talk: Agent Name Service (ANS) in Action – A DNS-like Trust Layer for Secure, Scalable AI-Agent Deployments on Kubernetes

Presenter:
Akshay Mittal, Staff Software Engineer, PayPal

About the Presenter:
Akshay Mittal is a Staff Software Engineer at PayPal and an IEEE Senior Member with over a decade of experience in full-stack development and cloud-native systems. He is currently pursuing a PhD at the University of the Cumberlands, focusing on AI/ML-driven security for cloud architectures. Akshay actively contributes to the Austin tech community through speaking engagements, mentoring, and IEEE and ACM initiatives, with a professional mission of advancing technical excellence and fostering innovation.

Talk Track: Agents in Production

Technical Level: 3

Talk Abstract:
Enterprise MLOps is rapidly shifting from model-centric pipelines to agent-centric ecosystems, where autonomous AI agents continuously retrain models, validate data, and remediate incidents without human intervention. Yet most production platforms still lack a uniform mechanism to discover, authenticate, and govern these agents. This session introduces the Agent Name Service (ANS) – an open, DNS-inspired protocol that assigns unique identities, publishes verifiable metadata, and issues capability attestations for AI agents running on Kubernetes. Drawing on lessons learned from securing PayPal’s global API platform, I will demonstrate how ANS enables end-to-end trust across the ML lifecycle: model-validation agents that flag concept drift, deployment agents that patch mis-configured Helm charts, and guard-agent ensembles that enforce policy-as-code in real time. A live demo will show ANS integrated with GitOps, Open Policy Agent, Sigstore, and an open-source agent-orchestration framework, highlighting zero-trust handshakes, key rotation, and automated RBAC provisioning. Attendees will leave with practical templates and a GitHub reference implementation ready for pilot adoption.

What You’ll Learn:
1. Why identity and capability verification are the missing guardrails for agentic MLOps

2. Reference architecture for deploying ANS on a Kubernetes stack with GitOps, OPA, and Sigstore

3. Patterns for chaining validation, remediation, and notification agents while preserving least-privilege access

4. Performance and security benchmarks from a production pilot handling 1 000+ daily agent interactions

Talk: Testing AI Agents: A Practical Framework for Reliability and Performance

Presenter:
Irena Grabovitch-Zuyev, Staff Applied Scientist, PagerDuty

About the Presenter:
Irena Grabovitch-Zuyev is a Staff Applied Scientist at PagerDuty and a driving force behind PagerDuty Advance, the company’s generative AI capabilities. She leads the development of AI agents that are transforming how customers interact with PagerDuty, pushing the boundaries of incident response and automation.

With over 15 years of experience in machine learning, Irena specializes in generative AI, data mining, machine learning, and information retrieval. At PagerDuty, she partners with stakeholders and customers to identify business challenges and deliver innovative, data-driven solutions.

Irena earned her graduate degree in Information Retrieval in Social Networks from the Technion – Israel Institute of Technology. Before joining PagerDuty, she spent five years at Yahoo Research as part of the Mail Mining team, where her machine learning solutions for automatic extraction and classification were deployed at scale, powering Yahoo Mail’s backend and processing hundreds of millions of messages daily.

She is the author of several academic articles published at top conferences and the inventor of multiple patents. Irena is also a passionate advocate for increasing representation in tech, believing that diversity and inclusion are essential to innovation.

Talk Track: Agents in Production

Technical Level: 3

Talk Abstract:
As AI agents powered by large language models (LLMs) become integral to production systems, ensuring their reliability and safety is both critical and uniquely challenging. Unlike traditional software, agentic systems are dynamic, probabilistic, and highly sensitive to subtle changes—making conventional testing approaches insufficient.

This talk presents a practical framework for testing AI agents, grounded in real-world experience developing and deploying production-grade agents at PagerDuty. The main focus will be on iterative regression testing: how to design, execute, and refine regression tests that catch failures and performance drifts as agents evolve. We’ll walk through a real use case, highlighting the challenges and solutions encountered along the way.

Beyond regression testing, we’ll cover the additional layers of testing essential for agentic systems, including unit tests for individual tools, adversarial testing to probe robustness, and ethical testing to evaluate outputs for bias, fairness, and compliance. Finally, I’ll share how we’re building automated pipelines to streamline test execution, scoring, and benchmarking—enabling rapid iteration and continuous improvement.

Attendees will leave with a practical, end-to-end framework for testing AI agents, actionable strategies for regression and beyond, and a deeper understanding of how to ensure their own AI systems are reliable, robust, and ready for real-world deployment.

What You’ll Learn:
Attendees will learn a practical, end-to-end framework for testing AI agents—covering correctness, robustness, and ethics—so they can confidently deploy reliable, high-performing LLM-based systems in production.

Talk: Context is King: Scaling Beyond Prompt Engineering at BlackRock

Presenters:
Vaibhav Page, Principal Engineer, Blackrock | Infant Vasanth, Senior Director of Engineering, Blackrock

About the Presenters:
Vaibhav is a Principal Engineer at BlackRock, where he leads the development of the Data Science and AI platform powering investment research and automation across the firm. Vaibhav is also the author of Argo-Events, a CNCF-graduated project widely used for event-driven automation in cloud-native environments.

Infant Vasanth leads the engineering team responsible for the Studio Compute Platform, BlackRock’s analytics and automation platform that enables our users to conduct research & analysis, run automations and distribute research at scale.
In addition, Infant is also leading the Data & AI Acceleration team focusing on efforts to enhance Aladdin Studio’s AI capabilities alongside the Operational AI capabilities(prospectus analyzer, operational agents etc.)

Talk Track: Augmenting Workforces with Agents

Technical Level: 2

Talk Abstract:
As AI use cases grow in complexity, prompt engineering along is insufficient. In this talk, we will discuss BlackRock’s evolution of engineering relevant contexts for a broad range of AI use cases from generating investment signals to optimizing operational processes. Furthermore, building the right context in real-time has its own set of challenges ranging from context window limitations, finding the relevant information, and running evaluations on the generated context. We’ll demonstrate how thoughtful context design leads to more robust and adaptable AI agents. We will go over the art and science of building relevant contexts for complex financial use cases and its associated challenges.

What You’ll Learn:
This session offers a practical guide and framework for users looking to build or engineer relevant contexts at scale for their AI applications and use cases. By showcasing how the framework accelerates the creation of these AI Contexts, the session will provide actionable insights for teams aiming to develop and deploy custom AI solutions. We’ll walk through real-world examples, including some of the challenges we faced while building contexts for different teams at BlackRock. The design principles, architectural patterns, and context engineering strategies shared can be applied across industries to reduce hallucinations and give relevant answers. Attendees will also learn how this looks like in a highly regulated environment where adhering to industry-standard security practices is of outmost importance.

Talk: Where Experts Can't Scale: Orchestrating AI Agents to Structure the World's Product Knowledge

Presenters:
Kshetrajna Raghavan, Principal Machine Learning Engineer, Shopify | Ricardo Tejedor Sanz, Senior Taxonomist, Shopify

About the Presenters:
Kshetrajna is a Principal Machine Learning Engineer at Shopify with 15 years of experience delivering AI solutions across technology, healthcare, and retail. He has led initiatives in large-scale product search, computer vision, natural language processing, and predictive modeling—translating cutting-edge research into systems used by millions. Known for his pragmatic approach, he focuses on building scalable, high-impact machine learning products that drive measurable business results.

Ricardo Tejedor Sanz is a Senior Taxonomist at Shopify with a distinctive background spanning legal experience, linguistics, and machine learning. With diverse analytical experience across international contexts and master’s degrees in English Literature and Audiovisual Translation, plus fluency in four languages, Ricardo brings exceptional rigor and customer-focused problem-solving to taxonomy challenges. He evolved from traditional manual taxonomy methods built on deep market research, competitive analysis, and semantic understanding, to pioneering AI-driven classification systems benefiting millions of merchants globally.

Talk Track: Augmenting Workforces with Agents

Technical Level: 2

Talk Abstract:
How do you maintain a product taxonomy spanning millions of items across every industry—from guitar picks to industrial sensors—when no human team could possibly possess expertise in all these domains? At Shopify, we faced this exact challenge and built an AI agentic system that transforms an impossible human task into a scalable, automated workflow.

In this talk, we reveal how we orchestrate multiple specialized AI agents to analyze, improve, and validate taxonomy changes at unprecedented scale.

You’ll discover:
– How parallel AI agents can augment human expertise across domains where deep knowledge is impossible to maintain
– The architecture patterns that enable agents to work together while maintaining quality and consistency
– Why LLM-as-judge systems are game-changers for scaling quality control
– Critical lessons learned from production deployment, including surprising failures and how we fixed them

We share real metrics showing how this approach transformed a years-long manual process into days of AI-augmented work, and provide actionable insights you can apply to your own “impossible” classification and curation challenges.
Whether you’re dealing with content moderation, data classification, or any task requiring expertise across vast domains, you’ll leave with concrete strategies for building AI agent systems that scale human judgment beyond traditional limitations.

What You’ll Learn:
1. Decompose “Impossible” Into Specialized Agents
Don’t build one AI to know everything. Build many agents that each know something, then orchestrate them.

2. LLM-as-Judge Unlocks Scale
Shifting from “humans review 100%” to “AI pre-screens, humans see 10%” is the game-changer. Key: Let AI fix minor issues, not just reject.

3. Production Lessons Are Brutal
– Prompt overload breaks reasoning
– Always build fallbacks for when services fail

4. Trust Through Transparency
Every AI decision needs reasoning, audit trails, and escalation paths. No black boxes.

5. The Meta-Lesson
Scale isn’t about replacing humans—it’s about amplifying the expertise you have across domains you couldn’t possibly cover.

Talk: How Math-Driven Thinking Builds Smarter Agentic Systems

Presenter:
Claire Longo, Lead AI Researcher, Comet

About the Presenter:
Claire Longo is an AI leader and Mathematician with over a decade of experience in Data Science and AI. She has led cross-functional AI teams at Twilio, Opendoor, and Arize AI and is currently a Lead AI Researcher at Comet. She holds a Bachelor’s in Applied Mathematics and a Master’s in Statistics from The University of New Mexico. Beyond her technical work, Claire is a Speaker, Advisor, YouTuber, and Poker Player. She is dedicated to mentoring Engineers and Data Scientists while championing diversity and inclusion in AI. Her mission is to empower the next generation of AI practitioners.

Talk Track: Evolution of Agents

Technical Level: 3

Talk Abstract:
Everyone’s buzzing about LLMs, but too few are talking about the math that should guide how we apply them to real-world problems. Mathematics is the language of AI, and a foundational understanding of the math behind AI model architectures should drive decisions when we’re building AI systems.

In this talk, I will do a technical deep dive to demystify how different mathematical architectures in AI models can guide us on how and when to use each model type, and how this knowledge can help us design agent architectures and anticipate potential weaknesses in production so we can safeguard against them. I’ll break down what LLMs can do (and where they fall apart), clarify the elusive concept of “reasoning,” and introduce a benchmarking mindset rooted in math and modularity.

To put it all into context, I’ll share a real-world example of an Agentic use case from my own recent project: a poker coaching app that blends an LLM reasoning model as the interface with statistical models analyzing a player’s performance using historical data. This is a strong example of the future of hybrid agents, where LLMs and other mathematical algorithms work together, each solving the part of the problem it’s best suited for. It demonstrates the proper application of reasoning models grounded in their mathematical properties and shows how modular agent design allows each model to focus on the piece of the system it was built to handle.

I’ll also introduce a scientifically rigorous approach to benchmarking and comparing models, based on statistical hypothesis testing, so we can quantify and measure the impact of different models on our use cases as we evaluate and evolve agentic design patterns.

Whether you’re building RAG agents, real-time LLM apps, or reasoning pipelines, you’ll leave with a new lens for designing agents. You’ll no longer have to rely on trial and error or feel like you’re flying blind with a black-box algorithm. Foundational mathematical understanding will give you the intuition to anticipate how a model is likely to behave, reduce time to production, and increase system transparency.

What You’ll Learn:
It’s easier than you think to understand foundational mathematical concepts in AI, and use that knowledge to guide you build better AI systems

Talk: From Schema Discovery to Kubernetes: Building an Autonomous Agent for Real-Time Apache Flink Apps with LangGraph

Presenter:
Purshotam Shah, Senior Princ Software Developer Engineer, Yahoo

About the Presenter:
Software Engineer on Yahoo’s Low Latency team, overseeing Apache Storm, ZooKeeper, and Flink deployments.

Talk Track: AI Agents for Model Validation and Deployments

Technical Level: 3

Talk Abstract:
In the era of generative AI, the focus of MLOps is shifting from managing models to managing autonomous agents that can write, test, and deploy their own code. This session presents a real-world case study on building a sophisticated AI agent that automates the entire lifecycle of a real-time Apache Flink application. The process is initiated from a single prompt where the user only needs to specify the location of their data schema in a registry like data.all. From there, the agent takes over, creating the code, discovering the schema, generating a corresponding serializer, building and pushing a Docker image via a Screwdriver pipeline, and finally deploying that image to create a production-ready Flink cluster on Kubernetes.

We will demonstrate how we used LangGraph to orchestrate a stateful workflow that intelligently scaffolds a Maven project, generates type-safe Java code based on centralized schemas, and writes its own unit tests. The core of our talk focuses on the self-healing CI/CD pipeline: when the initial build or tests fail, the agent analyzes the Maven error logs, identifies the root cause (be it a dependency issue in the pom.xml or a compilation error in the Java code), and autonomously performs repairs by prompting an LLM with the precise context needed for a fix.

Finally, we’ll cover the final mile of the pipeline, where the agent generates the necessary Dockerfile and screwdriver.yaml configurations to build a container, push it to a registry, and prepare it for deployment to a Kubernetes cluster. We’ll also touch on how we use specialized tracing tools to trace the agent’s complex decision-making process, providing critical observability into our autonomous development loop.

What You’ll Learn:
Architect Stateful AI Agents: Learn to design and build multi-step, autonomous agents using LangGraph to manage complex software engineering workflows, moving beyond simple, stateless API calls.

Automate Build & Test Cycles: Implement a CI/CD pipeline where an AI agent can autonomously diagnose and fix its own build failures, including dependency conflicts in pom.xml, Java compilation errors, and failing unit tests.

Enforce Enterprise-Grade Reliability: Discover techniques to ground LLM-generated code against sources of truth, such as a data.all schema registry and version-locked dependency rules, to ensure correctness and consistency.

Achieve Prompt-to-Prod Automation: Walk away with a complete methodology for creating a prompt-driven development lifecycle, from schema discovery and code generation to Dockerization and Kubernetes deployment.

Talk: Fake Data, Real Power: Crafting Synthetic Transactions for Bulletproof AI

Presenter:
Bhavana Sajja, Senior Machine Learning Engineer, Expedia Inc.

About the Speaker:
A Senior Machine Learning Engineer at Expedia Inc Company, I lead the end-to-end development and operationalization of AI/ML solutions across high-impact use cases such as fraud detection, supplier screening, and dynamic fraud listing. With a strong foundation in building, deploying, and monitoring production-grade models, I ensures that data pipelines, model performance, and governance frameworks align seamlessly with both business objectives and compliance requirements.

Known for a solutions-oriented mindset, I thrive on adopting emerging technologies to address real-world challenges. Currently, I am exploring agentic AI paradigms—such as agent-to-agent (A2A) protocols and model-context protocol (MCP) architectures—to enhance the reliability, adaptability, and explainability of fraud prevention systems. Our work focuses on crafting autonomous pipelines that can detect novel attack vectors in near real-time, prioritize high-risk cases, and continuously refine detection strategies through feedback loops.

Beyond day-to-day engineering, I actively contributes to cross-functional initiatives: mentoring junior engineers, sharing best practices at internal knowledge-shares, and evaluating new MLOps tools to accelerate model iteration cycles. With a passion for continuous learning, I participate in developer forums—bridging the gap between cutting-edge research and enterprise-scale deployments.

Talk Track: Data Engineering in an LLM era

Talk Technical Level: 2/7

Talk Abstract:
In today’s AI-driven world, organizations want to use their rich transaction records for insights and model building but worry about exposing sensitive customer details. This talk offers a clear, practical guide to creating high-quality synthetic transaction data—data that looks and behaves like real records but contains no actual customer information. We’ll focus on why good data quality is essential for any AI model: without realistic patterns and relationships, models trained on synthetic data simply won’t perform well.

We’ll first highlight the main hurdles in transaction tables: mixed data types (numbers, categories, dates), rare events (like fraud), and complex links between features. Then, we’ll introduce four proven generative approaches—GANs (Generative Adversarial Networks), TVAEs (Tabular Variational Autoencoders), TabularARGN (Tabular Autoregressive Generative Networks), and GPT-based methods—that address these challenges in different ways:

GANs learn to “fool” a critic network to produce realistic samples, which helps match complex data patterns.

TVAEs focus on understanding each column’s data type (text, number, category) to recreate accurate row-level details.

TabularARGN builds records step-by-step, preserving sequential and hierarchical relationships in the data.

GPT-based methods leverage transformer models (like those behind large language models) to capture broad patterns and generate new rows based on learned “templates.”

Through a simple case study on a public credit-card transactions dataset, we’ll walk through:

Preparing data (filling in missing values, encoding categories, handling outliers)

Choosing and training a model (why you might pick a GAN versus a TabularARGN or a TVAE)

Evaluating results with easy-to-understand checks—how closely synthetic data matches real data distributions and how well a fraud-detection model trained on synthetic data performs.

We’ll also discuss balancing privacy (keeping customer details safe) with usefulness (keeping important patterns, like rare fraud events). Finally, we’ll point to simple next steps: using synthetic data in healthcare records or IoT sensor logs, monitoring data quality automatically, and ensuring any privacy concerns are met. By the end of this session, even attendees new to generative AI will understand how to pick a method, build a high-quality synthetic dataset, and trust that their AI models can learn and perform effectively—boosting innovation without risking real customer data.

What You’ll Learn:
Using advanced techniques Understanding Why Synthetic Transactional Data Matters
Real-World Trade-Offs: Utility vs. Privacy

Talk: Video Intelligence Is Going Agentic

Presenter:
James Le, Head of Developer Experience, TwelveLabs

About the Presenter:
James Le is currently leading Developer Experience at Twelve Labs – a startup building multimodal foundation models for video understanding. Previously, he has worked at the nexus of enterprise ML/AI and data infrastructure. He also hosted a podcast that features raw conversations with founders, investors, and operators in the space.

Talk Track: Multimodal Systems in Production

Technical Level: 4

Talk Abstract:
While 90% of the world’s data exists in video format, most AI systems treat video like static images or text—missing crucial temporal relationships and multimodal context. This talk explores the paradigm shift toward agentic video intelligence, where AI agents don’t just analyze video but actively reason about content, plan complex workflows, and execute sophisticated video operations.

Drawing from real-world implementations including MLSE’s 98% efficiency improvement in highlight creation (reducing 16-hour workflows to 9 minutes), this session demonstrates how video agents combine multimodal foundation models with agent architectures to solve previously intractable problems. We’ll explore the unique challenges of video agents—from handling high-dimensional temporal data to maintaining context across multi-step workflows—and showcase practical applications in media, entertainment, and enterprise video processing.

Attendees will learn how to architect video agent systems using planner-worker-reflector patterns, implement transparent agent reasoning, and design multimodal interfaces that bridge natural language interaction with visual media manipulation.”

What You’ll Learn:
1. Why traditional approaches fail: Understanding the fundamental limitations of applying text/image AI techniques to video, and why agentic approaches are necessary for complex video understanding.

2. Video agent architecture patterns: How to design and implement planner-worker-reflector architectures that can maintain context across complex multi-step video workflows.

3. Practical implementation strategies: Real-world approaches to building transparent agent reasoning, handling multimodal interfaces, and orchestrating video foundation models.

4. Business impact and ROI: Concrete examples of dramatic efficiency improvements and how to identify high-impact use cases in their own organizations

Talk: Humans in the Loop: Designing Trustworthy AI Through Embedded Research

Presenter:
David Baum, UX Researcher & Design Strategist, Amazon

About the Presenter:
David Baum is a design strategist and UX researcher with over a decade of experience shaping AI-powered products at the intersection of human behavior, ethical design, and emerging technology. Currently leading UX research for Amazon Ads’ Generative AI portfolio, David works across disciplines to translate ambiguity into actionable insight, ensuring that cutting-edge models serve real human needs.

His past work spans healthcare, behavioral science, and enterprise innovation guiding product teams at organizations like Johnson & Johnson, Memorial Sloan Kettering, Cigna, and the U.S. Department of Veterans Affairs. David is especially focused on how AI reshapes cognition, decision-making, and user trust, and frequently explores the implications of AI on systems-level design, human-AI collaboration, and collective wellbeing.

He’s a frequent panelist and contributor on topics ranging from ethical AI to strategic foresight, and is known for his ability to bridge deeply technical domains with accessible, human-centered narratives.

Talk Track: Scoping and Delivering Complex AI Projects

Technical Level: 2

Talk Abstract:
As generative AI rapidly moves from lab to product, many teams are rushing to ship capabilities without understanding the lived experiences, risks, and edge cases that define real-world usage. This talk explores how embedding user research earlier–and more meaningfully–into AI development pipelines can do more than just mitigate harm. It can enhance product adoption, build user trust, and surface invisible needs that AI alone won’t catch.

Drawing on experience leading UX research for Amazon Ads’ generative AI portfolio and past work in healthcare, behavioral science, and public systems, I’ll show how user insights can serve as functional guardrails – shaping model boundaries, UI design, and feedback loops. We’ll also interrogate the frictionless design ethos that dominates AI tooling today, and ask: what does it mean to design for thoughtfulness rather than speed?

Whether you’re building AI-native products or adapting legacy systems, this talk will offer frameworks and provocations for making AI more accountable, more human, and more useful.

What You’ll Learn:
UX research is not just a validation tool, it’s a critical input to AI product strategy and model governance.

Friction isn’t failure: thoughtful UX friction can support better outcomes, greater user agency, and higher trust in AI systems.

Embedding research into AI workflows helps detect misalignment early, before launch, reducing risk and surfacing ethical blind spots.

Cross-functional collaboration (PMs, designers, engineers, scientists) must center the human, not just the model.

Designing for trust means understanding how users think, not just how models predict.

Talk: The Rise of Self-Aware Data Lakehouses

Presenter:
Srishti Bhargava, Software Engineer, Amazon Web Services

About the Speaker:
I’m Srishti! I’m a software engineer at AWS where I work on data platforms, focusing on systems like Apache Iceberg and SageMaker Lakehouse. I help teams build analytics and machine learning solutions that actually work at scale – turning messy data into something useful.
I really care about making data engineering more approachable. A lot of modern data tools feel unnecessarily complex, so I write about the practical stuff, how to keep tables performing well, handle schema changes gracefully, and build systems that don’t break in production.
Outside of work, I love hiking and catching sunrises when I can. I also spend a lot of time cooking – it’s how I relax and unwind. There’s something satisfying about taking simple ingredients and making something good with them. Some of my best ideas actually come to me while I’m in the kitchen, just taking things slow and enjoying the process.

Talk Track: Data Engineering in an LLM era

Talk Technical Level: 2/7

Talk Abstract:
If you’re managing more than 50 tables and a handful of data models, you’ve probably felt the pain. Schema changes break production. Impact analysis takes hours. New engineers spend weeks figuring out what data exists and how it connects.
In this session, we’ll show you how to build an AI assistant that understands your data platform. Not just another chatbot, but a system that can analyze your schemas, parse dependencies, and predict exactly which models will break when you change a column.
We’ll demonstrate a working implementation that extracts metadata from Apache Iceberg tables, analyzes SQL dependencies, and creates an AI assistant that answers questions like – Which tables are burning through our storage budget?, What’s the blast radius if this critical system goes down?, Where is all our customer PII hiding across 500 tables? Which data pipelines haven’t been touched in months and might be zombie processes? Which tables in the data lakehouse can benefit from iceberg compaction? – analysis that would take days of detective work manually and complex queries. The result is a powerful, natural language interface for data discovery.
Attendees will see live examples of querying table schemas and identifying datasets using simple English prompts, leaving with a practical blueprint for leveraging LLMs to unlock the full potential of their data infrastructure in production settings.

What You’ll Learn:
1. Metadata problem is becoming worse not better, as organizations store large amounts of data across complex systems, it’s getting harder to derive insights from your data in a non-trivial manner.
2. LLMs can actually understand your data architecture.
3. Small and simple changes in how you structure your tables can be extremely beneficial for your organization.
4. This approach scales exponentially – manual approaches don’t. At 10 tables, spreadsheets or manual queries work fine, but when we’re dealing with the scale at organizations today, only an LLM powered approach can keep up with the complexity.
5. This approach can be integrated into existing systems today. We’ll show you how to extract metadata from real Apache Iceberg tables, analyse dependencies, create embeddings and build systems that work with your current data stack
6. Metadata contains way more business value than we realize. The schemas, dependencies and usage patterns tell stories about performance bottlenecks, governance gaps, and business impact that most of us are completely missing.

Talk: The Efficiency Equation: Leveraging AI Agents to Augment Human Labelers in Building Trust and Safety Systems at Scale

Presenter:
Madhu Ramanathan, Principal Group Engineering Manager, Trust, Safety and Intelligence, Microsoft

About the Presenter:
Madhu Ramanathan is a seasoned engineering and applied science leader with over 13 years of experience building AI-powered systems at Microsoft, Meta and Amazon. She has led globally distributed teams in trust, safety, content intelligence, and search, delivering responsible AI solutions that impact millions of users worldwide. Passionate about trust, safety, and ethical innovation, she brings a practitioner’s lens to productionizing cutting-edge, trustworthy AI solutions to solve real-world problems at scale.

Talk Track: Augmenting workforces with Agents

Technical Level: 2

Talk Abstract:
In today’s digital ecosystem, Trust & Safety systems face mounting challenges—from content proliferation, real-time enforcement demands and cost savings pressure —complicated further by evolving threats like deepfakes, AI generated hallucination, misinformation, and adversarial behavior. Given this a defensive space with ever-evolving threats, human labeling has been crucial in this domain for measurement, data collection to train models, real time enforcements, reactive takedowns and appeals – but it comes with costs in the millions for scaled applications. This keynote explores how LLMs and AI agents are reshaping this landscape, augmenting the human labelers, offering scalable, cost-efficient, and high-quality solutions that optimizes across defect rates, precision and operation cost at unprecedented speeds.

In particular, the talk will cover the following –
– A brief introduction to Trust and Safety systems, metrics and emerging threats such as deepfakes, hallucination, misinformation in the evolving GenAI landscape
– The role of human labelers in the traditional Trust and Safety lifecycle across measurement, data collection, proactive enforcements and reactive takedowns, the challenges in having large scale human labeler dependencies and the costs involved
– Case study of how LLMs/Agents are used in each stage such as measurement, enforcement and reactive takedowns with real world examples and the impact on Defect rate, Precision, Cost at each stage.
– Deep dive on continuous evaluation and calibration techniques of the LLM/Agentic judges used in the measurement flow and enforcement flow using humans-in-the-loop and Auto tuners for prompt tuning.
– Challenges faced and solutions such as a) Pitfalls from using same Agent for measurement and enforcement and solution by using Agentic + HI flows for measurement b) Handling constant model migrations in product c) Cost and GPU constraints in deploying LLMs at scale and evolution into distilled SLM models using LLM based teacher models.
– Finally, summarizing learnings on how the recent AI evolution in the last couple of years has brought in new challenges to this space but also provided ability to solve those problems by smartly combining HI and AI.

What You’ll Learn:
Trust & Safety is entering a new era – where the rapid AI evolution has brought in mounting challenges such as deepfakes, hallucination, misinformation along with budget cuts and hyper agility demands. Fortunately, the AI evolution has also enabled powerful solutions to those problems —one where human judgment and AI intelligence must co-evolve. This talk will give the attendees a deep dive on real world hybrid systems built at scale that are not only scalable and cost-effective but also resilient, ethical, and continuously improving to defend against the evolving challenges.

Talk: A Practical Field Guide to Optimizing the Cost, Speed, and Accuracy of LLMs for Domain-Specific Agents

Presenter:
Niels Bantilan, Chief ML Engineer, Union.ai

About the Presenter:
Niels is the Chief Machine Learning Engineer at Union, a core maintainer of Flyte, an open source workflow orchestration tool, and creator of Pandera, a data validation and testing tool for dataframes. His mission is to help data science and machine learning practitioners be more productive. He has a Masters in Public Health Informatics, and prior to that a background in developmental biology and immunology. His research interests include reinforcement learning, NLP, ML in creative applications, and fairness, accountability, and transparency in automated systems.

Talk Track: Agents in Production

Technical Level: 3

Talk Abstract:
As the dust settles from the initial boom of applications using hosted large language model (LLM) APIs, engineering teams are discovering that while LLMs get you to a working demo quickly, they often struggle in production with latency spikes, context limitations, and explosive compute costs. This session provides a practical roadmap for navigating not only the experiment-to-production gap using small language models (SLMs), but also the AI-native orchestration strategies that will get you the most bang for your buck.
We’ll explore how SLMs (models that range from hundreds of millions to a few billion parameters) offer a compelling alternative for domain-specific applications by trading off the generalization power of LLMs for significant gains in speed, cost-efficiency, and task-specific accuracy. Using the example of an agent that translates natural language into SQL database queries, this session will demonstrate when and how to deploy SLMs in production systems, how to progressively swap out LLMs for SLMs while maintaining quality, and which orchestration strategies help you customize and maintain SLMs in a cost-effective way.

Key topics include:
– Identifying key leverage points: Which LLM calls should you swap out for SLMs first? We’ll cover how to identify speed, cost, and accuracy leverage points in your AI system so that you can speed up inference, reduce cost, and maintain accuracy.
– Speed Optimization: It’s not just about the speed of inference, which SLMs already excel at, it’s also about accelerating experimentation when you fine-tune and retrain SLMs on a specific domain/task. We’ll cover parallelized optimization runs, intelligent caching strategies, and task fanout techniques for both prompt and hyperparameter optimization.
– Cost Management: Avoiding common pitfalls that negate SLMs’ cost advantages, including resource mismatching (GPU vs CPU workloads), infrastructure provisioning inefficiencies, and idle compute waste. Attendees will learn resource-aware orchestration patterns that scale to zero and recover gracefully from failures.
– Accuracy Enhancement: Maximizing domain-specific performance by implementing the equivalent of “AI unit tests” and incorporating it into your experimentation and deployment pipelines. We’ll cover how this can be done with synthetic datasets, LLM judges, and deterministic evaluation functions that help you catch regressions early and often.

What You’ll Learn:
Attendees will leave with actionable strategies for cost-effective AI deployment, a decision framework for SLM adoption, and orchestration patterns that compound the value of smaller models in domain-specific applications.

Talk: Your Infrastructure Just Got Smarter: AI Agents in the DevOps Loop

Presenter:
Kishan Rao, Engineering Manager, Delivery and Automation Platform, Okta

About the Speaker:
I’m an Engineering Manager with a background in backend systems, platform engineering, and infrastructure automation, currently focused on how AI agents can reshape developer workflows. With over 8 years of experience building CI/CD pipelines, internal platforms, and scalable infrastructure at cloud-first companies, I’ve seen firsthand how operational complexity can slow down engineering teams.

My recent work explores the intersection of DevOps and AI agents—designing tools that intelligently interpret infrastructure-as-code, reduce toil, and guide developers through their environments with contextual awareness. I’m passionate about building agentic systems that augment developer cognition, shorten feedback loops, and turn codebases into living documentation.

I care deeply about developer velocity, system reliability, and creating engineering environments where teams can move quickly without sacrificing quality. Based in San Francisco, I’m excited to contribute to the conversation on how autonomous AI tooling is changing the way we build, ship, and maintain software

Talk Track: AI Agents for Developer Productivity

Talk Technical Level: 2/7

Talk Abstract:
Modern infrastructure is rich, dynamic, and deeply complex. Yet most engineering teams still rely on manual processes and tribal knowledge to navigate it. In this talk, I explore how AI agents are transforming DevOps by becoming part of the loop. They’re not just automating tasks but interpreting infrastructure-as-code, understanding system context, and guiding developers through their environments.

We’ll examine how AI-native workflows are emerging across the DevOps lifecycle, from documentation generation and config reasoning to incident triage and deployment planning. I’ll share implementation patterns from my experience in platform engineering and backend systems, including how to design agents that interact with code, tools, and people with minimal friction.

You’ll leave with a practical understanding of how to embed AI agents into your stack, the trade-offs of using local versus cloud LLMs, and how this shift can change the speed, clarity, and confidence with which your teams ship code.

What You’ll Learn:
AI at scale in production does not need to be hard. But you do need to spend time deeply thinking about the outcome you are trying to achieve with AI in the loop

Talk: I Tried Everything: A Pragmatist's Guide to Building Knowledge Graphs from Unstructured Data

Presenter:
Alessandro Pireno, Founder, Stealth Company

About the Speaker:
Alessandro Pireno is an AI and Data Product leader with a 15-year track record of scaling innovative data infrastructure companies. His career is distinguished by a unique 360-degree perspective gained from leading Engineering, Product, and Sales Engineering teams at hyper-growth startups like Snowflake and SurrealDB. He played a pivotal role in building the technical GTM engine that established Snowflake’s early enterprise dominance and more recently architected the product and GTM strategy for SurrealDB’s AI and vector capabilities. His open-source work includes proofs-of-concept for Retrieval-Augmented Generation with Knowledge Graphs (surrealdb-rag) and techniques for graph extraction (graph-examples). Currently, he is building a new stealth project to automate knowledge graph generation using an agentic framework that leverages diverse techniques from NLP to in-database search.

Talk Track: Data Engineering in an LLM era

Talk Technical Level: 3/7

Talk Abstract:
Traditional ETL pipelines are breaking under the demands of LLMs. They excel at structured data, but fail when confronted with the unstructured documents and implicit relationships that give AI its context. To solve this, we must evolve from ETL to “KG-ETL”—pipelines that build knowledge graphs as a first-class output. This session is a pragmatic guide to three competing pipeline architectures for building KGs from raw data. We’ll explore using LLM prompts as a new ‘T’ in your pipeline, contrast it with traditional NLP pipelines, and deep-dive into a novel hybrid retrieval workflow that uses vector stores for something beyond semantic search: high-precision entity resolution. You’ll leave with a framework for choosing the right pipeline for your data, moving beyond simple RAG to build truly context-rich AI systems.

What You’ll Learn:
Design and contrast three distinct data pipeline architectures for knowledge graph construction: LLM-prompt-based, traditional NLP-based, and a hybrid vector search-based model.

Evaluate the cost, latency, scalability, and observability trade-offs of each pipeline pattern, helping you select the right approach for your MLOps environment.

Learn a novel, operational technique for using vector stores beyond semantic search—by training a custom fasttext model on cleansed names to create embeddings for high-precision, scalable entity resolution.

Receive a decision framework for selecting the right KG-ETL pipeline based on your source data’s structure (unstructured, semi-structured, or structured) and your project’s specific requirements.

Talk: Unified Control Plane for Enterprise GenAI: Powered by Agentic Deployment Platform with Central AI Gateway & MCP Integration

Presenter:
Nikunj Bajaj, CEO, TrueFoundry

About the Speaker:
Nikunj is the co-founder and CEO of TrueFoundry, a platform helping enterprises build, deploy and ship LLM applications in a fast, scalable, cost efficient way with right governance controls within their own cloud. Prior to this role, he served as a Tech Lead for Conversational AI at Meta, where he spearheaded the development of proactive virtual assistants. His team also put Meta’s first deep learning model on-device. Nikunj also led the Machine Learning team at Reflektion, where he built an AI platform to enhance search and recommendations for over 600 million users across numerous eCommerce websites. He has done his bachelors in Electrical Engineering from IIT Kharagpur and masters in Computer Science from UC Berkeley.

As a visionary leader in the enterprise AI space, Nikunj is a sought-after speaker at premier technology conferences and summits, sharing his expertise on production AI deployment and enterprise ML strategies. His speaking portfolio includes keynotes and expert panels at MLOps Community events hosted with 50 speakers discussing LLMs in production alongside industry leaders from Stripe, Meta, Canva, Databricks, Anthropic, and Cohere, GenAI Summit San Francisco 2024 which attracted over 30,000 attendees and 200+ industry leaders at the historic Palace of Fine Arts, LLM Avalanche (part of Data+AI Summit by Databricks) technical meetups featuring 20 world experts and attracting 1,000 attendees in San Francisco, Global Big Data Conference where he was featured as a speaker at the Global Artificial Intelligence Conference, and MLOps World connecting over 15,000 members exploring best practices for ML/AI in production environments.

Talk Abstract:
As generative AI evolves from experimental tools to mission-critical enterprise applications, organizations face unprecedented operational complexity. Modern AI systems now orchestrate multiple models, invoke diverse tools, and span hybrid infrastructures, creating challenges around inconsistent APIs, model outages, unpredictable latency, complex rate limiting, and mounting governance requirements. Without centralized control, enterprises struggle with vendor lock-in, compliance gaps, runaway costs, and fragmented observability across their distributed AI ecosystems.

This session introduces the AI Gateway pattern—a critical architectural component that serves as the central control plane for enterprise AI systems. We’ll explore practical solutions including unified API abstraction, intelligent failover mechanisms, semantic caching, centralized guardrails, and granular cost controls. You’ll learn technical architecture patterns for building high-availability gateways that handle thousands of concurrent requests with sub-millisecond decision-making, plus emerging integration patterns like Model Context Protocol (MCP) for managing entire tool ecosystems.

Whether you’re an architect, platform engineer, or technical leader, you’ll gain actionable insights, architectural blueprints, and a practical framework for implementing scalable AI infrastructure that grows with your organization’s AI maturity.

All sessions and workshops curated by leading AI/ML practitioners

Agents in Production

Augmenting Workforces with Agents

Evolution of Agents

ML Collaboration in Large Organizations

AI Agents for Developer Productivity

AI Agents for Model Validation and Deployments

Data Engineering in an LLM era

ML Training Lifecycle

Latest MLOps Trends

LLMs on Kubernetes

Multimodal Systems in Production

Scoping and Delivering Complex AI Projects

Virtual Day

Lightning Talks

Speakers Corner

The Next Wave of AI

more coming soon

Agenda

Talk: Metaflow: The Baseplate for Agentic Systems

Talk: Doxing Dark Money: Entity Resolution to Empower Downstream Ai Applications in Anti-Fraud

Talk: How to Train Your Agent: Building Reliable Agents with RL

Talk: Why CI/CD Fails for AI, and How CC/CD Fixes I

Talk: From Static IVRs to Agentic Voice AI: Building Real-Time Intelligent Conversations

Talk: The Hard Truth About AI Agents: Lessons Learned from Running Agents in Production

Talk: Agents as Ordinary Software: Principled Engineering for Scale

Talk: Building Conversational AI Agents with Thread-Level Eval Metrics

Workshop: How to Build and Evaluate Agentic AI Workflows with FloTorch

Talk: Hope is Not a Strategy: Retrieval Patterns for MCP

Talk: From Vectors to Agents: Managing RAG in an Agentic World

Talk: Agent Name Service (ANS) in Action – A DNS-like Trust Layer for Secure, Scalable AI-Agent Deployments on Kubernetes

Talk: Building and Evaluating Agents

Talk: Testing AI Agents: A Practical Framework for Reliability and Performance

Talk: Agent Drift: Understanding and Managing AI Agent Performance Degradation in Production

Talk: Context is King: Scaling Beyond Prompt Engineering at BlackRock

Talk: Where Experts Can't Scale: Orchestrating AI Agents to Structure the World's Product Knowledge

Talk: From Zero to One: Building AI Agents From The Ground Up

Talk: How Math-Driven Thinking Builds Smarter Agentic Systems

Talk: Insights and Epic Fails from 5 Years of Building ML Platforms

Talk: From Schema Discovery to Kubernetes: Building an Autonomous Agent for Real-Time Apache Flink Apps with LangGraph

Talk: Impact of AI on Developer Productivity

Talk: Code-Guided Agents for Legacy System Modernization

Talk: Don't Page the Planet: Trust-Weighted Ops Decisions

Talk: Five Hard-Earned Lessons About Evals

Talk: Fake Data, Real Power: Crafting Synthetic Transactions for Bulletproof AI

Talk: Smart Fine-Tuning of Video Foundation Models for Fast Deployments

Talk: Why is ML on Kubernetes Hard? Defining How ML and Software Diverge

Talk: Securing Models

Talk: Building Multi-Cloud GenAI Platforms without The Pains

Talk: Opening Pandora’s Box: Building Effective Multimodal Feedback Loops

Talk: Video Intelligence Is Going Agentic

Talk: Future of AI in Healthcare

Talk: Humans in the Loop: Designing Trustworthy AI Through Embedded Research

Talk: LLM Inference: A Comparative Guide to Modern Open-Source Runtimes

Talk: Architecting and Orchestrating AI Agents

Talk: Architecting a Deep Research System

Talk: Gradio: The Web Framework for Humans and Machines

Talk: The Rise of Self-Aware Data Lakehouses

Talk: What’s Next in the Agent Stack

Talk: Building Effective Agents

Talk: From Hello to Repayment: Voice AI in African Finance

Adversarial Threats Across the ML Lifecycle: A Red Team Perspective

Talk: Story is All You Need

Talk: The Efficiency Equation: Leveraging AI Agents to Augment Human Labelers in Building Trust and Safety Systems at Scale

Talk: A Practical Field Guide to Optimizing the Cost, Speed, and Accuracy of LLMs for Domain-Specific Agents

Talk: Your Infrastructure Just Got Smarter: AI Agents in the DevOps Loop

Talk: I Tried Everything: A Pragmatist's Guide to Building Knowledge Graphs from Unstructured Data

Talk: Productizing Generative AI at Google Scale: Lessons on Scoping and Delivering Ai Powered Editors

Talk: Shipping AI That Works

Talk: Beyond the Vibe: Eval Driven Development

Title: SLMs + Fine-Tuning: Building the Infrastructure for Multi-Agent Systems

Talk: The Real Problem building Agentic applications (And How MLOps Solves It)

Talk: Agentic Metaflow in Action

Talk: A Simple Recipe for LLM Observability

Talk: What gets AI Agents to Production

Talk: Techniques to build high quality agents faster with MLflow

Talk: AI Catalog by JFrog - Control access to Open Source LLM's

Talk: Building Feedback-Driven Agentic Workflows

Talk: Unified Control Plane for Enterprise GenAI: Powered by Agentic Deployment Platform with Central AI Gateway & MCP Integration

Talk: MLOps for Agents: Bringing the Outer Loop to Autonomous AI