Session
Evals and Benchmarks
AI-Assisted MLOps & Evaluation Automation

AI-Assisted, Audit-Ready: Scaling ML Platform and Developer Productivity at A Regulated Fintech

Speaker

Ravika Nagpal

Staff Developer, KOHO Financial

Abstract

Building ML models is not the hard part for most teams anymore. Getting them from a data scientist’s notebook to a governed, monitored, production system and keeping them there without a platform team standing between every developer and every deploy is. It gets harder inside a regulated fintech, where every model decision needs an audit trail, every alert needs a documented escalation path, and every “quick fix” has to survive a compliance review.

This talk walks through how our ML platform team at KOHO, a Canadian fintech, built a developer-first MLOps stack on AWS that treats governance as a byproduct of good engineering rather than a tax on top of it and how we’re now layering AI-assisted workflows (Claude Code skills, agentic guardrails) on top to remove the remaining manual toil from model onboarding, monitoring triage, and incident response.

We’ll cover the architecture, the AI-assisted developer tooling built on top of it, and what changed operationally as the company moved toward a full banking license, where “move fast” and “pass the audit” had to become the same sentence, not a trade-off.

Audience takeaway: a concrete pattern for developer productivity that survives regulatory scrutiny, plus where AI agents genuinely help.

From the same track

Wednesday, November 18th | 10:55 AM – 11:25 AM

Performance is the Product: Our Journey to SoTA for Nemotron Retriever

Kalpesh Sutaria

Director, NVIDIA

Wednesday, November 18th | 11:30 AM – 12:00 PM

Maximizing GPU Utilization in LLM Post-Training with Co-Operative Time-Slicing in LLM-D

Poonam Lamba

Senior Product Lead, Google

Wednesday, November 18th | 12:05 AM – 12:35 PM

Training Generative Recommenders in Production

Fuzail Khan

Senior Machine Learning Engineer, Meta

Wednesday, November 18th | 01:35 AM – 02:05 PM

Little's Law Meets the Roofline Model: A Decision Framework for Sizing Hosted LLM Inference

Balaji Varadarajan

Staff Engineer, LLM Inference, DigitalOcean

Summit (2 days).

MLOps World | GenAI Summit 2026 is a two days of case studies, workshops, and expo on taking AI/ML and agentic systems into production – at the Etter-Harbin Alumni photo – full-bleed hero or browse files.

Share