Session
Agent Harness Engineering
Evaluation & Testing of Non-Deterministic Systems

Building Reliable Browser Agents in Healthcare

Speaker

Jake Kang

Co-Founder, Whitney AI

Abstract

This talk shares lessons from building a self-recovering browser agent for regulated healthcare workflows, where we moved from a single-agent prototype to a multi-step system with optimized inputs, memory, evals, sandboxes, and deterministic code where possible. I’ll walk through how we used production failures to build a faster evaluation and prompt optimization loop, and when to move beyond harness engineering to increasing model capability via post-training.

From the same track

Wednesday, November 18th | 10:55 AM – 11:25 AM

Performance is the Product: Our Journey to SoTA for Nemotron Retriever

Kalpesh Sutaria

Director, NVIDIA

Wednesday, November 18th | 11:30 AM – 12:00 PM

Maximizing GPU Utilization in LLM Post-Training with Co-Operative Time-Slicing in LLM-D

Poonam Lamba

Senior Product Lead, Google

Wednesday, November 18th | 12:05 AM – 12:35 PM

Training Generative Recommenders in Production

Fuzail Khan

Senior Machine Learning Engineer, Meta

Wednesday, November 18th | 01:35 AM – 02:05 PM

Little's Law Meets the Roofline Model: A Decision Framework for Sizing Hosted LLM Inference

Balaji Varadarajan

Staff Engineer, LLM Inference, DigitalOcean

Summit (2 days).

MLOps World | GenAI Summit 2026 is a two days of case studies, workshops, and expo on taking AI/ML and agentic systems into production – at the Etter-Harbin Alumni photo – full-bleed hero or browse files.

Share