
Senior Staff Software Engineer, LinkedIn
About the Speaker:
Jaideep Ray is a Senior Staff Engineer at LinkedIn and tech lead for its AI training stack. His focus areas are large-scale model training for generative recommenders and small language models, incremental training for ranking systems, and agent loops that generate, migrate and optimize production ML models. Previously, he led ML training at Coupang and worked on search ranking, AutoML and post-training at Meta.
To support complex autonomous tasks like model optimization and software engineering, we redesigned our AI infrastructure by shifting from stateless, request-response paradigms toward a model of managed, long-running execution. Structurally, this involved moving away from ad-hoc scripts toward a unified agentic harness where every session is treated as a durable, managed workflow. We implemented a decoupled sidecar architecture that effectively insulates core infrastructure from the unpredictable execution paths of autonomous agents, ensuring that identity, security, and network egress are managed through a hardened proxy rather than the agent itself
Attendees will walk away knowing how to architect a secure execution harness for autonomous agents, implement asynchronous human intervention models, and manage the lifecycle of persistent agentic sessions in high-scale production environments.
MLOps World | GenAI Summit 2026 is a two days of case studies, workshops, and expo on taking AI/ML and agentic systems into production – at the Etter-Harbin Alumni photo – full-bleed hero or browse files.