Senior Software Engineer (MLOps) – Annotation & Evaluation

About this role

At Datadog, we are building an internal AI platform that empowers our teams to train, evaluate, and deploy models at scale. The Annotation & Evaluation team plays a foundational role in ensuring our models are reliable, safe, and production-ready. We design the infrastructure and tooling for dataset labeling, model benchmarking, trust & safety evaluation, and performance diagnostics across a range of ML and LLM applications.