The opportunity
The Behavior AI team builds the AI-based anomaly detection behind Datadog's security products. Our models learn what normal looks like across the billions of logs, events, and telemetry records flowing through the platform every second, and they flag the behavior that does not…
What you'll do
Design and build custom mid-size models for high-throughput stream processing, and train them at scale.
Optimize these models from start to finish, working across both the: mathematics and the systems, often by finding mathematical reformulations that fit the hardware and software constraints better.
Build the training data pipelines the work depends on when they do not: already exist, from the raw stream to a training-ready dataset.
Work with engineering to integrate models into production, with a clear focus: on GPU utilization, latency, and cost per record on live traffic.
Plan the roadmap of model and system improvements, based on a solid: understanding of the product and of what matters most to users.
Build an agentic layer on top of the models to analyze, validate, and act on their outputs.
What they're looking for
- Build lightweight interpretability tools that make model behavior easier to: explain to the people who rely on it.
- Maintain and monitor the models, services, and infrastructure your team owns,: and take part in your team's on-call rotation.
- You have a BS/MS/PhD in Computer Science, Engineering, Machine Learning,: Applied Mathematics, or a related scientific field, or equivalent experience.
- You have hands-on experience training and fine-tuning models at scale, and: deploying them into production systems with real throughput and cost constraints.