The opportunity
The Agent Research and Tooling team, part of MongoDB's AI Builder Experience organization, owns the platform layer around agents: how teams author, distribute, evaluate, monitor, and improve agent skills and agent behavior. We are hiring a software engineer to build and maintain…
What you'll do
Build and maintain agent skills and the infrastructure to validate, evaluate, publish, and maintain them
Design evaluation datasets and workflows that compare agent behavior against: a baseline and produce actionable quality signals
Build agent metrics and observability: skill selection and routing, success and failure outcomes, tool calls, latency, and token usage
Design safety and quality gates for agent-authored content: rule packs, static analysis, confidence thresholds, structured verdicts, and bounded suppression
Create CLIs, libraries, and MCP integrations that other repositories adopt: and that run in local development and CI
Integrate tooling into GitHub Actions and other CI workflows, including: secrets, annotations, exit codes, and artifacts
What they're looking for
- + years of experience building production software, developer tools, internal platforms, or automation systems
- Software engineering fundamentals in API design, testing, error handling, and maintainability
- Experience building CLIs, libraries, test infrastructure, static analysis, or CI/CD workflows
- Ability to design systems that are usable by developers and reliable in automation
- Experience reasoning about correctness and safety with ambiguous input,: nondeterministic output, false positives, or untrusted content
- Comfort in an evolving R&D environment where the right abstraction emerges through prototypes and feedback
- Written and verbal communication, including explaining technical trade-offs: and aligning stakeholders across teams
