The opportunity
MongoDB is building a world-class team in India to create tooling that helps customers verify their application and data modernizations. As companies modernize their application and data ecosystems, ensuring functional equivalence and performance is paramount.
What you'll do
+ years of commercial software development experience with at least one JVM: language such as Java, preferably using the Spring ecosystem
Proven experience evaluating Large Language Models (OpenAI, Anthropic, open-weights, etc.)
Familiarity with evaluation frameworks (DeepEval, Ragas, Promptfoo) and LLM-as-a-judge concepts
Experience integrating Large Language Models (LLMs) into the developer: workflow to automate unit test generation and edge-case discovery
Experience curating "golden datasets," adversarial test sets, and: establishing scoring rubrics to test LLM accuracy, safety, and relevance
Experience building developer tools, infrastructure, or complex testing frameworks
What they're looking for
- Solid experience in software architecture and development
- Experience in application/database modernization with proven ability to: design and implement frameworks that ensure database state equivalence across different implementations. Must understand change data capture, event-driven database interception (MongoDB listeners, RDBMS triggers), and state comparison algorithms with pattern-based exclusions
- Experience with relational and document data modeling and hands-on experience: with at least one SQL database (Postgres, MySQL, etc) and at least one document database (e.g. MongoDB)
- Good understanding of algorithms, data structures and their time and space complexity
