The opportunity
Coursera and Udemy are now one company, bringing together two mission-driven brands to create the world’s most powerful platform for turning learning into progress. Together, we help more than 300 million learners and 12,000+ enterprise customers build the skills they need for a world being reshaped by AI.
What you'll do
Build and maintain the operational tooling for our LLM-powered systems,: including prompt/pipeline versioning, evaluation harnesses, and CI/CD workflows tailored to non-deterministic AI outputs
Implement monitoring and observability for production LLM systems: tracking latency, token usage, cost per request, output quality, and drift over time
Design and run automated evaluation suites to catch regressions,: hallucinations, and quality degradation before they reach customers
Manage RAG pipelines and vector store infrastructure, keeping retrieval: sources fresh, accurate, and performant
Implement safety and compliance guardrails: content filtering, PII redaction, and access controls — in line with enterprise data privacy and residency requirements
Own cost governance for LLM usage: caching strategies, model routing, and usage reporting to keep spend predictable as adoption scales
What they're looking for
- Collaborate closely with Product Managers and Senior Engineers to scope: operational requirements and translate them into reliable systems
- Participate in sprint planning, technical grooming, and retrospective discussions
- Bachelor’s or Master’s degree in Computer Science, Computer Engineering or a related field
- + years of experience in a software engineering role, with a solid background: in Backend Engineering and DevOps fundamentals
