The opportunity
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
What you'll do
Evaluate the model's ability to respond to coding requests, workflows, and: code base-related questions using available tools.
Assess agent trajectories and model capabilities for code generation and debugging requests.
Prompt models to complete complex coding tasks and review the accuracy of generated responses.
Label, proofread, and improve machine-written and human-written software engineering-related outputs.
Report quality and performance trends related to model/agent behaviour and project assignments.
Subject matter expertise in software engineering: you have both studied in this field and have 3-5 years of relevant industry experience.
What they're looking for
- Proficient knowledge and understanding of Python and the following: programming languages: Java, JavaScript, Go, and SQL (any dialect).
- Prior experience designing, building, and deploying APIs
- Prior experience working with code agents (OpenCode, Claude Code, Codex,: Cursor) or evaluating agent trajectories is a big plus.
