The opportunity
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
What you'll do
Evaluate the model's ability to respond to coding requests, workflows, and: code base-related questions using available tools.
Assess agent trajectories and model capabilities for code generation, tabular: and graphic manipulation, and debugging requests.
Prompt models to complete complex data science tasks and review the accuracy of generated responses.
Label, proofread, and improve machine-written and human-written software engineering-related outputs.
Report quality and performance trends related to model/agent behaviour and project assignments.
Exceptional data analysis and visualization skills.
What they're looking for
- + years of relevant industry experience working on real-world data science problems and pipelines.
- Proficient knowledge and understanding of Python and industry-standard data: science packages (numpy, pandas, matplotlib, sqlite, or others).
- Strong understanding of SQL syntax writing and workflows; and a deep: familiarity with file/data formats, such as markdown, JSON, XML, YAML, and HTML.
- Prior experience re-writing, proofreading, and delivering feedback on code.
