Member of Technical Staff, Data Analysis and EvaluationActive

The opportunity

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

What you'll do

  • Design and oversee data collection tasks, including supporting human annotators and ensuring data quality.

  • Develop and apply statistical methods to evaluate the quality and reliability of datasets.

  • Analyse and assess the generalisability and robustness of ML systems across diverse use cases.

  • Collaborate with teams to improve dataset quality and model performance.

  • Train and fine-tune large language models (LLMs) on distributed training infrastructures.

  • Conduct experiments to evaluate model performance and identify areas for improvement.

What they're looking for

  • Extremely strong software engineering skills.
  • Strong expertise in designing and conducting data collection tasks, including working with human annotators.
  • Strong statistical skills and experience evaluating scientific experiments: related to data collection and model performance.
  • Experience analysing datasets with respect to their quality, biases, and suitability for training ML models.