The opportunity
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
What you'll do
Conduct data ablations to assess data quality and experiment with data mixtures to enhance model performance.
Develop robust data modeling techniques to ensure datasets are structured and: formatted for optimal training efficiency.
Research and implement innovative data curation methods, leveraging Cohere’s: infrastructure to drive advancements in natural language processing.
Collaborate with cross-functional teams, including researchers and engineers,: to ensure data pipelines meet the demands of cutting-edge language models.
Strong software engineering skills, with proficiency in Python and experience building data pipelines.
Familiarity with curriculum learning, data mixing and data attribution.
What they're looking for
- Familiarity with data processing frameworks such as Apache Spark, Apache Beam, Pandas, or similar tools.
- Experience working with large-scale datasets, including web data, code data, and multilingual corpora.
- Knowledge of data quality assessment techniques and experimentation with data mixtures.
- A passion for bridging research and engineering to solve complex data-related challenges in AI model training.
