The opportunity
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
What you'll do
Design and write high-performant and scalable software for training.
Improve our training setup from an infrastructure and codebase performance standpoint.
Craft and implement tools to speed up our training cycles and improve the: overall efficacy of our training infrastructure
Research, implement, and experiment with ideas on our supercompute and data infrastructure.
Learn from and work with the best researchers in the field.
Extremely strong software engineering skills.
What they're looking for
- Proficiency in Python and related ML frameworks such as JAX, Pytorch and XLA/MLIR.
- Experience with distributed training infrastructures (Kubernetes, Slurm) and associated frameworks (Ray)
- Experience using large-scale distributed training strategies.
- Hands on experience on training large model at scale and having contributed: to the tooling and/or setup of the training infrastructure
