The opportunity
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
What you'll do
Design and write high-performing and scalable software for training models.
Develop new tools to support and accelerate research and LLM training.
Coordinate with other engineering teams (Infrastructure, Efficiency, Serving): and the scientific teams (Agent, Multimodal, Multilingual, etc.).
Research, implement, and experiment with ideas on our cluster and data infrastructure.
Collaborate, Collaborate, and Collaborate with other scientists, engineers, and teams!
Extremely strong software engineering skills.
What they're looking for
- Value test-driven development methods, clean code, and strive to reduce technical debts at all levels.
- Proficiency in Python and related ML frameworks such as JAX, Pytorch and/or XLA/MLIR.
- Experience using and debugging large-scale distributed training strategies (memory/speed profiling).
- Experience with distributed training infrastructures (Kubernetes) and associated frameworks (Ray).
