The opportunity
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
What you'll do
Design and write high-performant and scalable software for training.
Understand architectural modifications and design choices and their effects: on training throughput and quality.
Write low-level CUDA, triton kernels to squeeze every last bit of performance from our accelerators.
Research, implement, and experiment with ideas on our supercompute and data infrastructure.
Learn from and work with the best researchers in the field.
Extremely strong software engineering skills.
What they're looking for
- Proficiency in Python and related ML frameworks such as JAX, Pytorch and XLA/MLIR.
- Experience writing kernels for GPUs using CUDA, triton, etc
- Experience using large-scale distributed training strategies.
- Familiarity with autoregressive sequence models, such as Transformers.
