MTS, Research EngineerActive$250K–$400K
The opportunity
Fireworks is the platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and products. Founded by the team behind PyTorch and backed by AMD, Atreides, Benchmark Capital, Index Ventures, Lightspeed,…
What you'll do
Conduct Open-Ended Research: Explore new model architectures, training objectives, and optimization techniques. Formulate hypotheses, design experiments, and iterate quickly based on empirical results.
Reproduce and Extend State-of-the-Art: Implement and reproduce results from recent machine learning papers. Identify bottlenecks, propose improvements, and scale these methods to larger datasets and models.
Build and Scale Training Infrastructure: Design, implement, and maintain high-performance, distributed machine learning systems. Optimize training loops, data loaders, and communication overhead across large GPU clusters.
Bridge Science and Engineering: Translate abstract mathematical concepts and research ideas into robust, bug-free, and efficient code.
Collaborate Cross-Functionally: Work closely with Research Scientists to unblock their experiments by providing tooling, optimizing code, and co-designing experiments that are hardware-aware.
Strong programming skills (Python, C++, or Rust) and a commitment to writing clean, maintainable code.
What they're looking for
- Deep practical knowledge of machine learning frameworks (PyTorch, JAX, or TensorFlow).
- Experience working with large distributed systems and parallel computing (e.g., CUDA, NCCL, MPI).
- A strong foundation in linear algebra, calculus, probability, and statistics.
- A proven track record of implementing complex deep learning algorithms from scratch.
