Senior Software Engineer, Inference CloudActive

The opportunity

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

What you'll do

  • Kubernetes Infrastructure. Build and improve production Kubernetes: environments on Amazon EKS. Own improvements to workload scheduling, autoscaling, cluster upgrades, resource utilization, network policies, and failure recovery.

  • Service Networking & Traffic Control. Develop and operate traffic management: infrastructure using Envoy and Istio. Improve routing, rate limiting, connection management, timeouts, retries, and failover to keep services responsive under changing demand.

  • Databases. Build database-backed services and improve the reliability and: performance of their data stores. Troubleshoot query performance, connection pooling, and availability issues, and strengthen backup and recovery practices.

  • Reliability & Performance. Identify bottlenecks across applications,: Kubernetes, networking, and databases. Improve latency, throughput, and capacity efficiency in high-QPS systems, including during traffic spikes and partial failures.

  • Infrastructure & Deployment Automation. Use Terraform, Argo CD, and Kustomize: to automate infrastructure provisioning and application delivery. Improve deployment validation, rollback, and operational tooling.

  • Production Operations & Collaboration. Build actionable metrics, logs,: traces, dashboards, and alerts. Investigate incidents, deliver lasting fixes, and contribute to design reviews, code reviews, and shared engineering practices.

What they're looking for

  • + years of software engineering experience, including building and operating: production services or cloud infrastructure.
  • Strong Kubernetes expertise, including workload lifecycle, networking,: service discovery, storage, autoscaling, and troubleshooting cluster and application failures.
  • Hands-on experience with Amazon EKS or a comparable managed Kubernetes service.
  • Experience configuring and troubleshooting Envoy and Istio, or comparable: proxy and service mesh technologies. Solid understanding of HTTP, gRPC, DNS, TLS, and mTLS.
Senior Software Engineer, Inference Cloud at Cerebras | Role Match