Member of Technical Staff, InfrastructureActive$200K–$275K

LlamaIndex
Apply now

The opportunity

The Infra team at LlamaIndex owns the foundations that our product is built upon as well as many of the tools that enable engineers to develop, ship, and observe their code. We are responsible for designing, building, and scaling core infrastructure that powers a high-volume data platform for AI applications.

What you'll do

  • Collaborate with other engineering teams to build and maintain foundational: systems that empower developers and support the company's rapid growth.

  • Design and implement scalable infrastructure solutions for various deployment: models, including SaaS, single-tenant, and private deployments.

  • Manage and optimize cloud resources and Kubernetes clusters for cost-effectiveness and performance.

  • Enable external customer deployment success through maintaining clear: infrastructure boundaries and principles.

  • Optimize and improve the release and deployment processes to enhance efficiency and reliability.

  • Ensure compliance with relevant regulations and implement robust security: measures across different deployment environments.

What they're looking for

  • + years of engineering experience.
  • Worked on Platform or Infrastructure teams on significant projects involving: infrastructure components (Terraform/CDKTF, Kubernetes, Helm, test infrastructure, release management, observability, etc.)
  • Experience in optimizing cloud resource utilization.
  • Proficient in tuning Kubernetes clusters and cloud resources for cost and performance efficiency.
  • Willing to build LlamaIndex’s engineering culture as we grow.
  • You can balance speed and pragmatism and build the appropriate solutions for: each stage of the company’s growth.
  • Hands-on proficiency with modern LLM tooling and production AI systems,: including experience with model APIs, agent or RAG frameworks, evaluation and tracing tools, and the operational characteristics of LLM workloads.
  • Experience building out infrastructure from the ground up at a fast-growing startup.