The opportunity
Overview: The Data Acquisition team within the Foundations organization at OpenAI is responsible for all aspects of data collection to support our model training operations. Our team manages web crawling and GPTBot services and works closely with Data Processing, Architecture, and Scaling teams.
What you'll do
Develop and maintain full-stack applications that support data acquisition,: including internal tools and dashboards.
Collaborate closely with cross-functional teams, including Data Processing,: Architecture, and Scaling, to ensure seamless data ingestion and workflow management.
Design and implement APIs to facilitate data interactions between internal services and external data sources.
Enhance user experience by developing intuitive web-based interfaces for: managing and monitoring data pipelines.
Optimize backend services for performance, scalability, and security in a distributed computing environment.
Work with legal and compliance teams to ensure our data acquisition processes: adhere to privacy regulations and best practices.
What they're looking for
- Deploy and maintain infrastructure using Kubernetes and Infrastructure-as-Code (IaC) methodologies.
- Analyze system performance, conduct experiments, and improve data workflows to maximize efficiency.
- BS/MS/PhD in Computer Science or a related field.
- + years of industry experience in full-stack development.
