Software Engineer, Data Infrastructure
OpenAI • San Francisco
Hybrid
Posted 6/27/2024
Job Overview
Location
San Francisco
Work Type
Hybrid
Posted
6/27/2024
About this role
Data Platform at OpenAI owns the foundational data stack powering critical product, research, and analytics workflows. We operate some of the largest Spark compute fleets in production; design, and build data lakes and metadata systems on Iceberg and Delta with a vision toward exabyte-scale architecture; run high throughput streaming platforms on Kafka and Flink; provide orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is to deliver reliable, secure, and efficient data access at scale and accelerate intelligent, AI assisted data workflows.