The opportunity
Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences…
What you'll do
SpinalTap: near real-time change data capture (CDC) streaming to Kafka for: every Aurora and UDS table at Airbnb.
DBExports: periodic full-table snapshots and mutation exports.
Be hands-on (code, design, test) and work with partner teams, internal: customers, and leadership to deliver multi-month projects on time.
Design, build, and operate large-scale CDC and batch export systems that run: across every online database at Airbnb.
Help shape the architecture of DMT's unified data movement platform while it's being built.
Improve the reliability, performance, and efficiency of systems that critical business functions depend on.
What they're looking for
- Make it easier for engineers at Airbnb to get their data into offline systems: without needing to be database or pipeline experts.
- Take part in on-call and raise the operational bar for a platform that other teams build on.
- + years of experience building and operating large-scale backend distributed: systems, such as data ingestion, streaming, CDC, storage, or data platforms.
- Hands-on experience with streaming systems like Kafka, and with how databases: capture and publish changes (binlogs, Debezium, or similar).