Member of Technical Staff (Search Core, Indexing & Data Pipeline Stream)New
The opportunity
Perplexity is looking for a highly skilled Expert Systems Engineer to join our Search Core team. For the indexing and data processing stream.
What you'll do
Design and build core search engine components, especially indexing: pipelines, data storage formats that operate at the scale of billions of pages
Develop streaming and batch data processing with YT systems for search index: construction in a high-load environment
Push the limits of hardware performance through low-level optimizations and systems-level tuning
Tackle challenges in multithreading, concurrency, and system-level optimization
Design and build core search engine components, including indexing pipelines,: retrieval algorithms, and ranking systems that operate at the scale of billions of pages
Develop streaming and batch data processing systems for search index construction in a high-load environment
What they're looking for
- Push the limits of hardware performance through low-level optimizations and systems-level tuning
- Tackle challenges in multithreading, concurrency, and system-level optimization
- + years of hands-on experience in systems programming (Rust, C++, C, or similar)
- Ownership of full project lifecycle: you don't just write a fast inner loop, you care about how the system is built, deployed, operated, and scaled in production
