Staff+ Software Engineer, SafeguardsActive$320K

The opportunity

We are looking for software engineers to help build safety and oversight mechanisms for our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and ensure user well-being.

What you'll do

  • Develop monitoring systems to detect unwanted behaviors from our API partners: and potentially take automated enforcement actions; surface these in internal dashboards to analysts for manual review

  • Build abuse detection mechanisms and infrastructure

  • Surface abuse patterns to our research teams to harden models at the training stage

  • Build robust and reliable multi-layered defenses for real-time improvement of: safety mechanisms that work at scale

  • Bachelor’s degree in Computer Science, Software Engineering or comparable experience

  • Proficiency in Python and Typescript

What they're looking for

  • Ability to work across the stack
  • Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders
  • + years of experience in a software engineering position
  • Have experience with integrity, spam, fraud, or abuse detection and mitigation