Senior Efficacy Research and Psychometrics Analyst, Khan Kids (24 months fixed-term)New$138K–$155K

Khan Academy
Apply now

The opportunity

Notice to applicants: We have seen a rise in recruitment scams. Please note that outreach from Khan Academy recruiters will only come from the @khanacademy.

What you'll do

  • Lead our psychometric research partnership: Serve as the primary technical point of contact for our external psychometric research partnership, supporting study design, data sharing, psychometric analyses, and interpretation of findings

  • Extract, clean, and securely share assessment data with research partners on a recurring schedule

  • Analyze and interpret psychometric findings, including item difficulty, score: distributions, growth analyses, concurrent validity, and IRT-based scoring

  • Partner with our product and engineering teams to translate findings into: product improvements, such as updates to scoring models and assessment discontinuation rules

  • Collaborate with research partners to develop and publish technical: documentation, beginning with the technical manual for our PreK assessment

  • Recruit and manage research partner sites: Recruit and onboard school and district sites for psychometric and efficacy studies; execute MOUs; align on consent procedures and participant incentives; and coordinate site visits for direct child assessment data collection

What they're looking for

  • Partner with our legal team to draft and negotiate data-sharing agreements: with districts and research organizations, including requirements for pseudonymized and identified data
  • Support efficacy research. Coordinate Khan Academy Kids' participation in: ongoing efficacy studies and contribute to the design of future studies, aligning internal and external stakeholders on the research approach
  • Own Khan Kids’s KPI dashboard: Partner with our engineering team to build and maintain the Khan Academy Kids analytics dashboard, including integrations with App Store Connect and Google Play Console. Maintain the dashboard so it can be used by other teams including marketing, school partnerships, and philanthropy.
  • Lead recurring reporting: Prepare recurring app performance reporting, including monthly and quarterly business reviews and periodic target setting. Field ad hoc data requests across teams — for example, writing new SQL queries to support targeted district outreach or grant reporting.