2027 Summer Intern, PhD, Research, VLM Harnesses for AV PlanningActive$177K

The opportunity

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to…

What you'll do

  • Design and implement scenario preprocessors (e.g., visual rendering, scene: representations, and multimodal prompting) to effectively present driving scenarios to state-of-the-art VLMs

  • Develop postprocessors that translate VLM outputs into feasible, safe: trajectories for closed-loop vehicle control

  • Evaluate VLM driving harnesses in closed-loop autonomous driving simulation: and iterate on representations based on driving metrics

  • Communicate to both technical and non-technical audiences regarding research motivations and research findings

  • Conduct cutting-edge research and potentially communicate research findings: to the wider academic community via technical reports and/or publications

  • Currently enrolled in a PhD program in computer science, statistics, applied: mathematics, physics, or a related technical field of study

What they're looking for

  • Familiarity with major ML Frameworks (JAX, Pytorch)
  • Experience using coding agents for auto-research
  • + years of experience with Deep Learning, Computer Vision, and Generative Models (such as VLMs/LLMs)
  • Publications at top-tier conferences such as CVPR/ICCV/ECCV/ICLR/ICML/NeurIPS/IROS/CoRL etc.