Apple logo
Apple Verified
Consumer Electronics, Software, Services, Retail

Sr Engineering Program Manager, Evaluation - Special Projects

Cupertino, CAOnsiteFull TimeSeniorPosted 2 months agoVisa sponsorship available

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Required skills

  • AI evaluation framework
  • AI model performance
  • AI quality bar
  • Product roadmaps
  • Hill-climbing decisions
  • Technical depth
  • ML evaluation
  • Influence executive level
  • High-stakes programs
  • AI quality

Nice to have

  • Machine Learning
  • Statistics
  • Quantitative field
  • Large language models
  • LLMs
  • Vision-language models

Role summary

Apple's Special Projects team is seeking a Senior Engineering Program Manager (EPM) to lead the AI evaluation framework for next-generation AI experiences. This role involves driving the strategic direction for measuring and validating AI model performance across modalities. You will organize and lead teams to architect evaluation methodologies, translating ambiguous product requirements into concrete success metrics that ensure models meet Apple's quality standards. Your work will directly influence product roadmaps and critical decision-making for AI experiences used by millions. The position requires technical depth in ML evaluation, executive-level influence, program leadership, and mentoring capabilities.

Apple's Special Projects team is seeking a Senior Engineering Program Manager (EPM) to lead our AI evaluation framework at the forefront of next-generation AI experiences. This is a highly visible role where you'll drive the strategic direction for how we measure and validate AI model performance across modalities. You will organize and lead teams to architect our evaluation methodology, translating ambiguous product requirements into concrete success metrics that determine if our models meet Apple's quality bar. Your work will directly influence product roadmaps and drive critical hill-climbing decisions that shape the AI experiences millions of users will interact with daily. This role requires mastery of both technical depth in ML evaluation and the ability to influence across teams at the executive level. You'll lead complex, high-stakes programs while mentoring teams and establishing best practices that will define Apple's approach to AI quality.

Description


As the EPM for Evaluation, you will be responsible for :

Minimum Qualifications


7+ years of technical program management experience, with at least 3 years leading complex AI/ML programs. Proven track record of delivering complex programs by defining clear requirements and driving engineering teams to successful outcomes. Experience influencing and driving decisions at Director/VP level. Strong ability to navigate ambiguity and lead teams through uncertainty while maintaining program momentum. Excellence in executive communication - ability to distill complex technical information with the right balance of detail.

Preferred Qualifications


Master's or PhD in Computer Science, Machine Learning, Statistics, or related quantitative field. Deep hands-on experience with large language models (LLMs), vision-language models (VLMs), and multi-modal architectures. Demonstrated mastery of ML concepts, evaluation methodologies, and the end-to-end model development lifecycle. Experience with reinforcement learning from human feedback (RLHF) and preference optimization. Expertise in statistical analysis, A/B testing, and experimental design at scale.

Sample Apple interview questions

  • 1

    Architect a big data ingestion system focusing entirely on reliability and backpressure management during unpredictable traffic events.

    system designmedium
  • 2

    Break down the system design for a global digital learning environment including video hosting and user progress tracking.

    system designmedium
  • 3

    How do you architect a risk system that dynamically shifts its strictness based on the merchants tolerance for fraud?

    system designmedium
  • 4

    Break down the data pipeline required to serve live ad performance statistics to a client dashboard.

    system designmedium
  • 5

    Let us build the backend for a smart parking garage. How do you manage inventory and process payments in real time?

    system designmedium

Get started to unlock a personalized interview prep pack for this role.

Ready to apply?
You'll be redirected to Apple's application page.

Similar roles

See how RiseMe works

Match, tailor, and prep so you send fewer applications and land more interviews.