
Sr Engineering Program Manager, Evaluation - Special Projects
Required skills
- AI evaluation framework
- AI model performance
- AI quality bar
- Product roadmaps
- Hill-climbing decisions
- Technical depth
- ML evaluation
- Influence executive level
- High-stakes programs
- AI quality
Nice to have
- Machine Learning
- Statistics
- Quantitative field
- Large language models
- LLMs
- Vision-language models
Role summary
Apple's Special Projects team is seeking a Senior Engineering Program Manager (EPM) to lead the AI evaluation framework for next-generation AI experiences. This role involves driving the strategic direction for measuring and validating AI model performance across modalities. You will organize and lead teams to architect evaluation methodologies, translating ambiguous product requirements into concrete success metrics that ensure models meet Apple's quality standards. Your work will directly influence product roadmaps and critical decision-making for AI experiences used by millions. The position requires technical depth in ML evaluation, executive-level influence, program leadership, and mentoring capabilities.
Description
As the EPM for Evaluation, you will be responsible for :
Minimum Qualifications
7+ years of technical program management experience, with at least 3 years leading complex AI/ML programs. Proven track record of delivering complex programs by defining clear requirements and driving engineering teams to successful outcomes. Experience influencing and driving decisions at Director/VP level. Strong ability to navigate ambiguity and lead teams through uncertainty while maintaining program momentum. Excellence in executive communication - ability to distill complex technical information with the right balance of detail.
Preferred Qualifications
Master's or PhD in Computer Science, Machine Learning, Statistics, or related quantitative field. Deep hands-on experience with large language models (LLMs), vision-language models (VLMs), and multi-modal architectures. Demonstrated mastery of ML concepts, evaluation methodologies, and the end-to-end model development lifecycle. Experience with reinforcement learning from human feedback (RLHF) and preference optimization. Expertise in statistical analysis, A/B testing, and experimental design at scale.
Sample Apple interview questions
- 1
Architect a big data ingestion system focusing entirely on reliability and backpressure management during unpredictable traffic events.
system designmedium - 2
Break down the system design for a global digital learning environment including video hosting and user progress tracking.
system designmedium - 3
How do you architect a risk system that dynamically shifts its strictness based on the merchants tolerance for fraud?
system designmedium - 4
Break down the data pipeline required to serve live ad performance statistics to a client dashboard.
system designmedium - 5
Let us build the backend for a smart parking garage. How do you manage inventory and process payments in real time?
system designmedium
Get started to unlock a personalized interview prep pack for this role.
Similar roles
US Carrier Sales Consumer Offers LeadApple · Cupertino, CA · Onsite
AMS Lab OperationsApple · California · Onsite
Senior Hardware Engineering Program ManagerChargePoint · Campbell-254, CA · Onsite
IFS Sr. Engineering Program ManagerHoneywell International Inc. · United States · Hybrid- Engineering Program ManagerEight Sleep · San Francisco, CA · Onsite
Engineering Program ManagerBose Corporation · Binghamton, NY · Onsite
