
Distinguished Engineer, AI Infrastructure
Required skills
- AI Infrastructure
- Machine Learning
- Distributed Systems
- Training Systems
- Inference Systems
- Cloud-Native Architectures
- Compute Orchestration
- Kubernetes
- ML Accelerators
- GPUs
Nice to have
- Distributed Training
- Distributed Inference
- ML Systems Performance
- Profiling
- Optimization
- Deep Learning Frameworks
Role summary
Apple is seeking a Distinguished Engineer for its Machine Learning Platform Technologies - ML Compute organization. This role will provide technical leadership in building and evolving next-generation AI infrastructure, focusing on large-scale training and inference systems at the intersection of AI research, systems, and cloud infrastructure. The engineer will shape architecture and long-term technical strategy, influencing how models are trained, deployed, and scaled across diverse accelerator platforms. Key requirements include 15 years of experience in distributed systems, proficiency in backend languages like Python or C++, and experience with cloud-native architectures and ML accelerators. Preferred qualifications include expertise in ML systems performance and deep learning frameworks.
Description
We are seeking a Distinguished Engineer to provide technical leadership in building and evolving next-generation AI infrastructure at Apple. In this role, you will shape the architecture and long-term technical strategy for large-scale training and inference systems, working at the intersection of AI research, systems, and cloud infrastructure. Your work will directly influence how frontier and production models are trained, deployed, and scaled across diverse accelerator platforms.
Minimum Qualifications
Bachelor’s degree in Computer Science, relevant technical field, or equivalent practical experience 15 years of experience designing and building very large-scale distributed systems Proficiency in at least 1 backend language (e.g., Python, C++, Go, Rust) Proficiency in cloud-native architectures and compute orchestration platforms (e.g., Kubernetes) Hands-on experience working with ML accelerators such as GPUs and TPUs Track record of mentoring senior engineers and setting long-term architectural vision across orgs
Preferred Qualifications
Master’s degree or PhD in Computer Science or related technical fields Experience in running distributed training and/or inference workloads in production Expertise in ML systems performance profiling, debugging, and optimization Expertise in deep learning frameworks (e.g., PyTorch, JAX) and their underlying architectures
Sample Apple interview questions
- 1
Design a typeahead box for a search engine
system designmedium - 2
Design a rate limiter
system designmedium - 3
Architect a key-value store for distributed systems.
system designmedium - 4
Design a system to schedule jobs in a distributed environment
system designmedium
Get started to unlock a personalized interview prep pack for this role.
Similar roles
Senior Security EngineerRain · New York, NY · Onsite- Senior Electronics Quality Engineer- RemoteYO AI Labs · Remote · Remote
Remote Systems Integration Engineer - SMEPeraton · Remote · Remote- Lead Backend EngineerGardens Interactive · Remote · Remote
Data EngineerHiggsfield AI · San Francisco, CA · Hybrid- Staff Nuclear EngineerRadiant Nuclear · El Segundo, CA · Onsite
