
Machine Learning System Software Engineer
Required skills
- Machine Learning
- System Software
- C++
- runtime systems
- process models
- thread models
- memory management
- IPC
- RPC
- resource lifecycle
Nice to have
- ML runtimes
- inference engines
- accelerator driver stacks
- TensorRT
- ONNX Runtime
- XLA
Role summary
Apple is seeking a Machine Learning System Software Engineer to join the Apple Neural Engine (ANE) team. This role focuses on developing high-performance, low-power AI solutions for Apple products. The engineer will work with system software, AI, and hardware optimization, with opportunities for technical leadership and cross-functional collaboration. The position requires deep expertise in C/C++ and understanding of runtime systems and software-hardware interfaces, with preferred experience in ML runtimes, model compilation, and multi-client scenarios.
Description
This is a dynamic opportunity to work in a creative, collaborative environment while developing groundbreaking technologies that will shape the future of computing! We are looking for an engineer with deep expertise in system software technology who is eager to tackle new challenges and responsibilities as the role evolves. As the position progresses, there will be opportunities to demonstrate technical leadership, influence key design decisions, collaborate with and support other engineers, and help guide the direction of Apple's AI-driven capabilities across the ecosystem. Are you ready to help us deliver the next groundbreaking Apple products?
Minimum Qualifications
BS and a minimum of 10 years relevant industry experience Experience defining interfaces that are used by other teams or external developers, with attention to lifecycle, error handling, and forward compatibility Deep proficiency in C and C++ in large, production system software Understanding of runtime systems: process/thread models, memory management, IPC/RPC, and resource lifecycle Understanding of software-hardware interfaces: registers, DMA, command queues, or similar accelerator interaction patterns Experience shipping production system software
Preferred Qualifications
Experience building or extending ML runtimes, inference engines, or accelerator driver stacks (e.g., TensorRT, ONNX Runtime, XLA, Metal, Vulkan compute, or similar) Familiarity with Swift/Rust or another memory-safe systems language Familiarity with ML model compilation pipelines and how runtime APIs interact with compiler outputs (graph IR, compiled binaries) Experience with multi-client runtime scenarios: arbitrating hardware access, managing priority/QoS, and handling client lifecycle (ex: connect, disconnect, crash recovery) Knowledge of neural network inference: operator execution, tensor memory layout, pipelining, and batching strategies Strong communication skills and experience working across team boundaries (framework teams, compiler teams, hardware teams)
Sample Apple interview questions
- 1
Design a typeahead box for a search engine
system designmedium - 2
Design a rate limiter
system designmedium - 3
Architect a key-value store for distributed systems.
system designmedium - 4
Design a system to schedule jobs in a distributed environment
system designmedium - 5
What is an API and how does it work?
technicalmedium
Get started to unlock a personalized interview prep pack for this role.
Similar roles
BMS Control SpecialistApple · Austin, TX · Onsite
Learning Experience Designer, WW Sales Learning & DevelopmentApple · Austin, TX · Onsite
Agentic AI Director of Software EngineeringJPMorganChase · Columbus, OH · Onsite
Associate Embedded Software Engineer, Early CareerViasat · Carlsbad, CA · Hybrid
Director, Software EngineeringUnitedHealth Group · Eden Prairie, MN · Hybrid
Senior Bioinformatics Software EngineerBaylor Genetics · United States · Onsite
