Machine Learning Engineer, Foundation Model Services

Name: RiseMe
Availability: InStock

Seattle, WAOnsiteFull TimePosted 2 months agoVisa sponsorship available

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Required skills

production software
machine learning systems
Go
Python
cloud platform
containers
Kubernetes
Docker
LLMs
Machine Learning

Nice to have

Nvidia TensorRT-LLM
vLLM
DeepSpeed
Nvidia Triton Server

Role summary

Apple is seeking a Machine Learning Engineer for its Foundation Model Services team. This role involves building production-grade solutions and frameworks to serve large foundation models across various Apple products. You will collaborate with product teams and researchers to optimize inference, develop new model architectures, and build tools to identify performance bottlenecks. The position requires proficiency in modern programming languages like Python or Go, experience with cloud platforms and containerization (Kubernetes/Docker), and a strong background in machine learning technologies, particularly LLMs, NLP, and low-latency services. A Bachelor's degree in Computer Science or a related field is necessary, with preferred familiarity in specific ML serving frameworks.

Do you think differently? Are you eager to break the status quo, bold and ambitious, unafraid to take risks, and passionate about building best-in-class technology? If so, there's no better place to do it than Apple. The Foundation Model Services team builds the frameworks, services, and tools that run Apple's largest foundation models in production. Our infrastructure powers intelligent experiences across products people use every day — Search, Music, TV, the App Store, Messages, Photos, Spotlight, Safari, Siri, and more — serving millions of queries at incredibly low latency while drawing every ounce of performance from our hardware. Join us and you'll help bring intelligence to billions of users around the world, working on optimizing and serving large language, vision, and speech models at Apple's scale.

Description

Work closely with product teams to build production-grade solutions that launch models serving customers in real time. Partner with foundation model researchers to prototype and develop inference for cutting-edge model architectures, and build tools that help us understand and remove performance bottlenecks across different hardware and use cases. Write high-quality code, learn quickly in a fast-moving field, and grow your impact as you take on larger pieces of the system.

Minimum Qualifications

2+ years of industry experience building and shipping production software and/or machine learning systems. Proficiency in a modern programming language such as Go or Python. Experience deploying and operating services on a cloud platform (AWS, Azure, GCP, or equivalent) using containers and Kubernetes/Docker. 5 year+ industry experience in ML technologies (LLMs, Machine Learning, NLP, Information Retrieval, Statistics). Experience building or operating high-throughput, low-latency services. Strong communication and collaboration skills, with the ability to partner across research and product teams. Bachelor’s degree or higher in Computer Science or related technical field.

Preferred Qualifications

Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, Nvidia Triton Server etc.

Sample Apple interview questions

1
Design a typeahead box for a search engine
system designmedium
2
Design a rate limiter
system designmedium
3
Architect a key-value store for distributed systems.
system designmedium
4
Design a system to schedule jobs in a distributed environment
system designmedium
5
What is an API and how does it work?
technicalmedium

Get started to unlock a personalized interview prep pack for this role.

Ready to apply?

You'll be redirected to Apple's application page.