
Perception Algorithm Engineer
Required skills
- AI/ML
- Robotics
- Deep Learning
- Classical Techniques
- Systems Programming
- Production-Quality Code
- Machine Learning Frameworks
- Perception
- State-Estimation
- Testable Solutions
Nice to have
- Scalable Evaluation Pipelines
- Learning Based Pipelines
- Classical Perception Pipelines
- On-Device Computer Vision Models
- Multi-Object Tracking Systems
- VLMs
Role summary
Apple is seeking talented Perception Algorithm Engineers to contribute to new AI/ML and robotics-driven experiences in their products. This role involves blending deep learning with classical techniques, requiring proficiency in systems programming (C++/Swift) and Python, along with modern ML frameworks like PyTorch or JAX. The ideal candidate will have a PhD or MS in a related field with significant industry experience, a strong foundation in perception and state-estimation, and the ability to solve complex problems. Preferred qualifications include experience with scalable evaluation pipelines, on-device computer vision, multimodal data fusion, robotics software stacks, and applied mathematics.
Description
As a member of the team, you’ll have the opportunity to work with a team of highly skilled engineers and scientists to bring new experiences to Apple products. We are looking for a self-motivated algorithm engineer who is passionate about blending modern deep learning with robust classical techniques.
Minimum Qualifications
PhD in Computer Science, Robotics, or a related field with 3 years industry experience or MS with 2+ years industry experience. Proficiency in systems programming (C++/Swift) and writing performant, production-quality code. Fluency in Python and modern ML frameworks (e.g., PyTorch, JAX) with a solid foundation in machine learning and traditional perception and state-estimation pipelines. Ability to break down complex problems into testable solutions, prioritizing challenging edge cases and accessible experiences for all users. Curiosity about new technologies, flexibility, and an openness to ambiguity.
Preferred Qualifications
Experience designing scalable evaluation pipelines for learning based and classical perception pipelines. Experience in building and/or deploying on-device computer vision models or multi-object tracking systems. An area of particular domain expertise, such as one of the following: Experience with machine learning approaches and architectures (e.g., VLMs, VLAs, foundation models, self-supervision, distillation, or data augmentation techniques). Experience with classical and modern computer vision approaches, reconstruction pipelines, image processing/camera systems and computational photography pipelines Experience with multimodal data fusion across a variety of inputs and sensors, including audio processing (e.g., DSP, echo cancellation, audio-visual diarization, speech recognition) Knowledge of the broader robotics software stack (e.g., kinematics, planning, controls) alongside state estimation methods (e.g., SLAM, factor graphs, filtering, sensor fusion) and reinforcement learning methods. Strong applied math background (e.g., numerical optimization, geometry, graphics). Familiarity with Swift and Apple developer tools.
Sample Apple interview questions
- 1
Design a typeahead box for a search engine
system designmedium - 2
Design a rate limiter
system designmedium - 3
Architect a key-value store for distributed systems.
system designmedium - 4
Design a system to schedule jobs in a distributed environment
system designmedium - 5
What is an API and how does it work?
technicalmedium
Get started to unlock a personalized interview prep pack for this role.
Similar roles
Shipping SupervisorApple · Santa Clara, CA · Onsite
Senior Data Engineer, Data ProductsApple · Cupertino, CA · Onsite
ADAS Planning Algorithm EngineerAptiv · Usa Troy Offices, MI · Onsite- Senior Algorithm EngineerKLA · Usa-ca-milpitas-kla, CA · Onsite
Principal Deep Learning Algorithm EngineerNVIDIA · Remote · Hybrid
Algorithm Engineer IIGentex Corporation · Centennial East, MI · Onsite
