
Senior Deep Learning Performance Architect - LPU
Required skills
- AI Inference
- GPU architecture
- Deep Learning
- performance modeling
- LLM
- C++
- Python
- CUDA
- HPC
- MPI
Nice to have
- systems-level performance modeling
- profiling
- comparison studies
- CUDA kernels
- custom ASIC hardware
Role summary
NVIDIA is seeking a Senior Deep Learning Performance Architect to focus on AI Inference performance and efficiency through hardware-software co-design. The role involves designing GPU and system architectures, investigating deep learning algorithms, building performance models, and collaborating with cross-functional teams. Requires an MS/PhD or equivalent experience, 5+ years of relevant experience, strong ML/DL foundation, expert programming in C/C++/Python, familiarity with GPU computing (CUDA) and HPC (MPI, OpenMP), and knowledge of computer architecture. Background in systems-level performance modeling, profiling, and analysis is a plus.
We are now looking for a Senior Deep Learning Performance Architect!
NVIDIA seeks a Senior DL Performance Architect to join our group of pioneers who enjoy pushing AI Inference performance boundaries. Our team focuses on ambitious hardware-software co-design to speed AI Inference workloads. This role gives an outstanding opportunity to develop world-class performance strategies, guide future GPU architecture decisions, and lead AI innovation. If you are passionate about AI efficiency Pareto curves, have a proven record of modeling LLM performance and architecting AI systems, and enjoy optimizing every cycle, this role may be perfect for you!
What you'll be doing:
Design novel GPU and system architectures to advance the forefront of AI Inference performance and efficiency
Construct, investigate, and test popular deep learning algorithms and applications
Understand and analyze the relationship between hardware and software architectures as it influences future algorithms and applications
Build efficient power and performance models of AI inference stack, while capturing minimal but significant information to guide next-gen HW architecture
Collaborate across the company to guide the direction of AI, working with software, research, and product teams
What we need to see:
A MS or PhD in a relevant field (CS, EE, Math) or equivalent experience, with 5+ years of relevant experience
Strong mathematical foundation in machine learning and deep learning
Expert programming skills in C, C++, and/or Python
Familiarity with GPU computing (CUDA or similar) and HPC (MPI, OpenMP) stack
Strong knowledge and coursework in computer architecture
Ways to stand out from the crowd:
Background with systems-level performance modeling, profiling, and analysis
Experience in characterizing and modeling system-level performance, accomplishing comparison studies, and documenting and publishing results
Background in improving AI Inference workloads by developing CUDA kernels or compilers for custom ASIC hardware
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until July 26, 2026.This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Originally posted on Himalayas
Sample NVIDIA interview questions
- 1
Design a system for a rock paper scissors game
system designmedium - 2
Implement a distributed data migration management platform.
system designmedium - 3
Design a Distributed Build System with Cross-Data Center Artifact Sharing
system designhard - 4
Design a distributed training system for a trillion-parameter language model
system designmedium - 5
Develop a distributed tracing system for tracking and debugging.
system designmedium
Get started to unlock a personalized interview prep pack for this role.
Similar roles
Learning Performance Consultant - Field LearningEdward Jones · Tempe, AZ · Hybrid- Machine Learning Performance Engineer (Inference)Tower Research Capital · New York · Hybrid
- Senior Staff Machine Learning Performance EngineerXPENG · Santa Clara, CA · Onsite
- Machine Learning Performance Engineer, TrainingTower Research Capital · New York, NY · Hybrid
