NVIDIA logo
NVIDIA Verified
Semiconductors, Artificial Intelligence, Computer Hardware, Software Development

Distinguished Engineer - Dynamo

WashingtonHybridFull TimeDistinguished / Architect$320,000–$488,750 /yrPosted 1 month agoVisa sponsorship available

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Required skills

  • Distinguished Engineer
  • Dynamo
  • AI inference
  • inference systems
  • inference engines
  • Rust
  • Python
  • Go
  • AWS
  • GCP

Nice to have

  • observability
  • resilience
  • continual learning
  • disaggregated serving
  • KV-aware routing

Role summary

NVIDIA is seeking a Distinguished Engineer with deep expertise in AI inference to join the Dynamo engineering team. This senior technical leader will drive technology and product direction, provide technical guidance, and significantly impact the next generation of inference on NVIDIA hardware. Responsibilities include contributing to open-source projects, leading initiatives in resiliency, performance, and scalability for AI inferencing platforms, and representing NVIDIA externally. The role requires 18+ years of systems software engineering experience, proficiency in languages like Rust, Python, and Go, and expertise in cloud computing platforms. Preferred qualifications include experience with production-grade infrastructure and a passion for continuous learning in AI/ML systems.

We are currently seeking a senior-level Engineer with distinguished expertise to join the Dynamo engineering team. As a Distinguished Engineer, you will be a key technical leader, helping drive technology and product direction, provide deep technical expertise and guidance to the team and NVIDIA at large, and have a material impact on the next generation of inference on NVIDIA hardware.


At NVIDIA, we believe that inference will be driving increasing amount of compute, and as the hardware becomes more capable, it is crucial to make it easy for users to get the best performance as easily as possible. NVIDIA Dynamo helps users achieve state-of-the-art performance, using advanced techniques such as disaggregated serving, KV-aware routing, and others. As inference extends across modalities such as image, video and audio, the need for Dynamo only increases.


What you will be doing:

  • Contribute to the Dynamo family of open source projects.
  • Serve as a technical expert in AI inferencing, helping to push the frontier of what's possible.
  • Represent Dynamo and NVIDIA with customers, partners and the AI community.
  • Lead critical initiatives around resiliency, performance and scalability for Dynamo and AI inference.
  • Build and drive Dynamo to continue being a production-ready, data center-scale AI inferencing platform.
  • Collaborate with diverse partner teams at NVIDIA across storage, networking, hardware and performance.
  • Keep abreast of the latest advancements in AI/ML infrastructure technologies, frameworks, and effective strategies, and promote their implementation within the company.

What we need to see:

  • BS, MS, PhD, or equivalent experience in Computer Science, Computer Engineering, Artificial Intelligence or a related field.
  • 18+ years of Proven experience in systems software engineering
  • Expertise in the AI inference space, such as operating production inference systems at scale, working on inference engines, or similar.
  • Experience serving as a senior technical leader in an organization, with the ability to lead through influence.
  • Proficiency in programming languages such as Rust, Python, and Go, as well as familiarity with cloud computing platforms (e.g., AWS, GCP, Azure).
  • Excellent problem-solving skills, showing proficiency in analyzing complex systems, identifying bottlenecks, and implementing scalable solutions.
  • Excellent communication and collaboration skills, demonstrating effectiveness in working with diverse teams and individuals.

Ways to stand out from the crowd:

  • Experience in production-grade infrastructure, knowing how to take into account observability, resilience and operations.
  • Enthusiasm for continual learning and keeping abreast of new technologies and effective approaches within the AI/ML systems domain.

With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology industry's most desirable employers. We have some of the most forward-thinking and dedicated people in the world working with us and our engineering teams are contributing to some of the hottest state of the art fields: Deep Learning, Artificial Intelligence, and Autonomous Vehicles. If you're a creative and motivated software engineer with a real passion for building fast software solutions, as well as impacting AI development worldwide, we want to hear from you.


#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD - 488,750 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 11, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Sample NVIDIA interview questions

  • 1

    Design a system for a rock paper scissors game

    system designmedium
  • 2

    Implement a distributed data migration management platform.

    system designmedium
  • 3

    Design a Distributed Build System with Cross-Data Center Artifact Sharing

    system designhard
  • 4

    Design a distributed training system for a trillion-parameter language model

    system designmedium
  • 5

    Develop a distributed tracing system for tracking and debugging.

    system designmedium

Get started to unlock a personalized interview prep pack for this role.

Ready to apply?
You'll be redirected to NVIDIA's application page.

Similar roles

See how RiseMe works

Match, tailor, and prep so you send fewer applications and land more interviews.