
Senior Software Engineer, AI Performance Analysis
Required skills
- AI workloads
- frameworks
- performance characteristics
- infrastructure
- Python
- C++
- scalable tooling
- AI-enabled tooling
- performance analysis
Nice to have
- profiling
- optimizing AI training
- inference pipelines
- developer tools
- platforms for ML engineers
- open-source AI tooling
Role summary
NVIDIA is seeking a senior software engineer to automate and optimize performance analysis for AI training and inference workloads. The role involves designing and building scalable tools and workflows, integrating profiling infrastructure with AI frameworks, and identifying/diagnosing performance bottlenecks. Strong software development skills in Python and C++ are required, along with deep knowledge of AI workloads and frameworks. Experience building tools for other engineers and familiarity with AI-enabled development tooling are also key. Preferred qualifications include experience profiling/optimizing AI pipelines at scale and building developer tools for ML engineers.
NVIDIA GPU Architecture Group is seeking a senior software engineer to automate and optimize performance analysis workflows for AI training and inference workloads. You will not only perform analysis but also reshape how it's done, building tools and workflows that scale across a broad audience of engineers. NVIDIA is a world-class leader in AI workload optimization, and your work will push these boundaries even further!
What you'll be doing:
Design and build performance analysis tools and workflows for AI training and inference workloads.
Understand how AI performance engineers work and translate their needs into scalable, intuitive tooling.
Develop integrations between profiling infrastructure and AI frameworks and workflows.
Collaborate with performance engineers, hardware architects, and software teams to ensure profiling capabilities align with real-world AI workloads.
Identify performance bottlenecks in AI workloads and develop automated approaches to detect and diagnose them.
What we need to see:
M.S., or PhD in Computer Science, Computer Engineering, or a related field (or equivalent experience). 6+ years of relevant work experience
Deep knowledge of AI workloads, frameworks, and performance characteristics.
Experience building tools, workflows, or infrastructure used by other engineers.
Strong software development skills (Python, C++ preferred).
Ability to translate user requirements into scalable tooling solutions.
Up to date with AI-enabled tooling for software development and performance analysis.
Strong interpersonal skills for understanding engineer difficulties and working across multi-functional teams.
Ways to stand out from the crowd:
Experience profiling or optimizing AI training or inference pipelines at scale
Background building developer tools or platforms for ML engineers
Contributions to open-source AI tooling or frameworks
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until August 16, 2026.This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Originally posted on Himalayas
Sample NVIDIA interview questions
- 1
Design a system for a rock paper scissors game
system designmedium - 2
Implement a distributed data migration management platform.
system designmedium - 3
Design a Distributed Build System with Cross-Data Center Artifact Sharing
system designhard - 4
Design a distributed training system for a trillion-parameter language model
system designmedium - 5
Develop a distributed tracing system for tracking and debugging.
system designmedium
Get started to unlock a personalized interview prep pack for this role.
Similar roles
Lead Software EngineerJPMorganChase · Chicago, IL · Onsite
Associate Embedded Software Engineer, Early CareerViasat · Carlsbad, CA · Hybrid
Director, Software EngineeringUnitedHealth Group · Eden Prairie, MN · Hybrid
Senior Bioinformatics Software EngineerBaylor Genetics · United States · Onsite- Senior Software Engineer II - Platform & EnablementWrapbook · Remote · Remote
- Associate Software EngineerKeyfactor, Inc. · Remote · Remote
