NVIDIA logo
NVIDIA Verified
Semiconductors, Artificial Intelligence, Computer Hardware, Software Development

Senior Software Engineer, AI Performance Analysis

RemoteRemoteFull TimeSenior$184,000–$356,500 /yrPosted 7 days agoVisa sponsorship availableHidden Gem · Himalayas

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Required skills

  • AI workloads
  • frameworks
  • performance characteristics
  • infrastructure
  • Python
  • C++
  • scalable tooling
  • AI-enabled tooling
  • performance analysis

Nice to have

  • profiling
  • optimizing AI training
  • inference pipelines
  • developer tools
  • platforms for ML engineers
  • open-source AI tooling

Role summary

NVIDIA is seeking a senior software engineer to automate and optimize performance analysis for AI training and inference workloads. The role involves designing and building scalable tools and workflows, integrating profiling infrastructure with AI frameworks, and identifying/diagnosing performance bottlenecks. Strong software development skills in Python and C++ are required, along with deep knowledge of AI workloads and frameworks. Experience building tools for other engineers and familiarity with AI-enabled development tooling are also key. Preferred qualifications include experience profiling/optimizing AI pipelines at scale and building developer tools for ML engineers.

NVIDIA GPU Architecture Group is seeking a senior software engineer to automate and optimize performance analysis workflows for AI training and inference workloads. You will not only perform analysis but also reshape how it's done, building tools and workflows that scale across a broad audience of engineers. NVIDIA is a world-class leader in AI workload optimization, and your work will push these boundaries even further!

What you'll be doing:

  • Design and build performance analysis tools and workflows for AI training and inference workloads.

  • Understand how AI performance engineers work and translate their needs into scalable, intuitive tooling.

  • Develop integrations between profiling infrastructure and AI frameworks and workflows.

  • Collaborate with performance engineers, hardware architects, and software teams to ensure profiling capabilities align with real-world AI workloads.

  • Identify performance bottlenecks in AI workloads and develop automated approaches to detect and diagnose them.

What we need to see:

  • M.S., or PhD in Computer Science, Computer Engineering, or a related field (or equivalent experience). 6+ years of relevant work experience

  • Deep knowledge of AI workloads, frameworks, and performance characteristics.

  • Experience building tools, workflows, or infrastructure used by other engineers.

  • Strong software development skills (Python, C++ preferred).

  • Ability to translate user requirements into scalable tooling solutions.

  • Up to date with AI-enabled tooling for software development and performance analysis.

  • Strong interpersonal skills for understanding engineer difficulties and working across multi-functional teams.

Ways to stand out from the crowd:

  • Experience profiling or optimizing AI training or inference pipelines at scale

  • Background building developer tools or platforms for ML engineers

  • Contributions to open-source AI tooling or frameworks

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 16, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Originally posted on Himalayas

Sample NVIDIA interview questions

  • 1

    Design a system for a rock paper scissors game

    system designmedium
  • 2

    Implement a distributed data migration management platform.

    system designmedium
  • 3

    Design a Distributed Build System with Cross-Data Center Artifact Sharing

    system designhard
  • 4

    Design a distributed training system for a trillion-parameter language model

    system designmedium
  • 5

    Develop a distributed tracing system for tracking and debugging.

    system designmedium

Get started to unlock a personalized interview prep pack for this role.

Ready to apply?
You'll be redirected to NVIDIA's application page.

Similar roles

See how RiseMe works

Match, tailor, and prep so you send fewer applications and land more interviews.