Senior Software Engineer, SRE and Production Engineering - DGX Cloud
Required skills
- SRE
- Production Engineering
- bare-metal
- NVIDIA systems
- Go
- Python
- BMC
- Redfish
- NVIDIA GPU hardware
- NVL72
Nice to have
- DPU mode
- NVLink
- InfiniBand
- Spectrum-X
- GPU cluster performance validation
- rack-scale bringup
Role summary
NVIDIA DGX Cloud is seeking experienced Software Engineers with SRE or Production Engineering backgrounds to build and operate large-scale GPU infrastructure for AI workloads. The role involves hands-on work with bare-metal NVIDIA systems, developing automation for provisioning, hardware validation, upgrades, and cluster lifecycle management. Responsibilities include creating tools for BMC/Redfish interaction, diagnosing failures across complex systems, and participating in incident response. The ideal candidate will have 5+ years of experience in production infrastructure, strong Go or Python skills, and direct experience with NVIDIA hardware and Linux environments.
NVIDIA DGX Cloud builds and operates large-scale GPU infrastructure for AI workloads. We are looking for Software Engineers with SRE or Production Engineering experience who have worked hands-on with bare-metal NVIDIA systems. This team builds the software and operational tooling that moves GPU capacity from installed hardware to production service supporting an IaaS production environment of BMaaS, VMaaS.
What you’ll be doing
- Build automation for bare-metal provisioning, hardware validation, firmware and software upgrades, repair, and cluster lifecycle management.
- Develop tools that interact with BMC and Redfish interfaces to monitor hardware health, manage server state, and assist recovery workflows.
- Handle and advance NVIDIA NVL72 systems and BlueField-3 or later DPUs throughout cloud partner and on-premises environments.
- Diagnose failures across servers, DPUs, GPU systems, CPU systems, networking, Linux, and Kubernetes; turn recurring issues into automated detection and repair.
- Define validation and handoff criteria so new capacity enters production safely and consistently.
- Take part in on-call duties, incident response, root-cause analysis, and follow-up to implement permanent solutions.
- Work with hardware, networking, platform, data center operations, and partner teams to resolve issues across ownership boundaries.
What we need to see:
- 5+ years building software for or operating production infrastructure, including substantial hands-on bare-metal experience.
- Strong Go or Python skills, with a record of delivering production automation and services.
- Direct experience with BMC and Redfish in server provisioning, health inspection, power management, or fault diagnosis.
- Practical experience working directly with NVIDIA GPU hardware, such as NVL72 systems, and BlueField-3 or newer DPUs.
- Experience with Linux, firmware and driver management, network boot, and the server lifecycle from initial provisioning through repair.
- Experience managing production reliability through on-call duties, incident response, observability, and durable solutions.
- Ability to debug failures across hardware, host operating systems, networking, and distributed services.
- Clear communication and demonstrated ownership of problems that span multiple teams.
- BS/MS in Computer Science or equivalent experience in a practical setting.
Ways to stand out from the crowd:
- Experience operating BlueField DPUs in DPU mode, including host-to-DPU connectivity and lifecycle debugging, with DPU or equivalent experience considered.
- Background with NVLink, InfiniBand, Spectrum-X, or GPU cluster performance validation.
- Experience building safe, repeatable workflows for rack-scale bringup, firmware upgrades, hardware replacement, and customer handoff.
- Experience with Kubernetes, GitOps, Argo CD, SLOs, and fleet-wide automation.
At NVIDIA, you’ll help make next-generation AI infrastructure production-ready at scale!
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until October 3, 2026.This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Originally posted on Himalayas
Sample NVIDIA interview questions
- 1
Design a system for a rock paper scissors game
system designmedium - 2
Implement a distributed data migration management platform.
system designmedium - 3
Design a Distributed Build System with Cross-Data Center Artifact Sharing
system designhard - 4
Design a distributed training system for a trillion-parameter language model
system designmedium - 5
Develop a distributed tracing system for tracking and debugging.
system designmedium
Get started to unlock a personalized interview prep pack for this role.
Similar roles
- Software Engineer, OpenShellNVIDIA · Remote · Hybrid
- Senior Solutions Architect, NVIDIA Cloud Partner OperationsNVIDIA · Remote · Hybrid
Bioinformatics Software EngineerBaylor Genetics · United States · Onsite- Senior Software Engineer II - Platform & EnablementWrapbook · Remote · Remote
- Associate Software EngineerKeyfactor, Inc. · Remote · Remote
- Platform Software EngineerFord Motor Company · Dearborn, MI · Hybrid
