
Senior Software Architect - Data Center Systems
Required skills
- server systems
- GPU accelerated applications
- Deep Learning
- software and firmware stack
- server platforms
- application use cases
- software solutions
- roadmap
- technical decisions
- inter-component dependencies
Nice to have
- cloud deployment
- cluster level deployment
- management systems
- device management protocols
- Redfish
- IPMI
Role summary
NVIDIA is seeking a Senior Software Architect to design and develop the end-to-end software and firmware stack for their GPU-accelerated server systems, focusing on Deep Learning applications. The role involves leading software activities from design to production, driving system architecture in a multi-functional environment, and collaborating with internal teams, customers, and vendors. Key responsibilities include understanding customer requirements, developing technology roadmaps, and mentoring engineering teams. The ideal candidate possesses deep expertise in scalable server system architecture, particularly at the SW/HW interface, and has knowledge of HPC or Deep Learning workloads and management architectures. Experience with left-shift strategies and device management protocols is also valued.
We are building innovative server systems for GPU accelerated applications, such as Deep Learning. Data Center SW team architects and develops the end to end software and firmware stack for these systems. We are looking for a Senior Software Architect who has deep expertise in designing server platforms and has added understanding of application use cases in Deep Learning workloads. You will work with world class engineering teams, product management, Operations and Customer support to build systems that will truly delight our customers.
What you’ll be doing:
You will lead software activities for NVIDIA's deep learning server platforms, from design through production; collaborating with teams across company to deliver software solutions
Drive the system architecture for a complex server platform in a multi-functional environment.
Partner across application software, libraries, system software and firmware teams to design complete software solutions for new server platforms
Work directly with major customers to understand their requirements and work to align their roadmap with NVIDIA’s roadmap.
Work with business partners and vendors to shape their products to meet NVIDIA’s needs.
Develop a roadmap of new technologies and protocols and drive their design and adoption.
Mentor architects and engineering teams to grow them into future leaders.
Make key technical decisions for designs involving complex inter-component dependencies.
What we need to see:
Deep experience in designing architecture for scalable and performant server systems, particularly at the SW/HW interface.
Understanding of HPC or Deep learning workloads and use of accelerated computing platforms.
Expertise in Out of Band and In-band management architectures.
Knowledge of server system architecture and implications of architecture decisions on overall performance of end applications.
Demonstrable experience in implementing left shift strategy to de-risk program execution.
Excellent written and verbal communication skills.
BS or MS degree in Computer Engineering, Computer Science, or related degree or equivalent experience.
10+ years in the area of System architecture and design.
Ways to stand out from the crowd:
Knowledge of cloud and cluster level deployment and management systems.
Strong background of device management protocols such as Redfish, IPMI, MCTP, PLDM and RDE.
Knowledge in storage and networking technologies.
NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars. NVIDIA is looking for great people like you to help us accelerate the next wave of artificial intelligence.
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. Come, join our Data center server systems team and help build the real-time, cost-effective computing platform driving our success in this exciting and quickly growing field.
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD for Level 5, and 272,000 USD - 431,250 USD for Level 6.You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until October 17, 2026.This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Sample NVIDIA interview questions
- 1
Design a system for a rock paper scissors game
system designmedium - 2
Implement a distributed data migration management platform.
system designmedium - 3
Design a Distributed Build System with Cross-Data Center Artifact Sharing
system designhard - 4
Design a distributed training system for a trillion-parameter language model
system designmedium - 5
Develop a distributed tracing system for tracking and debugging.
system designmedium
Get started to unlock a personalized interview prep pack for this role.
Similar roles
- Software Engineering Intern, Frontend (Summer 2027)Notion · New York, NY · Hybrid
Software System EngineerThe Exploration Company · Houston, TX · Hybrid
Sr. Software Integration Engineer, Autonomy42dot · Sunnyvale, CA · Onsite
Lead, Mobile App Software EngineerWhitepages · Seattle, WA · Hybrid- Sr. Software Systems Validation EngineersRivian and Volkswagen Group Technologies · Palo Alto, CA · Onsite
Customer Success Manager, Industrial SoftwareHoneywell International Inc. · Houston, TX · Hybrid
