NVIDIA logo
NVIDIA Verified
Semiconductors, Artificial Intelligence, Computer Hardware, Software Development

Senior Software Architect - Data Center Systems

Austin, TXOnsiteFull TimeDistinguished / Architect$224,000–$431,250 /yrPosted 25 days agoVisa sponsorship available

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Required skills

  • server systems
  • GPU accelerated applications
  • Deep Learning
  • software and firmware stack
  • server platforms
  • application use cases
  • software solutions
  • roadmap
  • technical decisions
  • inter-component dependencies

Nice to have

  • cloud deployment
  • cluster level deployment
  • management systems
  • device management protocols
  • Redfish
  • IPMI

Role summary

NVIDIA is seeking a Senior Software Architect to design and develop the end-to-end software and firmware stack for their GPU-accelerated server systems, focusing on Deep Learning applications. The role involves leading software activities from design to production, driving system architecture in a multi-functional environment, and collaborating with internal teams, customers, and vendors. Key responsibilities include understanding customer requirements, developing technology roadmaps, and mentoring engineering teams. The ideal candidate possesses deep expertise in scalable server system architecture, particularly at the SW/HW interface, and has knowledge of HPC or Deep Learning workloads and management architectures. Experience with left-shift strategies and device management protocols is also valued.

We are building innovative server systems for GPU accelerated applications, such as Deep Learning. Data Center SW team architects and develops the end to end software and firmware stack for these systems. We are looking for a Senior Software Architect who has deep expertise in designing server platforms and has added understanding of application use cases in Deep Learning workloads. You will work with world class engineering teams, product management, Operations and Customer support to build systems that will truly delight our customers.

What you’ll be doing:

  • You will lead software activities for NVIDIA's deep learning server platforms, from design through production; collaborating with teams across company to deliver software solutions

  • Drive the system architecture for a complex server platform in a multi-functional environment.

  • Partner across application software, libraries, system software and firmware teams to design complete software solutions for new server platforms

  • Work directly with major customers to understand their requirements and work to align their roadmap with NVIDIA’s roadmap.

  • Work with business partners and vendors to shape their products to meet NVIDIA’s needs.

  • Develop a roadmap of new technologies and protocols and drive their design and adoption.

  • Mentor architects and engineering teams to grow them into future leaders.

  • Make key technical decisions for designs involving complex inter-component dependencies.

What we need to see:

  • Deep experience in designing architecture for scalable and performant server systems, particularly at the SW/HW interface.

  • Understanding of HPC or Deep learning workloads and use of accelerated computing platforms.

  • Expertise in Out of Band and In-band management architectures.

  • Knowledge of server system architecture and implications of architecture decisions on overall performance of end applications.

  • Demonstrable experience in implementing left shift strategy to de-risk program execution.

  • Excellent written and verbal communication skills.

  • BS or MS degree in Computer Engineering, Computer Science, or related degree or equivalent experience.

  • 10+ years in the area of System architecture and design.

Ways to stand out from the crowd:

  • Knowledge of cloud and cluster level deployment and management systems.

  • Strong background of device management protocols such as Redfish, IPMI, MCTP, PLDM and RDE.

  • Knowledge in storage and networking technologies.

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars. NVIDIA is looking for great people like you to help us accelerate the next wave of artificial intelligence.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. Come, join our Data center server systems team and help build the real-time, cost-effective computing platform driving our success in this exciting and quickly growing field.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD for Level 5, and 272,000 USD - 431,250 USD for Level 6.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 17, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Sample NVIDIA interview questions

  • 1

    Design a system for a rock paper scissors game

    system designmedium
  • 2

    Implement a distributed data migration management platform.

    system designmedium
  • 3

    Design a Distributed Build System with Cross-Data Center Artifact Sharing

    system designhard
  • 4

    Design a distributed training system for a trillion-parameter language model

    system designmedium
  • 5

    Develop a distributed tracing system for tracking and debugging.

    system designmedium

Get started to unlock a personalized interview prep pack for this role.

Ready to apply?
You'll be redirected to NVIDIA's application page.

Similar roles

See how RiseMe works

Match, tailor, and prep so you send fewer applications and land more interviews.