
Senior Software Development Engineer, EC2 Trainium AI Infra
Required skills
- EC2 UltraServer
- AWS Trainium
- AI Infrastructure
- provisioning
- microservices
- system design
- reliability
- scaling
- capacity management
- hardware engineering
Nice to have
- coding standards
- code reviews
- source control management
- computer science degree
Role summary
The Senior Software Development Engineer on the EC2 UltraServer Provisioning team will lead technical strategy, design, and operation of infrastructure services for AWS Trainium-based AI servers. Responsibilities include architecting large-scale systems, building microservices, and collaborating with cross-functional teams to manage AI/ML infrastructure at scale. The role requires 5+ years of professional software development, system design, and programming experience, with a focus on reliability and scaling. Experience in mentorship and leading engineering teams is also required. Preferred qualifications include full software development lifecycle experience and a computer science degree.
Key job responsibilities
- Lead the design and development of infrastructure systems that support AI workloads on UltraServers, ensuring reliability and performance at scale.
- Own your team's architectural direction for provisioning systems, influencing technical decisions across dependent systems and driving alignment with partner teams.
- Collaborate with capacity management, hardware engineering, and datacenter teams to improve provisioning workflows and operate efficiently at scale.
- Mentor and coach engineers on the team, driving adoption of engineering best practices and raising the technical bar across the organization.
- Investigate complex performance challenges, develop solutions, and publish actionable best practices to internal and external stakeholders.
A day in the life
You might start your morning reviewing operational metrics for provisioning pipelines, then shift into a design review with hardware engineering partners on an upcoming server configuration. After lunch, you could be deep in code — prototyping a new microservice or refactoring a critical path in the provisioning workflow. Throughout the day, you balance hands-on technical work with mentoring teammates, unblocking cross-team dependencies, and contributing to architectural decisions that shape how AI infrastructure scales.
About the team
The EC2 UltraServer Provisioning team is responsible for delivering AWS Trainium-based UltraServer infrastructure at scale. We manage end-to-end provisioning workflows from host ingestion through testing, repair, and recovery. Our mission is to ensure that AI/ML customers have reliable, high-performance compute infrastructure ready when they need it. We are a collaborative engineering team that values technical depth, operational excellence, and building systems that grow with customer demand. Basic Qualifications: - 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience as a mentor, tech lead or leading an engineering team Preferred Qualifications: - 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, Seattle - 168,100.00 - 227,400.00 USD annually
Sample Amazon interview questions
- 1
Implement Search a 2D Matrix
codingtechnicalmedium - 2
Implement LRU Cache
codingtechnicalmedium - 3
Implement Best Time to Buy and Sell Stock
codingtechnicaleasy - 4
Implement Flood Fill
codingtechnicaleasy - 5
Implement Top K Frequent Elements
codingtechnicalmedium
Get started to unlock a personalized interview prep pack for this role.
Similar roles
Software Development Engineer, Global From Day1Amazon · Bellevue, WA · Onsite
Software Development EngineerAmazon · Boston, MA · Onsite- Senior Software Development Engineer in TestVaricent · Remote · Remote
Software Development EngineerCVS Health · Scottsdale, AZ · Hybrid- Co-op Software Development Engineer in Test (SDET) - Winter 2027Global Relay · Halifax, NS · Onsite
Senior Software Development Engineer in Test, MLPlayStation Global · Ontario · Hybrid
