AI Engineer, Sr.

About The Company
Capital One is a leading financial services company dedicated to transforming banking through innovative technology and responsible practices. Renowned for its pioneering use of machine learning and AI, Capital One has established itself as an industry leader in delivering personalized, real-time customer experiences. The company invests heavily in cutting-edge technology infrastructure and attracts top-tier talent to stay at the forefront of AI advancements. Capital One's commitment to leveraging AI responsibly ensures that its solutions are secure, reliable, and ethically sound, ultimately enhancing customer trust and satisfaction. The organization fosters a culture of innovation, collaboration, and continuous learning, making it an ideal environment for professionals passionate about shaping the future of banking through technology.
About The Role
The Senior Distinguished Engineer, AI Compute role offers a unique opportunity to lead the development and scaling of foundational AI compute capabilities within Capital One's cloud-based enterprise AI and machine learning platform. This position is ideal for a seasoned technical leader with extensive experience in distributed systems, large-scale infrastructure, and high-performance computing. The successful candidate will architect and implement control and data plane solutions to support multi-tenant, secure, and highly available AI workloads across CPU and GPU substrates. You will collaborate with cross-functional teams to optimize AI model training, inference, and data processing pipelines, including large language models and generative AI applications. This role emphasizes innovation, operational excellence, and mentorship, providing a platform to influence the company's AI strategy and contribute to groundbreaking advancements in financial technology.
Qualifications

• Bachelor's Degree in Computer Science, Software Engineering, or related field
• Minimum of 7 years of experience in application architecture and design patterns
• At least 5 years of experience with distributed databases, microservice architectures, and high availability systems
• Proficiency in programming languages such as Golang and Python
• Experience with distributed compute frameworks like Spark, Dask, Ray, or Flink
• Knowledge of containerization (Kubernetes) and serverless environments (AWS Lambda)
• Strong understanding of AI/ML workload patterns and infrastructure requirements

Responsibilities

• Design and develop control and data plane implementations to enable a highly available, secure, multi-tenant AI platform
• Build and optimize distributed compute engines using Ray and Spark to accelerate diverse workloads, including large language model pre-training and reinforcement learning
• Implement systemic improvements to enhance operational efficiency and automate routine workflows
• Lead technical execution across multiple projects, collaborating with teams focused on microservices, foundation models, and AI infrastructure
• Work closely with product management and stakeholders to align technical solutions with business goals
• Stay current with emerging technology trends, participate in community discussions, and lead system design and code reviews
• Mentor internal talent and contribute to the development of next-generation AI engineering capabilities
• Recruit and onboard external talent to strengthen the technical team

Benefits

• Competitive salary aligned with experience and location
• Performance-based incentive compensation, including cash bonuses and long-term incentives
• Comprehensive health, dental, and vision insurance coverage
• Retirement savings plans with company contributions
• Generous paid time off and holiday leave
• Professional development opportunities and continuous learning support
• Inclusive and collaborative work environment that values diversity and innovation

Equal Opportunity
Capital One is an equal opportunity employer committed to creating a diverse and inclusive workplace. We do not discriminate based on race, color, religion, sex, national origin, age, disability, veteran status, or any other protected characteristic. We promote a drug-free workplace and adhere to all applicable laws and regulations. We consider qualified applicants with criminal histories in a manner consistent with legal requirements. We encourage candidates from all backgrounds to apply and join our team in shaping the future of banking through technology.