Senior AI Operations Engineer
Role summary
The Senior AI Ops Engineer will lead the advancement of AI capabilities, focusing on engineering excellence and leveraging generative AI to enhance end-to-end operations. This role involves architecting, optimizing, and scaling AI workloads within Oracle Cloud Infrastructure (OCI). Key responsibilities include enhancing AI operations, leading R&D efforts, stakeholder collaboration, program-level initiatives, and ensuring ethical AI/ML practices. The position requires 7+ years in Data Science, 3+ years in R&D, and 2+ years of mentoring/managing junior engineers, with deep expertise in Kubernetes, CI/CD, LLMOps, and cloud-native architecture. Fluency in Python and Bash is essential, along with familiarity with open-weight LLMs and handling large datasets.
Role Overview
As the Senior AI Ops Engineer, you will lead the advancement of our AI capabilities, focusing on engineering excellence and leveraging generative AI to enhance our end-to-end operations from experimentation to deployment. With our infrastructure transitioning to Oracle Cloud Infrastructure (OCI), you will play a pivotal role in architecting, optimizing, and scaling AI workloads within OCI’s ecosystem.
What You Will Do
Enhance AI Operations, Lead R&D Efforts, Stakeholder Collaboration, Program-Level Initiatives, Ethical AI/ML Practices, Team Management, Compliance
Why It Might Be a Fit
Must have 7+ years in Data Science, 3+ years in R&D, 2+ years mentoring/managing junior engineers. Deep expertise in Kubernetes, CI/CD, LLMOps, and cloud-native architecture. Passion for building AI that’s not just powerful, but secure and compliant.
Requirements
- 7+ years in Data Science
- 3+ years in R&D
- 2+ years mentoring/managing junior engineers
- Deep expertise in Kubernetes, CI/CD, LLMOps, and cloud-native architecture
- Fluency in Python, Bash, and container-native toolchains
- Familiarity with open-weight LLMs (Mistral, Grok, LLaVA, etc.)
- Experience in dealing with Peta Bytes of data
- Strong problem-solving, critical thinking, creativity, organizational, and communication skills
Benefits
- Medical, dental and vision coverage with low deductible & copay
- Life insurance
- Short and long-term disability
- Paid Parental Leave
- 401(k) + match
- Employee Stock Purchase Plan
- Generous Paid Time Off – accrued based on years of service
- 10 paid company holidays
- Tuition reimbursement
- Flexible Spending Account
- Employee Assistance Program
- Sick time benefits – for eligible employees, one hour of sick time for every 30 hours worked, up to a maximum accrual of 40 hours per calendar year
Originally posted on Himalayas
