AI DevOps/Platform Engineer
Role summary
GSPANN is seeking a Remote AI DevOps/Platform Engineer to join their AI Enablement team. The role involves building, maintaining, and scaling enterprise AI infrastructure, including agent orchestration platforms (NOVA), AI gateway services (LiteLLM), and RAG pipelines across multi-cloud environments (GCP, Azure). Responsibilities include platform development, RAG pipeline optimization, infrastructure automation using Kubernetes, CI/CD, and IaC tools, and ensuring security and compliance. The ideal candidate will have 8+ years of platform engineering/DevOps experience, 2+ years in AI/ML platforms, strong Kubernetes, CI/CD, and cloud skills, and proficiency in Python or TypeScript.
About GSPANN:
Headquartered in California, U.S.A., GSPANN is a leading provider of consulting and IT services to global clients. We specialize in helping clients transform their IT capabilities, optimize business practices, and drive operational efficiency across industries such as retail, high-technology, and manufacturing. With five global delivery centers and over 2500 employees, we combine the personalized approach of a boutique consultancy with the extensive capabilities of a large IT services firm.
AI DevOps/Platform Engineer
Location: Remote-(Canada)
Duration: 12+ Months
Here is the JD -
The
AI DevOps/Platform Engineer
will join the AI Enablement team, focusing on building, maintaining, and scaling enterprise AI infrastructure. This includes proprietary agent orchestration platforms (NOVA), AI gateway services, and Retrieval-Augmented Generation (RAG) pipelines across multi-cloud environments.
Key Responsibilities:
• Platform Development & Operations:
o Develop, deploy, and maintain the NOVA agentic AI platform
o Manage LiteLLM as the central AI gateway
o Optimize LLM routing, cost control, load balancing, and failover
o Implement monitoring and observability (Prometheus, Grafana, OpenTelemetry)
RAG Pipeline Development:
o Design and optimize RAG pipelines
o Maintain document ingestion, chunking, embeddings, and vector stores
o Build RAG on GCP and Azure using managed AI services and vector databases
Infrastructure & DevOps:
o Deploy AI services on Kubernetes (AKS, GKE)
o Implement CI/CD with Jenkins, Opsera, GitHub Actions
o Automate infrastructure (Terraform, Helm, GitOps)
o Ensure security and compliance
• Agentic AI & Automation:
o Develop automation tools and scripts
o Build MCP servers for tool integrations
o Enable multi-agent orchestration and autonomous workflows
o Create SDKs, APIs, and developer documentation
Required Qualifications:
•
8+ years platform engineering/DevOps experience
• 2+ years AI/ML or LLM platform experience
• Strong Kubernetes, CI/CD, and cloud experience (GCP or Azure)
• Proficiency in Python and/or TypeScrip
t
Technical Environment:
• AI Platforms: LiteLLM, LangChain, LangGraph
• Cloud: GCP, Azure
• Containers: Kubernetes, Docker, Helm
• CI/CD: Jenkins, GitHub Actions, Opsera
• Observability: Prometheus, Grafana, OpenTelemetry, Dynatrace
• Languages: Python, TypeScript, Bash
Working at GSPANN
GSPANN is a diverse, prosperous, and rewarding place to work. We provide competitive benefits, educational assistance, and career growth opportunities to our employees. Every employee is valued for their talent and contribution. Working with us will give you an opportunity to work globally with some of the best brands in the industry.
The company does and will take affirmative action to employ and advance in the employment of individuals with disabilities and protected veterans and to treat qualified individuals without discrimination based on their physical or mental disability status. GSPANN is an equal opportunity employer for minorities/females/veterans/disabled.