Senior Software Engineer, Product AI - AI Powered Platform
Role summary
This Senior Software Engineer role focuses on building AI-powered product features by integrating Large Language Models (LLMs) and Machine Learning (ML) services into user workflows. Responsibilities include designing APIs, developing evaluation frameworks and metrics for quality and safety, optimizing performance (cost/latency), and instrumenting features for A/B testing. The ideal candidate will have 5+ years of software experience, with at least 2 years in applied ML/LLMs, proficiency in Python and a backend stack (Go/Node/Java), and experience with vector stores and MLOps in the cloud. Strong product instincts and data-driven decision-making are also essential.
Senior Software Engineer — Product AI
About The Role
Ship AI-powered product features. You’ll integrate LLMs and ML services into user workflows, build evaluation frameworks, and ensure safety, reliability, and measurable outcomes.
What You’ll Do
- Design APIs and services that incorporate LLM/NLP and retrieval (RAG, embeddings).
- Build evaluation harnesses, guardrails, and offline/online metrics for quality.
- Optimize cost/latency via prompt design, tuning, distillation, and caching.
- Instrument features for A/B testing and impact analysis.
- Collaborate with research, data, and product to iterate rapidly.
What We’re Looking For
- 5+ years in software; 2+ years in applied ML/LLMs preferred.
- Proficiency in Python and one backend stack (Go/Node/Java).
- Experience with vector stores and ML ops in cloud.
- Strong product instincts and data-driven decision making.
About Andiamo
Talent Partners for the AI Revolution. As a globally recognized staffing and consulting firm, we specialize in placing the top 2% of technology and go-to-market professionals with the world’s largest and most well-known companies.
For over 20 years, we've maintained the status of tier-one vendor for firms such as Palantir, Amazon, Fluidstack, Bloomberg, Relativity Space, Firefly, MasterCard, Visa, Two Sigma, Citadel, as well as other major financial services firms, elite hedge funds, Google-backed tech start-ups, and major software firms.
Our talent solutions include Permanent Placement, Contract Staffing, Executive Search, and Dedicated Recruiting Services (RPO). Find out more at www.andiamogo.com