Senior Technical Product Manager, ML Platform

CanadaOnsiteFull TimeSeniorPosted 23 days ago

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Required skills

ML Platform
roadmap
priorities
reliability
cost efficiency
scalability
technical debt
model building
model serving
experimentation

Nice to have

internal ML platform
internal data platform
internal developer platform
MLflow
SageMaker
Kubernetes-based serving

Role summary

Coveo is seeking a Senior Technical Product Manager to define and evolve their ML Platform roadmap. This role involves understanding the needs of internal ML and AI teams, balancing current requirements with long-term platform health, reliability, and scalability. You will partner with technical leads, translate complex needs into actionable plans, and lead product discovery for new capabilities. The ideal candidate has 5+ years of technical product management experience, a hands-on understanding of production ML systems, and strong communication skills. Familiarity with MLOps/LLMOps tooling and platform adoption is a plus.

Shape the platform behind every model

What if your product decisions could shape how every machine learning model at Coveo is built, deployed and operated? As a Technical Product Manager in our ML Platform unit, you'll help shape the platform our applied scientists and ML engineers rely on to train, evaluate, deploy, serve and monitor the models and AI capabilities behind Coveo's products.

Working alongside the unit's director, dev managers, technical leads, applied scientists and product managers, you'll turn complex needs into clear priorities and actionable plans, balancing what our internal users need today with reliability, cost, scalability and the long-term health of the platform.

As one of our Technical Product Managers, you will:

Help define and evolve the ML Platform product roadmap, balancing the needs of our ML and AI teams with reliability, cost efficiency, scalability and technical debt.

Partner closely with technical leads across model building, model serving, experimentation and the LLM platform, validating direction with them before committing teams to it.

Understand how applied scientists and ML engineers work, and reconcile their needs into feature briefs, written proposals and clear priorities.

Stay current on MLOps, LLMOps and AI infrastructure trends, and bring build versus buy options to the table with evidence.

Lead product discovery for new capabilities, helping teams validate technical approaches and user value before work starts.

Coordinate across teams and partners such as Security, Legal and Data Platform to manage dependencies, track progress and ensure successful delivery.

Here is what will qualify you for the role:

5+ years of experience in technical product management or a closely related role, including owning a roadmap and setting priorities, not only managing delivery.

Hands-on understanding of machine learning systems in production (training pipelines, deployment and serving, monitoring), gained through a software engineering, ML engineering or data science background.

Strong communication and stakeholder management skills, with the ability to write clear proposals and build alignment across technical and non-technical audiences.

A proactive problem-solving mindset, with the habit of validating ideas early with technical experts and users before committing to them.

What will make you stand out:

Experience as a product manager of an internal ML, data or developer platform whose customers are engineers or data scientists.

Familiarity with MLOps and LLMOps tooling such as MLflow, SageMaker, Kubernetes-based serving, model monitoring, LLM gateways and evaluation.

Experience driving platform adoption, including deprecating legacy tools and migrating teams to new ones.

A track record of improving product practices in teams that worked without a product manager, and of building trust with experienced engineers.

Do you think you can bring this role to life? Send us your application, we want to hear from you!

Join the Coveolife!

We encourage all qualified candidates to apply regardless of, for example, age, gender, disability, gaps in CV, national or ethnic background.

This job description was written by humans, assisted by AI. We may leverage technology in our hiring process to help us see the person behind the resume.

Coveo is committed to providing accessible employment practices. If you require accommodation due to a disability at any point during the recruitment process, please contact HR@Coveo.com to discuss your needs.

Ready to apply?

You'll be redirected to Coveo's application page.