Fullscript logo
Fullscript Verified
Healthtech, E-commerce, Software, Biotechnology

Staff Machine Learning Engineer

Toronto, Ontario, CanadaRemoteFull TimeStaffPosted 2 months ago

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Role summary

Fullscript is seeking a Staff Machine Learning Engineer to join their AI team. This senior individual contributor role focuses on building and implementing production-grade LLM-powered agents and conversational experiences for clinical applications. The engineer will shape technical direction, guide architecture, and lead the design and deployment of AI systems that answer complex questions and support follow-up interactions. Key responsibilities include owning backend services in Python, defining prompting and orchestration strategies, establishing evaluation frameworks for LLM outputs, and shaping model-related engineering patterns. The role requires strong proficiency in Python, SQL, and LLM application frameworks like LangChain, with a focus on quality, safety, maintainability, and scalability in healthcare-adjacent AI.

### Who you are
- 6+ years of experience building and implementing machine learning applications in production, including meaningful experience with LLM-powered agents, conversational experiences, or agent-based workflows
- A track record of owning complex technical problems end to end and shaping implementation beyond your immediate code contributions
- Experience designing and deploying AI systems that answer open-ended questions, support follow-up interactions, and operate reliably in production
- Strong experience with LLM application frameworks and tooling, such as LangChain, LangGraph, or similar orchestration and RAG frameworks
- Familiarity with evaluation and monitoring frameworks for LLM outputs, conversational quality, and system reliability
- Knowledge of MCP, agent orchestration patterns, or related approaches for building multi-step AI systems
- Strong proficiency in Python and SQL
- Experience making sound technical decisions around quality, safety, maintainability, and scalability in production AI systems
- Strong communication and collaboration skills, with the ability to work effectively across technical and non-technical stakeholders
- Experience defining technical direction for AI or machine learning systems across multiple projects or teams
- Experience building clinician-facing, healthcare-adjacent, or other high-trust AI experiences
- Experience with recommendation systems, personalization, or other applied ML systems beyond LLMs
- Experience with modern retrieval, grounding, or evaluation patterns for LLM applications
- Experience working closely with domain experts to build systems in complex or highly contextual problem spaces

### What the job involves
- We’re hiring a Staff Machine Learning Engineer to join our AI team and help shape the next generation of Fullscript’s AI-powered experiences
- You’ll work on building innovative AI capabilities that help clinicians provide better services and help patients improve their health
- This is a senior individual contributor role for someone who can go beyond implementation
- In addition to building high-quality systems, you’ll help define technical direction, guide architecture decisions, and identify where AI can create meaningful value in clinical workflows
- You’ll work with a high degree of autonomy and partner closely with engineering, product, analytics, and medical stakeholders to deliver scalable, reliable, and clinically useful AI experiences
- Lead the design, development, and deployment of production, multi-turn LLM-powered features, including summarization tools and clinician-facing conversational agents that support follow-up questions and reasoning over clinical context
- Own backend services in Python that integrate LLM agents with Fullscript’s platform and support reliable production use
- Help define technical direction for prompting, grounding, safety, and orchestration strategies used across clinical AI workflows
- Establish and improve evaluation approaches for LLM outputs, including accuracy, hallucinations, edge cases, and overall feature quality
- Shape engineering patterns for model-related workflows, including testing, CI/CD, observability, and version control
- Partner with medical, product, and engineering teams to identify high-value opportunities for AI and turn them into practical, scalable product capabilities
- Work cross-functionally with engineering, analytics, and medical SMEs to refine requirements and ensure data and system design support clinical use cases
- Provide technical leadership across projects by creating clarity in ambiguous problem spaces, guiding tradeoff decisions, and raising the quality bar for the team
- Stay current with the latest LLM research and emerging AI technologies, and help assess where they can be applied effectively at Fullscript

### Benefits
- Reach your wellness goals with our benefits plan, discount on practitioner-grade supplements, and company-wide health and wellness programs
- Our dedicated DEIB Council ensures we advocate for equality and encourage positive change within ourselves and the community. We value the unique qualities and perspectives of our team
- You choose your own office with our Wherever You Work Well approach. Whether that’s in-person or at home, teams aren’t defined by geography. Output, not location, is our success metric so we also offer a flexible approach to your working hours, vacation, and personal days
- We empower each other to grow with lunch and learns, lean in circles, show-and-tells, and more. Everyone has something to learn and something to teach so we pride ourselves on growing as a team
- We're not just a company — we're a community. Team lunches, weekly town halls, birthdays, parties, and clubs are an essential part of our community and culture
- The health of our people relies on the health of our planet. We are certified carbon-neutral, taking our first big step in creating a more sustainable future

Ready to apply?
You'll be redirected to Fullscript's application page.

Similar roles