Director of AI

What We Do:

Florence software advances cures by helping the world’s most important research sites do their best work. Our solutions are now used by over 65,000 research teams in 90 countries around the world—we’re the most widely deployed site workflow tool in the industry. By the end of the decade, we’ll double the pace at which new medicines get to market by doubling the output of trial site teams. To date, we were named a Deloitte Fast 50 business, G2 Category Leader, an Inc. & AJC best place to work, and an Inc. 5000 company five years in a row.

At Florence, we are committed to make the world a better place by accelerating research while providing an environment for our employees where they can be happy in their lives, enjoy their jobs, and grow.

What You’ll Bring to the Team:

The Director of AI leads the design, development, and delivery of AI-powered capabilities across Florence products. This is a hands-on technical leadership role responsible for guiding architecture, mentoring engineers, evaluating emerging AI technologies, and partnering closely with engineering teams to deliver scalable, production-ready AI solutions. While this role includes people leadership, success is measured by the ability to help teams solve complex technical challenges and accelerate the delivery of AI capabilities.

You Will:

Technical Leadership & Architecture

Lead the technical design and architecture of AI-powered products and platforms.

Evaluate and recommend LLMs, AI frameworks, orchestration platforms, and emerging AI technologies.

Remain hands-on by building prototypes, validating technical approaches, and helping teams solve complex AI engineering challenges.

Review architecture, code, and technical designs to ensure scalable, secure, and maintainable solutions.

Guide engineers on best practices for Generative AI, Agentic AI, Retrieval-Augmented Generation (RAG), prompt engineering, and model integration.

Mentor AI engineers through technical coaching, design reviews, and pair problem-solving.

AI Engineering Delivery

Lead the development and operationalization of machine learning pipelines, including data preparation, feature engineering, model training, validation, deployment, monitoring, and continuous improvement.

Drive the best practices and adoption of MLOps practices to enable repeatable, scalable, and reliable machine learning model development and deployment across the organization.

Work alongside engineering teams to unblock technical challenges and accelerate delivery.

Partner with Product Management to define and implement AI capabilities that solve customer problems.

Ensure AI solutions are reliable, observable, performant, cost-efficient and production-ready.

Balance rapid experimentation with engineering quality and operational excellence.

AI Platform & Engineering Excellence

Design and Enhance Florence's AI platform, including machine learning pipelines , LLM/model orchestration, vector search, Agentic AI frameworks, Model Context Protocol (MCP), AI gateways, Knowledge retrieval systems, evaluation pipelines, feature stores, model serving infrastructur and observability.

Establish AI Development Lifecycle (AI DLC) practices, including prompt engineering, evaluation, testing, deployment, monitoring, and governance.

Establish engineering standards and reusable patterns that enable teams to deliver AI solutions consistently.

Continuously evaluate new AI tools and frameworks to improve developer productivity and product capabilities.

Leadership & Team Development

Lead, mentor, and grow a team of AI Engineers and Machine Learning Engineers.

Build engineering capabilities across Generative AI, classical Machine Learning, MLOps, and AI platform engineering

Provide day-to-day technical guidance and engineering leadership.

Foster collaboration, experimentation, and continuous learning across the team.

Help engineers develop expertise in modern AI technologies and engineering practices.

Cross-Functional Collaboration

Partner with Product Management on AI roadmaps and prioritization.

Work closely with Platform/ Product Engineering, Security, DevOps, QA, and Data Engineering teams.

Partner closely with Data Engineering and Data Science teams to establish scalable data pipelines, feature engineering practices, and production machine learning workflows.

Collaborate with Clinical, Customer Success, and Product teams to deliver impactful AI solutions.

Contribute to engineering planning and technical roadmaps.

Work closely with Engineering leaders to prioritize AI initiatives and remove delivery risks.

AI Governance & Security

Ensure AI systems are secure, reliable, and compliant.

Implement guardrails, evaluation frameworks, and responsible AI engineering practices.

Partner with Security and Compliance teams on regulated AI deployments.

Establish engineering standards for safe AI adoption.

An Ideal Candidate Has:

8+ years of software engineering experience, including significant experience designing, building, deploying, and operating production AI and machine learning systems.

4+ years leading engineering teams in a technical leadership capacity.

Strong expertise in Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Agentic AI, prompt engineering, and modern AI application architectures.

Experience building and scaling production AI systems, machine learning pipelines, and MLOps platforms in cloud-native environments. .

Demonstrated ability to evaluate new AI technologies and translate them into practical engineering solutions.

Strong understanding of production machine learning engineering practices, including model performance monitoring, drift detection, experiment tracking, model versioning, and continuous delivery of ML models.

Proven experience leading architecture discussions, mentoring technical teams, and influencing engineering direction.

Excellent communication skills with the ability to engage effectively with executives, product leaders, and engineering teams.

We’ll Be Extra Excited If You Have:

Experience with: Amazon Bedrock, AWS SageMaker, AWS AgentCore, Claude,TensorFlow or PyTorch, Feature Stores, ML Pipeline orchestration tools, OpenAI, Gemini, LangGraph, LangChain, MCP (Model Context Protocol), Kafka, Snowflake, Kubernetes, Docker, Python, MLflow, Vector databases (Pinecone, pgvector, OpenSearch), Healthcare or regulated SaaS environments

Hands-on Technical Expectations:

Stay current with advances in Generative AI and AI engineering.

Build proof-of-concepts to evaluate new technologies when appropriate.

Participate in architecture reviews and technical design sessions.

Guide engineers through complex implementation challenges.

Contribute to prototypes or reference implementations for strategic initiatives.

What’s in it for you?

Do well. We offer a competitive compensation package, medical and dental insurance, and office space in the heart of the city.

Do good. We insist that health technology is the highest calling for software development. We pride ourselves on working on something bigger than ourselves; helping advance cures and therapies.

Make the leap. Join our high-output culture to create innovative, modern, and purposeful software solutions.

Florence supports workplace diversity and does not discriminate on the basis of race, color, religion, gender identity or expression, national origin, age, military service eligibility, veteran status, sexual orientation, marital status, physical disability, or any other protected class.

Please be cautious of potential recruitment fraud. If you are interested in exploring opportunities at Florence Healthcare, please go directly to our Careers Page. Florence Healthcare will never ask you to pay a fee or download software as part of the interview process with our company. In addition, Florence Healthcare will not ask for your personal banking information until you have signed an offer of employment and completed onboarding paperwork that is provided by our People Operations team. All communications with Florence Healthcare employees will only be sent from @florencehc.com email addresses.