AI Engineer
Role summary
We are seeking an AI Engineer to develop and deploy advanced AI solutions. This role involves core programming in Python, API development with FastAPI, and debugging distributed systems. You will work extensively with Large Language Models (LLMs), focusing on prompt engineering, RAG implementation (including document processing, embeddings, and vector databases like pgvector), and agentic frameworks for multi-agent coordination. Key responsibilities include evaluating LLM performance using various metrics, implementing observability for prompts and models, and deploying solutions using Docker and CI/CD pipelines. This hybrid role requires 3 days onsite per week in Lake Mary, FL.
Job Title:
AI Engineer
Location:
Lake Mary, FL (3 Days onsite/week)
Job Description
Skillsets Required:
Core Programming:
- Python (Intermediate/Advanced) – async programming
- API Development – FastAPI
- Writing production-grade, scalable code
- Testing (unit, integration)
- Debugging complex distributed systems
LLM Fundamentals:
- Prompt Engineering
- Tokenization, context windows
- Model selection
- Handling hallucinations and grounding responses
Retrieval-Augmented Generation (RAG):
- Document ingestion and preprocessing
- Chunking strategies (semantic, recursive, sliding window)
- Embeddings
- Vector database – pgvector
- Hybrid search (keyword (BM25) + semantic)
- Re-ranking and relevance tuning
Agentic Frameworks and Orchestration:
- Multi-agent coordination
- Memory management
- Workflow orchestration
Evaluation and Observability:
- LLM evaluation metrics (accuracy, faithfulness, relevance)
- Prompt/version tracking
- Logging and tracking
- Human-in-the-loop (HITL) feedback loops
Deployment and MLOps:
- Containerization (Docker)
- CI/CD pipelines
- Monitoring
Similar roles
Senior AI EngineerData Capital Incorporation · United States · Remote
Senior AI EngineerRealPage, Inc. · Richardson, Texas, United States · Onsite
AI EngineerFetchJobs.co · Richmond, Virginia, United States · Remote
Distinguished AI EngineerCapital One · Mclean, Virginia, United States · Onsite- AI EngineerHaystack · United States · Hybrid