GovCon Associates LLC logo
GovCon Associates LLC Verified
Government Contracting Consulting, Business Services, Management Consulting

AI Engineer

Lake Mary, Florida, United StatesHybridContractPosted 2 months ago

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Role summary

We are seeking an AI Engineer to develop and deploy advanced AI solutions. This role involves core programming in Python, API development with FastAPI, and debugging distributed systems. You will work extensively with Large Language Models (LLMs), focusing on prompt engineering, RAG implementation (including document processing, embeddings, and vector databases like pgvector), and agentic frameworks for multi-agent coordination. Key responsibilities include evaluating LLM performance using various metrics, implementing observability for prompts and models, and deploying solutions using Docker and CI/CD pipelines. This hybrid role requires 3 days onsite per week in Lake Mary, FL.

Job Title:
AI Engineer

Location:
Lake Mary, FL (3 Days onsite/week)

Job Description

Skillsets Required:

Core Programming:

  • Python (Intermediate/Advanced) – async programming
  • API Development – FastAPI
  • Writing production-grade, scalable code
  • Testing (unit, integration)
  • Debugging complex distributed systems

LLM Fundamentals:

  • Prompt Engineering
  • Tokenization, context windows
  • Model selection
  • Handling hallucinations and grounding responses

Retrieval-Augmented Generation (RAG):

  • Document ingestion and preprocessing
  • Chunking strategies (semantic, recursive, sliding window)
  • Embeddings
  • Vector database – pgvector
  • Hybrid search (keyword (BM25) + semantic)
  • Re-ranking and relevance tuning

Agentic Frameworks and Orchestration:

  • Multi-agent coordination
  • Memory management
  • Workflow orchestration

Evaluation and Observability:

  • LLM evaluation metrics (accuracy, faithfulness, relevance)
  • Prompt/version tracking
  • Logging and tracking
  • Human-in-the-loop (HITL) feedback loops

Deployment and MLOps:

  • Containerization (Docker)
  • CI/CD pipelines
  • Monitoring
Ready to apply?
You'll be redirected to GovCon Associates LLC's application page.

Similar roles