AI/ML Software Engineer

Public Sector Experience required in recent times. Candidates within DMV area or nearby area will be preferred,

I’m working with the
Administrative Office of the Courts (AOC)
on an opportunity and wanted to connect regarding an
AI/ML Software Engineer (LLMs / RAG / AI Systems)
role.

Please review the details below and let me know if you’re interested. If so, share your resume, rate expectations, and availability.

Additional Details:

JLocation
: Remote (with occasional onsite in Annapolis, MD)

Address
: 189 Harry S Truman Parkway, Annapolis, MD 21401

Duration
: 5 years

Submission Requirements:
Resume, LOC, 3 References

Interview Process
: Panel interview (Teams/Zoom, camera required)

Work Model:

- Primarily remote
- Must be onsite for
first 2 days
- Must be able to report onsite within
72 hours if required

About the Role:

This role focuses on building
AI/ML-powered software systems
to automate tasks, enhance internal workflows, and improve user-facing services. Work includes LLM-based applications, RAG systems, chatbots, and intelligent automation solutions.

Scope of the Project:

The focus is on designing and deploying
AI-driven systems
including document processing, knowledge retrieval, automation tools, and intelligent assistants, while working within constrained infrastructure and ensuring production-grade reliability.

Daily Duties / Responsibilities:

- Design and develop AI/ML systems (LLMs, RAG, automation tools)
- Build and integrate
chatbots, agents, and AI-powered workflows
- Develop backend services, APIs, and data pipelines (Python-based)
- Collaborate on system architecture, workflows, and model selection
- Implement testing, evaluation, and performance optimization pipelines
- Deploy and manage solutions in
hybrid cloud / containerized environments
- Optimize systems for
accuracy, latency, and cost efficiency
- Document system design and continuously improve solutions

Required Skills (Ranked):

- 3+ years experience in
AI/ML, data science, or applied AI development
- 3+ years experience in
software engineering / backend development
- Strong proficiency in
Python (APIs, data pipelines, backend systems)
- Experience with
LLMs, embeddings, and retrieval systems (RAG)
- Experience with
SQL / relational databases (PostgreSQL preferred)
- Experience with
Docker, Git, and service-oriented architectures

Preferred Skills:

- Experience with
multi-agent AI systems and workflow orchestration
- Experience with
vector databases, graph databases (Neo4j), retrieval systems
- Experience fine-tuning
language models or embedding models
- Experience integrating AI into
production pipelines and mitigating hallucinations
- Familiarity with
React or Teams Toolkit (chatbot UI development)

Environment and Tools:

• Python, APIs, Data Pipelines
• LLM frameworks, RAG systems
• PostgreSQL, SQL
• Docker, Git
• Hybrid cloud environments

Additional Skills:

- Strong problem-solving and system design ability
- Ability to work with
ambiguous datasets and evolving requirements
- Strong collaboration across technical teams
- Ability to balance performance, cost, and scalability

This is not a basic ML role you’re expected to
build production-grade AI systems, not just models or notebooks
. If your experience is limited to experimentation or academic work, you’ll struggle here.