AI/ML Software Engineer
We are looking for an
AI/ML Software Engineer
to support the client in designing, building, and deploying production-grade AI-enabled systems that automate workflows, enhance internal operations, and improve user-facing services within the client. This role is highly focused on
applied AI engineering
, including LLM integration, RAG systems, agent-based architectures, and intelligent document workflows. The engineer will operate across the full lifecycle—system design, development, evaluation, deployment, and optimization—within constrained enterprise environments, balancing accuracy, latency, and cost. The ideal candidate combines strong backend engineering fundamentals with hands-on experience in modern AI/ML systems, including embeddings, vector search, multi-agent workflows, and production LLM pipelines.
Requirements
- Bachelor’s degree in Engineering, Computer Science, Data Science, Mathematics, or a related field.
- 3+ years of experience in data science, machine learning, or applied AI development.
- 3+ years of experience in software engineering, backend development, or system architecture.
- Strong Python development experience building production-grade backend services, APIs, and data pipelines.
- Experience with SQL and relational databases (e.g., PostgreSQL).
- Experience designing and implementing AI/ML systems using LLMs and non-LLM approaches.
- Experience with Retrieval-Augmented Generation (RAG), including embeddings, vector search, re-ranking, and hybrid retrieval techniques.
- Experience working with LLMs via APIs and/or local deployment (open-source or fine-tuned models).
- Experience fine-tuning small language models or embedding models.
- Experience building or supporting multi-agent or task-oriented AI systems.
- Experience validating AI outputs, reducing hallucinations, and integrating AI into production pipelines.
- Experience designing and implementing testing and evaluation pipelines for AI systems, including synthetic data usage.
- Experience with version control (Git), containerization (Docker), and service-oriented architecture.
- Experience deploying AI/ML solutions in hybrid cloud or distributed environments.
- Understanding of graph databases or graph-based retrieval (e.g., Neo4j, Apache AGE) is preferred.
- Experience with asynchronous processing, threading, and queue-based architectures in backend systems.
- Familiarity with React and/or Microsoft Teams Toolkit for chatbot UI development is preferred.
- Knowledge of classical NLP techniques alongside modern LLM-based approaches.
- Experience working with structured, semi-structured, and unstructured data processing.
- Exposure to performance-oriented languages (e.g., Rust) is a plus.
- Strong ability to work within constrained environments (limited GPU, predefined infrastructure).
- Strong documentation, collaboration, and system design skills.
If interested, please apply with resume.
Similar roles
- Sr AI/ML Software EngineerCisco · Milpitas, California, United States · Hybrid
AI/ML Software EngineerBooz Allen Hamilton · Washington, District of Columbia, United States · Remote- AI/ML Software EngineerASRC Federal · Colorado, United States · Onsite
- AI/ML Software EngineerJobs via Dice · Texas, United States · Hybrid
- AI/ML Software EngineerToyon Research Corporation · California, United States · Onsite