Software Engineer
Compensation estimateAI
See base, equity, bonus, and total comp estimates for this role — free, no credit card.
Sign up to see compensation estimate### Who you are
- Master’s degree in Artificial Intelligence, Computer Science, or a related technical field
- Strong programming skills in Python, with experience in ML and data tooling (e.g., PyTorch, Pandas, NumPy, Scikit-learn)
- Preferred: 2+ years of professional software engineering experience, including scripting, data processing, or backend/ML pipelines
- Experience with NLP techniques, LLMs, or machine learning fundamentals
- Strong problem-solving ability and comfort working independently in a fast-moving environment
- Preferred: Experience deploying applications or models on cloud platforms, preferably AWS
- Bonus (not required): experience with real-time systems, WebSockets/streaming, RAG pipelines, vector databases, or ML evaluation frameworks, Genesys/Twilio
### What the job involves
- We are seeking a skilled and motivated Software Engineer focused on Large Language Model (LLM) applications to join our Machine Learning team
- In this role, you will help design, build, and optimize next-generation conversational agent technologies. You will collaborate closely with ML researchers and product teams to ship high-impact features and own key components of our conversational AI stack. This position reports to the ML Research Scientist
- Software engineering for LLM-powered conversational agents, with an emphasis on practical implementation, reliability, and user experience
- Evaluate, fine-tune, and deploy LLM-based models and pipelines using REST APIs and internal microservices
- Implement prompt engineering, retrieval-augmented generation (RAG), tool-use pipelines, and conversation orchestration logic
- Investigate and integrate emerging technologies, particularly in real-time voice, streaming, and multi-modal interaction
- Analyze model outputs, user interactions, and system performance to drive iterative improvements
- Build and maintain high-quality datasets, including data cleaning, preprocessing, labeling workflows, and benchmarking for NLP tasks
- Own data quality, ensuring accuracy, reproducibility, and reliability across the data lifecycle
- Collaborate with ML, backend, and product teams on deployment best practices, monitoring, and scalability of LLM-based services
- Contribute to internal documentation, experimentation processes, and model evaluation frameworks
### Benefits
- Dental and Health Insurance
- Company Outings
- 401(k)
- Fitness Center
- Unlimited PTO
- Stocked Kitchen
- Company Issued Hardware
- Cool Swag
Similar roles
Software EngineerConcord Servicing, LLC · Dallas, Texas, United States · Remote- Senior Software EngineerNorthside Hospital · Atlanta, Georgia, United States · Onsite
- Senior Software EngineerRandstad Digital Americas · North York, Ontario, Canada · Hybrid
- Lead Software EngineerElanco · Lake County, Indiana, United States · Onsite
- Software EngineerAMERICAN SYSTEMS · Fredericksburg, Virginia, United States · Onsite