LiteLLM Verified
AI/ML, Software Development, Developer Tools
Technical Support Engineer
San Francisco, California, United StatesOnsiteFull Time$80,000–$100,000 /yrPosted 2 months agoHidden Gem · YC Startup
Role summary
LiteLLM, a rapidly growing open-source LLM Gateway with 28K+ GitHub stars and $2.5M ARR, is seeking a Technical Support Engineer. This role involves troubleshooting customer issues, optimizing their setups, and providing excellent customer experiences. The ideal candidate enjoys solving complex technical problems, communicating effectively with diverse users, and improving internal processes and documentation. Responsibilities include diagnosing issues across the LiteLLM platform, creating bug reports, submitting minor code fixes, and escalating bugs to engineering. The role offers a front-line customer interaction experience at a fast-paced startup focused on AI.
### **TLDR**
LiteLLM is an **open-source LLM Gateway with 28K+ stars on GitHub** and trusted by companies like **NASA, Rocket Money, Samsara, Lemonade, and Adobe.** We’re rapidly expanding and seeking a performance engineer to help scale the platform to handle 5K RPS (Requests per second). We’re based in San Francisco.
### **What is LiteLLM**
LiteLLM provides an **open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format**
We just hit **$2.5M ARR** and have raised a **$1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund.** You can find more information on our [**website**](https://www.litellm.ai/), [**Github**](https://github.com/BerriAI/litellm) and [**Technical Documentation.**](https://docs.litellm.ai/docs/)
### **About the Role**
We’re looking for a Technical Support Engineer to help our customers troubleshoot issues, optimize their setup, and get the most value out of our product. You’ll be the first line of defense for incoming technical questions, ensuring timely resolution and a great customer experience.
This role is ideal for someone who enjoys solving complex technical problems, communicating clearly with both technical and non-technical users, and continuously improving internal processes and documentation.
### Responsibilities
* Diagnose and troubleshoot technical problems across on LiteLLM. This can be on the backend or frontend.
* Reproduce issues and create clear, actionable bug reports for engineering.
* Submit small pull requests for simple fixes, documentation updates, or configuration changes.
* Escalate bugs to product engineering and close the loop with the customer once shipped.
* Maintain a high standard of customer empathy—clear communication, active listening, and ownership of problems until resolution.
* Keep support documentation up to date.
### **Why Work At LiteLLM?**
* You love being on the front lines with customers at a fast-growing startup, quickly scoping their issues, leading troubleshooting discussions, and driving them to successful outcomes.
* You love working with developers (30k+ Github stars)
* You want to work hard (966 work culture)
* You want to learn how AI is transforming businesses (Businesses run ALL LLM calls through LiteLLM)
LiteLLM is an **open-source LLM Gateway with 28K+ stars on GitHub** and trusted by companies like **NASA, Rocket Money, Samsara, Lemonade, and Adobe.** We’re rapidly expanding and seeking a performance engineer to help scale the platform to handle 5K RPS (Requests per second). We’re based in San Francisco.
### **What is LiteLLM**
LiteLLM provides an **open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format**
We just hit **$2.5M ARR** and have raised a **$1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund.** You can find more information on our [**website**](https://www.litellm.ai/), [**Github**](https://github.com/BerriAI/litellm) and [**Technical Documentation.**](https://docs.litellm.ai/docs/)
### **About the Role**
We’re looking for a Technical Support Engineer to help our customers troubleshoot issues, optimize their setup, and get the most value out of our product. You’ll be the first line of defense for incoming technical questions, ensuring timely resolution and a great customer experience.
This role is ideal for someone who enjoys solving complex technical problems, communicating clearly with both technical and non-technical users, and continuously improving internal processes and documentation.
### Responsibilities
* Diagnose and troubleshoot technical problems across on LiteLLM. This can be on the backend or frontend.
* Reproduce issues and create clear, actionable bug reports for engineering.
* Submit small pull requests for simple fixes, documentation updates, or configuration changes.
* Escalate bugs to product engineering and close the loop with the customer once shipped.
* Maintain a high standard of customer empathy—clear communication, active listening, and ownership of problems until resolution.
* Keep support documentation up to date.
### **Why Work At LiteLLM?**
* You love being on the front lines with customers at a fast-growing startup, quickly scoping their issues, leading troubleshooting discussions, and driving them to successful outcomes.
* You love working with developers (30k+ Github stars)
* You want to work hard (966 work culture)
* You want to learn how AI is transforming businesses (Businesses run ALL LLM calls through LiteLLM)
Similar roles
- Technical Support EngineerInvicti · Austin, Texas, United States · Hybrid
- Technical Support EngineerTrend Micro Inc. · Irving, Texas, United States · Onsite
- Technical Support EngineerGong · New York, New York, United States · Onsite
- Senior Technical Support EngineerStellar Cyber · Remote, Japan · Remote
- Senior Technical Support EngineerVerily · Raleigh, North Carolina, United States · Onsite
