Senior Software Engineer, GenAI Platform

• About Our Client:

The organization operates a large online platform composed of diverse communities centered on shared interests, passions, and trust. It facilitates open and authentic conversations on a wide range of topics, hosting over 100,000 active communities and attracting approximately 121 million daily active unique visitors. The platform serves as a significant source of information and interaction across various subjects, supporting engagement through content submission, voting, and commenting.

• About the Opportunity:

The Senior Software Engineer, GenAI Platform will lead the development of a large-scale generative AI platform. This role focuses on building and maintaining core infrastructure that supports machine learning models and generative AI services. The position drives improvements in reliability, scalability, and operational excellence of AI systems. By shaping the AI platform from design through production, this role directly impacts the effectiveness of recommendation, content discovery, and other AI-driven services within the organization.

• Responsibilities

• Design, implement, and maintain the LLM Gateway, including unified API endpoints for internal and external large language models, rate/token limit management, and failover mechanisms

• Develop and operate ML and generative AI systems at scale in cloud production environments

• Build and manage retrieval-augmented generation (RAG) applications using embeddings, vector search, and retrieval pipelines

• Implement and operationalize agentic AI workflows with tooling frameworks such as LangChain and LangGraph

• Promote adoption of MLOps and LLMOps practices including CI/CD automation, versioning, testing, and lifecycle management

• Define best practices for observability, monitoring, evaluation, and governance of generative AI pipelines in production

• Demonstrate strong ownership and platform-oriented thinking

• Lead delivery of AI platform projects from concept to production

• Requirements:

• Minimum 5 years of experience in ML Engineering, AI Platform Engineering, or Cloud AI Deployment roles

• Experience managing orchestration systems like Kubernetes at scale

• Extensive knowledge of cloud-based ML platform technologies including AWS, Google Cloud Storage, and infrastructure-as-code tools such as Terraform

• Proficiency in programming languages common to ML platforms, such as Go and Python

• Ability to communicate complex AI concepts clearly to technical and non-technical stakeholders

• Strong focus on scalability, reliability, performance, and user experience for platform users

• Familiarity with model serving, inference pipelines, monitoring, and observability is a plus

• Proficiency with modern AI/ML frameworks such as LangChain, Vertex AI Agent Builder, TensorFlow, or PyTorch is advantageous

• Pay Range and Compensation Package:

• The base salary range for this position is $190,800—$267,100 USD

• Eligible to receive equity in restricted stock units and potentially commissions depending on role

• Additional compensation details and benefits are aligned with standard U.S.-based employee offerings

• Benefits & Perks:

• Comprehensive healthcare benefits and income replacement programs

• 401k plan with employer match

• Global benefit programs tailored to lifestyle needs, including workspace, professional development, and caregiving support

• Family planning support

• Gender-affirming care

• Mental health and coaching benefits

• Flexible vacation and paid volunteer time off

• Generous paid parental leave

Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin.

Note:

RemoteHunter is not the Employer of Record (EOR) for this role. Our purpose in this opportunity is to connect exceptional candidates with leading employers. We help job seekers worldwide discover roles that match their goals and guide them to complete their full application directly through the hiring company’s career page or ATS.