RiseMe
LoginSign Up
Fireworks AI logo
Fireworks AI Verified
Artificial Intelligence, Machine Learning, SaaS

Member of Technical Staff

New York, New York, United StatesFull TimeStaff$175,000–$220,000 /yrPosted 3 days agoVisa sponsorship available

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Role summary

Fireworks AI is seeking a Member of Technical Staff to design, develop, and maintain large-scale backend and cloud-native infrastructure for their generative AI platform. This role involves architecting scalable systems for distributed machine learning training, inference, and data processing. The ideal candidate will have 4 years of experience in backend infrastructure, cloud environments, and server-side programming languages like Python, C++, Go, or TypeScript. Responsibilities include leading technical design, mentoring engineers, optimizing infrastructure costs, and collaborating with cross-functional teams. Experience with containerization (Docker, Kubernetes) and data processing systems (Spark, Kafka) is required. The position offers competitive salary, equity, and benefits in a fast-growing startup environment.

About Us:

At Fireworks, we’re building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We’ve been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models. Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. We’re an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI.

Job Duties: Design, develop, and maintain large-scale backend and cloud-native infrastructure tosupport distributed machine learning training, inference, and data processing pipelines for generative AI platform.Architect and build scalable, resilient backend infrastructure to support distributed training, inference, and dataprocessing pipelines. Lead technical design discussions, mentor engineers, and establish best practices forlarge-scale machine learning systems. Design and implement core backend services with a focus on efficiencyand low latency. Drive infrastructure optimization initiatives for compute cost, storage lifecycle management, andnetwork performance. Collaborate with machine learning, DevOps, and product teams to translate research andproduct requirements into robust infrastructure solutions. Evaluate and integrate cloud-native and open-sourcetechnologies such as Kubernetes, Ray, Kubeflow, and MLFlow to enhance platform reliability. Own end-to-endsystems from design to deployment, emphasizing reliability, fault tolerance, and operational excellence.

Minimum Education & Experience Required: Bachelor’s degree or equivalent in Computer Science or relatedfield plus four (4) years of experience in software engineering or related role

Minimum Skills Required: 4 years of experience designing, building, and optimizing large-scale backendinfrastructure and distributed data systems (e.g., PostgreSQL, MySQL, DynamoDB, Apache Spark, ApacheFlink, Apache Kafka) in cloud environments (AWS, GCP, Azure, or equivalent), including cloud-native platforms,core infrastructure components, and optimization techniques (caching, indexing, sharding, replication,transactions, ACID). 4 years of experience with major server-side programming languages and frameworks(e.g., Python, C++, Go, TypeScript). 4 years of experience writing technical design documentation, leading cross-functional projects, and collaborating with cross-functional teams to achieve business impact. 3 years ofexperience developing and maintaining data processing and API systems, including client-server communicationframeworks (e.g., gRPC, Thrift). 3 years of experience conducting A/B testing and scientific experimentation(e.g., Statsig, Meta Deltoid, Optimizely) to measure software impact. 3 years of experience conducting codinginterviews and providing systematic feedback for engineering candidates. 2 years of experience with cloud-nativetools and infrastructure, such as Docker and Kubernetes. 2 years of experience defining and implementing data-driven metrics to support company or team goals.

How to Apply: Submit resume and apply online at http://www.fireworks.ai/careers and search for job by title.

Total compensation for this role also includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package. Base salary is determined by a range of factors including individual qualifications, experience, skills, interview performance, market data, and work location. The listed salary range is intended as a guideline and may be adjusted.

Base Pay Range (Plus Equity)
$175,000—$220,000 USD

Why Fireworks AI?

  • Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.
  • Build What’s Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.
  • Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.
  • Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.

    • Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.

    Ready to apply?
    You'll be redirected to Fireworks AI's application page.

    Similar roles