We're in beta · Starting with US & Canada · Shipping weekly — your feedback shapes RiseMe
Together AI logo
Together AI Verified
Artificial Intelligence

Software Engineer

San Francisco, California, United StatesOnsiteFull Time$165,000–$200,000 /yrPosted 2 months ago

Compensation estimateAI

See base, equity, bonus, and total comp estimates for this role — free, no credit card.

Sign up to see compensation estimate

### Who you are
- Experience: 1–3 years of professional experience in Software Engineering or Cloud Operations with hyper scalers
- Cloud & Containers: Solid understanding of Docker and Kubernetes orchestration, as well as experience with cloud platforms like AWS, GCP, or Azure
- Tooling: Familiarity with infrastructure-as-code (Terraform or Helm) and version control (Git)
- Observability Fundamentals: Experience using Prometheus and Grafana for system monitoring
- Storage Systems: Experience with distributed storage systems, like WekaFS, Vast, Ceph, MinIO, GPFS, Luster etc
- Problem Solving: Strong debugging skills and a passion for automation and operational excellence
- Experience monitoring AI/ML infrastructure, GPU clusters, and custom metrics for model performance and training pipelines
- Background in high-frequency, low-latency systems monitoring, chaos engineering, and reliability testing
- Contributions to open-source projects, preferably in the space of observability or storage
- Familiarity with security monitoring and compliance frameworks

### What the job involves
- Our AI Infrastructure team is at the forefront of scaling the foundational systems that power this platform. We are looking for an Early Career Software Engineer to join our Storage and Observability team, where you will help design and maintain robust distributed storage solutions and develop comprehensive observability platforms
- In this role, you will work on the systems that provide critical insights into GPU utilization and system performance, ensuring seamless data access for the world's largest AI training and inference workloads
- Build and deploy scalable observability tools (metrics, logs, traces) using the latest state of the art open source distributed telemetry, log search and tracing systems
- Develop and implement infrastructure-as-code for stack deployment using Terraform, Ansible, and Helm
- Write clean, production-grade code in Go or Python to create custom K8S operators, tools and automation
- Support the operation of high-performance distributed storage systems (such as Ceph, Weka/Vast) and Kubernetes-native storage operators
- Optimize storage systems for GPU clusters (10-50 GB/s per-node throughput) and scale storage infrastructure to support thousands of nodes
- Partner with senior engineers to enhance distributed tracing and optimize data paths for AI workloads

### Benefits
- Competitive health insurance plans
- Dental and vision insurance
- Pre-tax flexible spending accounts
- Mental health support and services
- Income protection & retirement
- 401(k) plan
- AD&D insurance
- Life insurance
- STD & LTD insurance
- Monthly team lunches
- Flexible time off policy
- Team-driven celebrations and events
- Monthly commuting stipend + pre-tax bene

Ready to apply?
You'll be redirected to Together AI's application page.

Similar roles