
Staff Forward Deployed Engineer
Required skills
- AI technology
- RISC-V CPU
- production code
- customer impact
- inference stack
- pull requests
- benchmarks
- telemetry data
- Kubernetes
- Helm
Nice to have
- early adopter
- agentic workflows
- accelerator compute
- memory topology
- networking topology
- AI hardware-software co-design
Role summary
Tenstorrent is seeking a Staff Forward Deployed Engineer to bridge the gap between customers and engineering for their AI computers. This remote, North America-based role requires strong software engineering skills with 5+ years of experience, focusing on production code contribution, deployment operations, and customer interaction. Key responsibilities include debugging the full inference stack, managing Kubernetes/Helm at scale, and utilizing observability and automation tools. Experience with LLM inference serving engines and understanding hardware constraints are crucial. The role offers direct customer impact and high autonomy, contributing to the development of cutting-edge AI technology.
- You understand how accelerator compute, memory, and networking topology constrain AI workloads, and don't treat hardware as a black box.
- You're an early adopter of AI for your work from coding to building agentic workflows that multiply your impact.
- You work directly with customers to understand their challenges and provide effective solutions.
- You are comfortable debugging across the full inference stack: from failing requests, through the serving layer, down to OOMs or kernel dispatch if need be.
- You bring feedback in the form of pull requests, reproducible code, benchmarks, and telemetry data.
- Strong software engineering skills with 5+ years of relevant technical experience (e.g. Applied Engineer, Machine Learning Engineer, MLOps Engineer, Platform Engineer, Infrastructure Engineer, Site Reliability Engineer, Field Application Engineer).
- Experience turning ambiguous customer requirements or issues into verifiable acceptance criteria.
- Kubernetes and Helm experience at multi-node, HPC, or AI cluster scale.
- Experience with observability and infrastructure automation, e.g. Prometheus, Grafana, OpenTelemetry.
- Experience with LLM inference serving engines and technologies, e.g. vLLM, SGLang, Mooncake, NIM, Dynamo, LMCache.
- Where co-design of AI hardware and software translates into unique latency and throughput performance.
- How to scale disaggregated inference services on Kubernetes while balancing performance, reliability, and tactical tradeoffs.
- What makes enterprise AI deployments successful: from technical requirements through software delivery, cluster-scale validation, and production ownership.
- Why customer insights from the field shape the best products.
- How to build agentic workflows for asymmetric impact.
Originally posted on Himalayas
Similar roles
AI Field Engineer / Forward Deployed Engineer (FDE)Urban Ridge Supplies · Remote · Remote
Lead Software Engineer, AI & Emerging TechUrban Ridge Supplies · Toronto, ON · Onsite- Forward Deployed Engineer (FDE) C-UASDefense Unicorns · Remote · Remote
AI Forward Deployed EngineerTelnyx · Remote · Remote- Senior Forward Deployed EngineerWithClutch · Remote · Remote
Senior Forward Deployed Engineer - CanadaCamunda · Remote · Remote
