
Software Engineer, Systems Machine Learning
Required skills
- MTIA
- AI accelerator ASICs
- silicon specs
- fleet observability
- debug
- profile
- memory analysis
- monitoring
- performance analysis
- code reviews
Nice to have
- CLI tools
- diagnostic utilities
- accelerator ecosystems
- GPU/CUDA
- TPU
- custom ASICs
Role summary
Meta is seeking a Software Engineer for its MTIA (Meta Training & Inference Accelerator) Software Tooling team. This role focuses on developing and maintaining the tooling ecosystem for Meta's in-house AI accelerator ASICs. You will design, build, and maintain developer tools for debugging, profiling, memory analysis, and monitoring AI workloads on MTIA hardware at scale. The position involves working at the intersection of compilers, runtime, hardware, and ML frameworks, collaborating with cross-functional teams to enhance the developer experience for custom AI accelerators. A Bachelor's degree in Computer Science or a related field, along with 2+ years of experience in systems software, developer tooling, or infrastructure, proficiency in C++ and Python, and experience with complex systems debugging are required.
Responsibilities
- Design and develop software tools across the MTIA tooling ecosystem, including debugging, profiling, performance analysis, memory analysis, and monitoring infrastructure
- Own features and components end-to-end, from design through implementation, testing, and deployment
- Build and improve tooling infrastructure that enables engineers to efficiently develop, test, and optimize AI workloads on MTIA hardware
- Collaborate with the MTIA compiler, runtime, kernel, and hardware teams to integrate tooling hooks and support new platform capabilities
- Proactively identify gaps in the tooling ecosystem and propose solutions to improve developer productivity
- Contribute to technical design discussions, write design documents for medium-scope projects, and participate in code reviews
- Partner with internal product teams across advertising, recommendations, and generative AI to understand developer pain points and improve tool usability
Minimum Qualifications
- Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
- Bachelor's degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience
- 2+ years of experience in software engineering, with exposure to systems software, developer tooling, or infrastructure
- Proficiency in C++ and Python, including systems-level programming concepts
- Experience working across multiple layers of a system stack (e.g., application, runtime, OS/driver, or hardware interfaces)
- Track record of independently delivering software projects from design through production deployment
- Experience debugging and resolving issues in complex software systems (e.g., using log analysis, stack traces, or system-level diagnostic tools)
Preferred Qualifications
- Experience building developer tools such as debuggers, profilers, build systems, CLI tools, monitoring dashboards, or diagnostic utilities
- Exposure to accelerator ecosystems (GPU/CUDA, TPU, custom ASICs) or heterogeneous computing environments
- Familiarity with Linux debugging and profiling tools (gdb, perf, strace, eBPF, valgrind) or similar diagnostic infrastructure
- Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
- Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
- Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
- Contributions to open-source projects demonstrating tooling or system software interest
- Experience in using data-driven methods to evaluate tooling effectiveness and to prioritize improvements
- Experience with distributed systems debugging, profiling, or monitoring at scale
- Familiarity with ML frameworks (PyTorch, TensorFlow) or compiler infrastructure (LLVM, MLIR, TVM)
$121,992/year to $181,000/year + bonus + equity + benefits
Similar roles
Agency Solutions ManagerMeta · Chicago, IL · Onsite
Net Zero Manager, Supplier Clean EnergyMeta · Menlo Park, CA · Hybrid
Senior Software EngineerHumata Health · Remote · Remote- Intermediate Software Engineer (Frontend/UI)Achievers · Toronto, ON · Hybrid
Software Engineer, ML Workload PlatformCohere · Remote · Remote- Senior Fullstack Software EngineerNovellia · Remote · Remote
