Financial Services, Quantitative Trading, Fintech

Machine Learning Compiler Engineer

New York, NYOnsiteFull TimePosted 3 days agoVisa sponsorship available

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Required skills

ML compiler
compiler stack
graph compilers
kernel DSLs
GPU kernel programming
compute and memory hierarchies
static analysis
intermediate representations
instruction selection
CUDA Graphs

Nice to have

compiler technologies
algebraic rewriting
materialize vs recompute tradeoffs
fusion
equality saturation
scheduling languages

Role summary

Jane Street is seeking Compiler Engineers for a new ML Compilers Team. This role involves shaping the development of their ML compiler stack, leveraging a unique trading environment for rapid ML experimentation. Responsibilities include improving existing ML compiler technologies and potentially building new solutions to optimize hardware resources and enable fast model development and deployment. The ideal candidate has experience with ML compilers or other compiler technologies, with a focus on areas like optimizations, frontends, GPU kernel programming, compiler concepts, ML inference/training, and programming language design.

About the position

We’re looking for compiler engineers to join a new ML Compilers Team at Jane Street.

Machine learning is a critical pillar of our global business. Our ever-evolving trading environment serves as a unique, rapid-feedback platform for ML experimentation, allowing us to incorporate new ideas with relatively little friction. Our ML team is full of people with a shared love for the craft of software engineering, and for designing APIs and systems that are delightful to use.

ML compilers let us quickly turn research ideas and novel architectures into high-throughput training jobs and low-latency inference. To get the most out of our hardware resources and enable rapid model development and deployment, we are working to understand and improve the current ML compiler technologies and explore where it makes sense to build our own solutions. In this role, you would shape the development of our compiler stack.

If you’ve never thought about a career in finance, you’re in good company. Many of us were in the same position before working here. If you have a curious mind and a passion for solving interesting problems, we have a feeling you’ll fit right in.

About you

The ideal candidate has worked on an ML compiler in the past, but non-ML compiler experience is also valuable. Experience with any part of the stack is fine, be it high-level ML frameworks (PyTorch, Jax, TensorFlow), graph compilers (Inductor, XLA, TVM), or kernel DSLs (Triton, Helion, cuTile). You should understand how all those pieces fit together even if you are unfamiliar with specific parts.

Some other things you might be excited about are:

Optimizations in ML compilers: algebraic rewriting, materialize vs recompute tradeoffs and fusion, equality saturation, scheduling languages, loop-level optimization, autotuning

ML compiler frontends: graph capture, symbolic and dynamic shapes, control flow, automatic differentiation

GPU kernel programming and architecture: Triton, cuTile, CuTeDSL, CUDA, compute and memory hierarchies, programming with tensor cores

Compiler concepts: static analysis, intermediate representations like SSA and CFGs, instruction selection

ML inference: CUDA Graphs, KV caching, batching

ML training: Tensor/Sequence/Expert/Pipeline Parallelism, FSDP, NCCL, activation checkpointing

GPU debugging and optimization: CUDA-GDB, Nsight Systems, Nsight Compute

Formal methods: proof assistants, automated theorem provers, agentic proof systems

Programming languages and DSL design: embedded DSLs, staging and metaprogramming, type systems, functional programming

If you're a recruiting agency and want to partner with us, please reach out to agency-partnerships@janestreet.com

Ready to apply?

You'll be redirected to Jane Street's application page.