As an ML Compiler Engineer, you will develop efficient programs for ML models, implementing transformations and optimizations within the compiler stack.
You will work on a custom ML compiler that transforms modern ML and DSP models into highly efficient programs for our accelerator.
This role spans the full compiler stack—from ingesting models and transforming intermediate representations to optimizing execution under tight memory and latency constraints.
- Build and maintain model ingestion pipelines (e.g., PyTorch / ONNX → internal IR)
- Implement graph transformations such as:
- Operator decomposition and canonicalization
- Shape inference and layout transformations
- Develop and extend intermediate representations (e.g., MLIR)
- Implement optimization passes including:
- Operator fusion and graph partitioning
- Basic scheduling and tiling strategies
- Memory planning and reuse
- Debug correctness and numerical issues across transformations
- Collaborate with hardware and ML teams to improve system performance
Requirements
Required qualifications and experience:
- 2+ years of experience in compilers and/or edge-AI
- Proficiency in Python and/or C++
- Experience with at least one:
- MLIR, LLVM, TVM, XLA, or similar
- Graph-level transformations or ML model internals
- Understanding of deep learning models (conv, sequence models, etc.)
- Ability to reason about correctness and performance tradeoffs
Nice to have:
- Experience with optimization techniques (tiling, scheduling, memory reuse)
- Familiarity with ONNX or PyTorch internals
- Exposure to quantization or low-precision computation
- Interest in hardware-aware ML systems
Benefits
- 401(k)
- Medical insurance
- Vision insurance
- Dental insurance
- Commuter benefits
- Disability insurance
- Paid maternity leave
- Paid paternity leave
- Child care support
femtoAI is an equal opportunity employer committed to a diverse workforce which strives to create an inclusive working environment empowering everyone to do their best work. We do not discriminate on the basis of race, ethnicity, religion, gender, gender identity, sexual orientation, age, marital status, veteran status, or disability status.
Similar Jobs
Artificial Intelligence • Transportation
Own and extend Wayve’s machine learning compilation pipeline from model checkpoint to deployable embedded bundles across NVIDIA TensorRT and Qualcomm QNN targets. Design compiler passes, quantization and precision-typing systems, graph partitioning, legalization, regression testing, and benchmarking infrastructure. Partner with model and training teams to ensure compilability, accuracy, and latency across architectures and SoCs. Provide technical direction and mentorship for compiler engineering.
Top Skills:
C++MlirNvidia TensorrtOnnxPythonPyTorchQualcomm Qnn
Automotive
Design and implement compiler optimizations and new compiler features for a high-performance neural network inference platform. Analyze generated code performance, collaborate with hardware architects for hardware/software codesign, and work with model developers to tune networks for inference efficiency and accuracy. Leverage agentic AI to accelerate analysis, planning, and production software improvements.
Top Skills:
Agentic AiC++Compilers For Parallel ArchitecturesLinear Algebra ComputationMl Inference
Artificial Intelligence • Hardware • Machine Learning • Semiconductor
Develop the next generation AI compiler for Mythic's analog compute, optimizing for dataflow architectures and collaborating with hardware engineers.
Top Skills:
C++GurobiIreeMlirOnnxOr-ToolsPythonPyTorchTvmXla
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
