H Company Logo

H Company

Infrastructure Engineer (ML Compute) - Paris

Posted 11 Days Ago
Be an Early Applicant
Hybrid
London, Greater London, England, GBR
Entry level
Hybrid
London, Greater London, England, GBR
Entry level
Own and operate globally distributed GPU infrastructure for model training, evaluation, and serving. Responsibilities include running Kubernetes GPU clusters, optimizing scheduling and placement, repairing unhealthy nodes, managing cloud capacity, and debugging Linux, hardware, storage, and networking failures. The role also involves designing GPU clusters, collaborating with research and product teams, and improving compute reliability and utilization.
The summary above was generated by AI

You’ll own the GPU compute that powers our model training, evaluation and serving systems.

This role sits in our Infrastructure team, which works at the lowest layers of our stack, from Kubernetes down to the GPU hardware. You’ll run the clusters, GPUs and schedulers that our research, product and platform teams depend on, and manage the capacity we buy from our cloud providers.

What success looks like

Success is measured by how well we use our GPUs: keeping production reliable and improving the performance of our training and serving stack.

What you’ll be doing
  • Running Kubernetes clusters for GPU training and inference

  • Improving how GPU work is scheduled and placed

  • Detecting, draining and repairing unhealthy GPU nodes

  • Managing capacity with our cloud providers

  • Debugging failures in GPUs, Linux, storage and networking

The first year

By month 3, you’ll be handling a share of cluster incidents on your own and will have shipped one change to scheduling or node health, such as automatically detecting and draining unhealthy GPU nodes. By month 6, you’ll own one part of the compute layer outright: scheduling and placement, node health and repair, or capacity and new regions. By month 12, you’ll be responsible for a globally distributed GPU system that shifts capacity between training and inference as needs change.

Who you’ll work with

Your hiring manager is our VP of Engineering. Day to day, you’ll work with the Platform Infrastructure team, the research and product teams who use our compute, and our cloud providers and other vendors.

What we think it takes

You’re likely a good fit if you:

  • Have built and run GPU workloads on Kubernetes

  • Could design a GPU cluster for training and online RL from scratch

  • Debug confidently at the OS layer and below (Linux, GPU drivers, networking and storage)

  • Write strong Python

It’s a plus if you’ve worked as an SRE or infrastructure engineer, or have used:

  • Slurm

  • Kubernetes scheduling and autoscaling tools such as Kueue or Karpenter

  • Multi-cloud orchestration tools such as SkyPilot

  • AWS services such as EKS or SageMaker HyperPod

  • High-performance interconnects and collective communication libraries such as EFA, InfiniBand, NCCL or Open MPI

  • Terraform

You don’t need ML research experience. If you match most of this but not every point, please apply.

How we hire

Four stages, about three hours in total: a 30-minute call with our Talent team, a 60-minute coding interview, a 60-minute system design interview and a closing 30-minute conversation with our VP of Engineering. The coding and system design interviews are modelled on real-world problems you’d face in this role.

Practicalities

The role is hybrid, with three days a week in our Paris or London office and occasional travel between the two. We offer a competitive package.

Similar Jobs

52 Minutes Ago
Easy Apply
Hybrid
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Own and scale Datadog’s batch analytics data platform, supporting extensive Spark, PySpark, Ray, and Python workloads. Build AI-driven migration automation, agentic tooling, engine-agnostic batch execution, reliability improvements, and Spark pod autosizing. Design high-performance distributed systems, improve developer infrastructure, and manage execution-model tradeoffs across large-scale workloads. Collaborate with internal data engineering and science teams while using AI coding tools to enhance development workflows.
Top Skills: Ai/Llm ToolsSparkGoJavaJvmKubernetesPysparkPythonRayRustScala
2 Hours Ago
Hybrid
Senior level
Senior level
eCommerce • Information Technology • Retail • Software
Manage France-based payroll preparation, personnel administration, benefits, employee onboarding, mobility, and offboarding for approximately 400 employees. Maintain accurate HR records, prepare payroll inputs, coordinate with Finance and outsourced payroll providers, produce employment documents, and support employees and managers on daily HR matters. The role requires strong knowledge of French employment law, full employee lifecycle experience, advanced English, and comfort with HR tools in a fast-paced international environment.
Top Skills: BamboohrDustGoogle WorkspaceLuccaSiitSilae
2 Hours Ago
Easy Apply
Remote or Hybrid
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Build performant, high-scale distributed systems supporting Datadog’s Metrics, Logs, Events, and APM products. Develop governance and cost-control tools for telemetry, collaborate across product teams, navigate ambiguous systems, anticipate technical dependencies, and connect engineering decisions to customer value, usability, and cost efficiency. The role requires strong backend programming, distributed systems expertise, proactive cross-team communication, and effective use of AI coding tools.
Top Skills: Ai Coding ToolsC++Distributed SystemsGoJavaRust

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account