Lead end-to-end ML initiatives: integrate and fine-tune models, optimize GPU inference for latency and throughput, build evaluation and monitoring tooling, collaborate on scalable serving systems, and mentor engineers.
Join Runware as a Senior Machine Learning Engineer and be at the forefront of developing innovative AI solutions across various media modalities including text, image, video, 3D, and audio. We're building a powerful AI media creation platform designed to revolutionize how content is generated.
As a Senior Machine Learning Engineer, you’ll take the lead on critical projects, guiding the end-to-end lifecycle from research and experimentation to production deployment and performance monitoring. Your work will help shape the capabilities of our platform and enhance the experiences of users who rely on our cutting-edge AI technologies.
What You'll Be Doing- Integrate open-source and third-party models into our inference platform
- Lead fine-tuning initiatives (LoRA, adapters, PEFT, domain adaptation)
- Optimise inference workloads for latency, batching, memory efficiency, and throughput
- Benchmark model quality vs cost vs performance across modalities
- Improve inference startup times and stability under high load
- Build evaluation frameworks and internal tooling for model validation
- Work closely with Infrastructure and Backend teams on scalable serving systems
- Monitor production performance and drive continuous optimisation
- Mentor engineers and help raise the ML engineering bar across the team
RequirementsWhat We’re Looking For
- Deep, hands-on expertise in Python and PyTorch, comfortable working at a level well beyond standard framework usage, including the quirks and edge cases that come with pushing Python for ML workloads
- Demonstrated experience building ML applications and models yourself, not just running or deploying existing ones (e.g. serving a pre-built model via vLLM doesn't qualify on its own)
- Hands-on experience writing GPU kernels in CUDA/C++, or in Triton
- Low-level experience with model internals e.g. working directly with diffusion model architectures (diffusers or equivalent), not just calling high-level APIs
- Experience with the PyTorch compiler (torch.compile) or comparable low-level PyTorch tooling
- Practical experience fine-tuning large models as a repeatable service (LoRA, PEFT, adapters), built for speed and reuse across many models, not a single one-off training run
- Real, verifiable project history e.g. GitHub repos, demonstrating what you have personally wrote
- High ownership and comfort operating in a fast-paced startup environment
- Experience optimizing inference workloads in GPU environments
- Experience with vLLM or custom inference servers
- Experience with diffusion models, LLMs, or multimodal architectures more broadly
- Experience with Kubernetes, Docker, or containerised ML workloads
- Experience building internal ML tooling or developer-facing APIs
- Experience working in high-throughput distributed systems
- Background in AI media generation (image, video, audio)
Benefits
We’re a remote-first team that comes together in person twice a year to plan, collaborate, and celebrate wins. Day to day we keep a few core hours for teamwork, but outside of that you set the schedule that helps you do your best work.
We move quickly and hold a high bar, but we also believe sustainable performance matters. After major releases and milestones, we create space for the team to properly unplug, recharge and come back with the energy to tackle what's next.
- Generous paid time off – vacation, sick days, public holidays
- Meaningful stock options – share in the upside you create
- Remote-first setup – work from home anywhere we can employ you
- Flexible hours – own your schedule outside core collaboration blocks
- Family leave – paid maternity, paternity, and caregiver time
- Company retreats – twice-yearly gatherings in inspiring locations
Runware London, England Office
London, United Kingdom
Similar Jobs
Artificial Intelligence • Information Technology • Consulting
Develop and deploy machine learning models for retrieval, reranking, indexing, search relevance, crawling, and content understanding. Build large-scale embedding and retrieval systems, evaluation pipelines, and quality metrics for agent-native search. Integrate models into high-throughput production services while balancing latency, quality, and cost. Collaborate on architecture and product decisions involving search, retrieval, and LLM-based systems.
Top Skills:
C++Deep LearningEmbeddingsGoInformation RetrievalLarge Language ModelsMachine LearningNatural Language ProcessingPythonRecommendation SystemsTransformers
Marketing Tech • Software
Lead the architecture, development, deployment, and operation of scalable machine learning systems for algorithmic recommendations. Convert data science prototypes into reliable production software, develop training and inference pipelines, implement MLOps practices, and optimize monitoring and infrastructure. Collaborate with data scientists, product managers, and backend engineers while mentoring peers, influencing technical decisions, and ensuring system reliability.
Top Skills:
AirflowAws SagemakerCi/CdDagsterDistributed Data ProcessingDockerFeature StoresGcp Vertex AiKubernetesPythonRest ApisSQLTerraform
Big Data • Cloud • Software
Optimize large-scale ML inference systems for throughput, latency, cold-start time, and cost per token. Tune SGLang, vLLM, and TensorRT-LLM across GPUs and distributed clusters; improve batching, scheduling, KV caching, quantization, weight loading, JIT caching, and multi-node inference. Profile and instrument systems to validate performance gains, eliminate storage and networking bottlenecks, and establish technical direction through reproducible benchmarks and experiments.
Top Skills:
Chunked PrefillClickhouseContinuous BatchingCudaCuda GraphsExpert ParallelismFastsafetensorsFp4Fp8Gitlab CiGrafanaInt4Int8KubernetesKv CachingO_DirectOpentelemetryPaged AttentionPrefix CachingPrometheusPythonPyTorchSglangSpeculative DecodingTensor ParallelismTensorrt-LlmVirtiofsVllm
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
