Design, develop, and optimize LLM-powered features and agentic systems, ensuring reliability, performance, and scalability. Collaborate with cross-functional teams and contribute to overall technical strategy.
About Modjo
At Modjo, we’re on a mission to free salespeople to rediscover the art of selling.
The sales world is broken: even top performers spend more time documenting than selling.
We exist to change that.
By removing admin noise and empowering teams with AI agents, Modjo helps sellers focus on what truly matters: building trust, driving strategy, and closing deals.
Our AI doesn’t replace the human touch; it amplifies it. We build for people who want to perform, progress, and win.
With 70+ people and strong ambitions for our next stage of growth, we’re scaling fast across Europe and strengthening our AI team to move even faster in building our AI product capabilities.
About the role
Play a central role in building, maintaining, and scaling the LLM-powered and agentic features that drive Modjo’s product.
Your primary mission will be to design, develop, and evolve our agentic system, which is becoming the backbone of the entire product. You will work across model orchestration, tool execution, evaluation, reliability, and performance—ensuring these systems operate at production scale and deliver consistently high-quality results.
Experience with speech technologies and our self-hosted transcription pipeline is a plus but not a core requirement.
Responsibilities
Design, build, and optimize the agentic stack that powers both conversational and autonomous multi-step agents, ensuring reliability, scalability, and low-latency performance in production.
Architect, productionize, and maintain LLM-powered features end-to-end, including model orchestration, routing, monitoring, logging, and evaluation.
Develop and improve ML infrastructure, including observability, load balancing, scaling patterns, and deployment workflows for agentic and LLM-based systems.
Construct robust datasets and evaluation pipelines for both deterministic systems (ASR) and non-deterministic systems (LLMs and agents), enabling continuous quality improvements.
Collaborate with Software Engineers to build scalable, observable, and automated infrastructure supporting ML services across the platform.
Work closely with Product Managers to assess feasibility, shape feature specs, and ensure timely and reliable delivery of ML- and agent-driven capabilities.
Contribute to technical strategy, model/tool selection, architectural decisions, and long-term roadmap for Modjo’s agentic platform.
Stay ahead of the curve on new research, frameworks, and open-source developments in LLMs, agentic systems, and evaluation methodologies.
Desired Profile
3+ years of experience in ML Engineering, with a strong track record of deploying and maintaining ML or LLM systems in production—including monitoring, scaling, and performance optimization.
Deep familiarity with LLM integration, including model orchestration, prompt/graph design, evaluation methods, reliability patterns, and cost/performance tradeoffs.
Strong experience with production-grade ML infrastructure, including CI/CD, observability, monitoring, containerization, load balancing, and cloud deployment.
Direct experience with agentic systems—such as planning, tool execution, workflows, memory architectures, LangChain/LangGraph, or equivalent frameworks.
Experience with Vector and Graph Databases is a plus.
Experience with MCP (Model Context Protocol), DeepEval, FastAPI, Uvicorn, or production API development is a plus.
Experience with NLP technologies (ASR, diarization, embeddings, audio ML) is a plus.
Comfortable owning projects end-to-end in a fast-paced, highly collaborative engineering environment.
Our Stack
Cloud & Infra: AWS, Langfuse, Datadog
Agentic & LLM Tools: LangChain, LangGraph
LLMs: OpenAI GPT, Anthropic Claude, Google Gemini
Speech & Audio: OpenAI Whisper, NVIDIA NeMo, pyannote.audio
Data & Storage: Postgres, MongoDB, Weaviate, Neo4j
Top Skills
Anthropic Claude
AWS
Ci/Cd
Containerization
Google Gemini
Langchain
Langgraph
MongoDB
Neo4J
Nvidia Nemo
Openai Gpt
Openai Whisper
Postgres
Pyannote.Audio
Weaviate
Similar Jobs
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Generative AI
The role involves developing and maintaining ML models for robotics, enhancing the core library, managing community interactions, and ensuring high performance benchmarks.
Top Skills:
AIPythonPyTorchRobotics
Software
Develop and maintain NLP models for legal documents, design conversational agents, collaborate on product development, and contribute to internal best practices.
Top Skills:
Deep LearningElasticsearchMachine LearningNlpPython
Software
Design and improve end-to-end ML/AI pipelines, process datasets, and contribute production code for high-quality solutions in machine learning projects.
Top Skills:
AICi/CdGitMachine LearningPython
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
