Build and maintain a scalable internal LLM agent framework and backend services in Python, ensuring observability, reliability, and parallel processing. Collaborate with ML/NLP teams, adapt the framework to customer use cases, and build automated LLM evaluation pipelines.
Description
We are now expanding our team and are looking for a skilled, goal-oriented backend developer to help us grow. You'll work on services, APIs, databases, and integrations with external systems, collaborating closely with a small, hands-on, technically strong team that moves fast and makes decisions without unnecessary bureaucracy.
Requirements- 6+ years of production experience with Python
- At least 2 years of hands-on experience with async Python (FastAPI, aiohttp, or similar frameworks) in production
- Ability to debug issues across service boundaries
- Strong product mindset, understanding the "why" behind requests and making technical decisions that align with product and business goals.
- Able to navigate ambiguity, adapt quickly to changing priorities, and deliver results despite evolving requirements and limited upfront specifications.
- Open to using AI tools in daily development and troubleshooting
Nice to have:
- Experience with AI Tracing Tools like LangSmith
- Develop and maintain the internal LLM agent framework with focus on scalability, processing, and parallelism
- Ensure system observability and reliability using metrics, tracing and monitoring tools
- Adapt the framework for specific customer use cases and collaborate closely with ML/NLP teams
- Build and support automated LLM evaluation pipelines
- Design backend services using Python () and modern cloud-native architecture.
- The team has built award-winning AI products for tech corporations: devices, voice assistants, products that are actually in the world
- Cutting-edge tech stack: Speech Technologies, NLP, Generative AI (LLMs, diffusion models), voice-first agentic architecture with privacy-first and on-premises deployment
- High engineering bar and real ownership: the team cares about what actually works in production, not what looks good in a demo, and you'll see the impact of your work directly
- Fast career progression: a senior-heavy team and a high volume of real problems means you grow faster than you would anywhere else
- Startup pace with enterprise stability: real clients, real revenue, no bureaucracy
- Fully remote across Europe
- 21 vacation days + public holidays + 5 sick days
- Private English lessons via Preply
- Company-paid subscriptions to top AI tools (ChatGPT, Claude, Cursor, and others)
Similar Jobs
Cloud • Security • Software • Cybersecurity • Automation
Build and maintain backend AI capabilities for GitLab Duo Chat: design flow components and agentic flows in Python/LangGraph, integrate LLMs and multi-agent orchestration, implement and maintain APIs in the Rails monolith, improve observability and reliability, and participate in on-call rotations and cross-functional collaboration to deliver safe, scalable AI chat features.
Top Skills:
Agent FrameworksGraphQLLangchainLanggraphLarge Language ModelsMulti-Agent OrchestrationPostgresPytestPythonRestRspecRuby On RailsSQLTool/Function Calling
Cloud • Security • Software • Cybersecurity • Automation
Build tooling, workflows, and guidance to make GitLab easier to deploy, validate, and operate across cloud-native and self-managed environments. Evolve deployment guidance, improve production-like ephemeral environments, and maintain consistent deployment artifacts and environment contracts across development through production.
Top Skills:
Ci/CdCloud NativeDistributed SystemsEphemeral EnvironmentsGitlabKubernetesPlatform Engineering
Cloud • Security • Software • Cybersecurity • Automation
Design, build, and operate the high-availability event and trigger system that links GitLab and third-party events to AI-powered Duo Flows. Work in GitLab's Rails monolith, scale for high throughput, influence architecture, add trigger types, collaborate cross-functionally, and participate in Tier 2/3 on-call rotations to troubleshoot production issues.
Top Skills:
Agentic SystemsCi/CdGitlabJenkinsJIRALarge Language ModelsRuby on RailsRubySlack
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
