Design, build, and maintain a scalable internal LLM agent framework and backend services in Python. Ensure observability and reliability via metrics, tracing, and monitoring. Collaborate with ML/NLP teams to adapt the framework for customers, build automated LLM evaluation pipelines, and support integrations and parallel processing for production systems.
Description
We are now expanding our team and are looking for a skilled, goal-oriented backend developer to help us grow. You'll work on services, APIs, databases, and integrations with external systems, collaborating closely with a small, hands-on, technically strong team that moves fast and makes decisions without unnecessary bureaucracy.
Requirements- 6+ years of production experience with Python
- At least 2 years of hands-on experience with async Python (FastAPI, aiohttp, or similar frameworks) in production
- Ability to debug issues across service boundaries
- Comfortable working with partially defined tasks and evolving requirements
- Ready to work in a fast-changing, high-uncertainty environment
- Open to using AI tools in daily development and troubleshooting
Nice to have:
- Experience with AI Tracing Tools like LangSmith
- Develop and maintain the internal LLM agent framework with focus on scalability, processing, and parallelism
- Ensure system observability and reliability using metrics, tracing and monitoring tools
- Adapt the framework for specific customer use cases and collaborate closely with ML/NLP teams
- Build and support automated LLM evaluation pipelines
- Design backend services using Python () and modern cloud-native architecture.
- The team has built award-winning AI products for tech corporations: devices, voice assistants, products that are actually in the world
- Cutting-edge tech stack: Speech Technologies, NLP, Generative AI (LLMs, diffusion models), voice-first agentic architecture with privacy-first and on-premises deployment
- High engineering bar and real ownership: the team cares about what actually works in production, not what looks good in a demo, and you'll see the impact of your work directly
- Fast career progression: a senior-heavy team and a high volume of real problems means you grow faster than you would anywhere else
- Startup pace with enterprise stability: real clients, real revenue, no bureaucracy
- Fully remote across Europe
- 21 vacation days + public holidays + 5 sick days
- Private English lessons via Preply
- Company-paid subscriptions to top AI tools (ChatGPT, Claude, Cursor, and others)
Similar Jobs
Information Technology • Software • Travel • Hospitality
Senior backend engineer responsible for building and owning high-scale hotel integrations (channel managers, PMS) from code to production. Work includes designing resilient API adapters, optimizing performance and cost for 600M daily requests, debugging live incidents, and shipping new integrations with high ownership in a low-process environment.
Top Skills:
APIsChannel Manager IntegrationsGoProperty Management Systems (Pms)
Software
Lead ownership of major backend subsystems, design scalable APIs and architectures, improve reliability, mentor engineers, drive cross-team technical initiatives, contribute hands-on to codebase, and support production stability and CI/CD practices.
Top Skills:
Ai/Ml ServicesAWSCi/CdNoSQLPineconePostgresQdrantRedisRubyRuby On RailsSidekiqVector DatabasesWeaviate
Machine Learning • Software • Database
Design and implement execution primitives for AI/agent workflows in Kestra's Java core, build and maintain plugins to connect LLM providers and agent frameworks, convert agent use cases into reusable blueprints with product, and ensure AI executions are observable, debuggable, correct, and reliable.
Top Skills:
AWSAzureBootstrapDockerElasticsearchGCPGitGithub ActionsJavaKafkaKubernetesLangchain4JMicronautMySQLPostgresTerraformVue
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
