Lead backend engineer responsible for owning major product features, designing scalable observability for LLM calls, optimizing dashboard latency, improving the prompt-management SDK, collaborating with founders, and handling end-to-end deployment and customer-facing tasks.
About Us:
About the Role:
Our Stack:
Why Join Us:
About You:
Bonus Points:
Our Company Culture
What We Offer:
Agenta is an open-source LLM developer platform that builds AI applications powered by Large Language Models (LLMs). We streamline each step of the development lifecycle, enabling teams to develop reliable LLM-powered apps more quickly.
Our product equips teams with necessary tools for collaboration and building reliable LLM applications: prompt management, evaluation and testing, and observability and monitoring.
Visit our GitHub repository: https://github.com/Agenta-AI/agenta
As our fourth engineering hire, you will have full ownership over major product features. You will play a significant role in shaping our engineering team's culture and work closely with the founders.
Our backend uses Python+FastAPI, with MongoDB (and potentially Clickhouse) for our database. We use NextJS+React for our frontend and manage deployments with Kubernetes and Docker Compose for management. Our stack primarily runs on AWS using Terraform. You can check out our code at https://github.com/Agenta-AI/agenta
- Your work will significantly impact our customers.
- You will help build the company and product's foundation.
- There are massive growth opportunities, not only technically but also professionally.
- Public work exposure through contributions and collaborations on open-source projects.
- Designing a scalable observability architecture for tracing LLM calls and integrating it with OTel.
- Optimizing and enhancing the latency of our observability dashboard for analytics.
- Improving the design of our SDK for prompt management.
- You have 5+ years of experience in software development and broad knowledge in various technologies (AWS, CI/CD, Kubernetes…).
- Python is your second language
- You're a 10x Engineer, considered a top engineer in your previous roles.
- You possess excellent communication skills, both written and spoken.
- Experience in founding a startup or working in an early-stage startup.
- Experience in ML and building LLM applications.
- DevOps or infrastructure experience.
- Some frontend development knowledge (React, NextJS).
Hard Work Makes a Difference:
- While working extensive hours doesn't guarantee success, working too few can lead to failure. We value our work ethic and believe it makes a significant difference.
Ownership:
- Every engineer at Agenta plays both the role of a project manager and a developer. This encompasses designing features, interacting with customers, overseeing deployment, and managing bug reports.
- Opportunity to work on a challenging problem in a highly competitive market.
- A smart and talented team.
- Ownership and rapid growth opportunities.
- Competitive salary and significant equity in the company
Interested? Please contact us on [email protected]
Similar Jobs
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Build and operate Zeta's data compute infrastructure and lakehouse runtime. Implement features, optimize compute for Spark jobs, contribute patches to open-source stack (Spark, Iceberg, Hadoop, Airflow), mentor engineers, and collaborate with cross-site teams to improve reliability, cost-efficiency, and developer productivity.
Top Skills:
Apache AirflowApache IcebergSparkAws AthenaAws Ec2Aws S3HadoopJvmKubernetesScala
Digital Media • Information Technology • News + Entertainment
The Solutions Consultant identifies and engages enterprise prospects, demonstrating technical solutions, managing sales cycles, and expanding customer relationships in GRC and cyber risk.
Top Skills:
CybersecurityGrc FrameworksRisk ManagementSecurity Operations
Productivity • Software • App development • Automation
As a C++ Engineer, you will develop machine learning features, integrate models, maintain SDKs, and collaborate across teams for software performance and enhancements.
Top Skills:
AWSC++CmakeDockerGCPGitJenkinsNumpyOpencvPython
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
