White Circle Logo

White Circle

Research Engineer (Evals)

Reposted One Month Ago
Be an Early Applicant
Hybrid
London, Greater London, England, GBR
Mid level
Hybrid
London, Greater London, England, GBR
Mid level
Build, own, and maintain internal benchmark suites for single- and multi-turn content and agentic guardrails; create benchmarks distinguishing model capabilities; extend evals to new verticals and product features; collaborate on research quantifying realistic LLM and agent failure modes; support product integration of core model functionality.
The summary above was generated by AI

TL;DR: We're looking for a research engineer to build and maintain our internal suite of benchmarks, covering single/multi-turn content and agentic guardrails. The research engineer would also work with the team on projects studying agent behaviours in the wild.

About us

White Circle is an AI Safety company building the safety, reliability, and optimization layer for AI systems. At the core of our platform are policies – simple natural-language rules that define what an AI model should and shouldn’t do. We automatically test, enforce, and continuously improve these policies at scale.

  • We’ve recently raised our Series A funding round, taking our total funding to $70M. Our investors include top funds, founders, and senior leaders at OpenAI, Anthropic, HuggingFace, Mistral, DeepMind, Datadog, Sentry, and others

  • We process over 100M+ API calls every month

  • We fine-tune and train our own LLMs so they run faster and cheaper than any open or proprietary model

We’re a small, highly focused team. If you want to work deeply on hard problems, see your work ship to production quickly, and influence how AI safety is actually built – you’re the one we need.

About the team

White Circle's fundamental research team works on the science of how AI systems fail in the real world: where agents break, how misalignment actually looks like to the end user, and how it is present in the model internals. We build the evals, benchmarks, environments, and tooling that empirically study high-impact agent reliability concerns — some of which become the guardrails shipped in our products, and some of which become public writeups.

What you’ll do

Own and maintain our internal benchmark suite, covering single/multi-turn content guardrails and agentic safety.

  • Build benchmarks that distinguish specific model capabilities.

  • Work with the product team to build evals covering core functionality of our flagship models.

  • Build benchmarks for new features coming out of the research team.

  • Adapt and extend evals to new verticals and changing product data.

  • Work on research projects that study and quantify realistic agentic and LLM failure modes in the wild.

You’ll fit right in if you

  • Have built an LLM benchmark from scratch that distinguished specific model capabilities (i.e., produced a measurable, defensible capability difference, not just a score).

  • Have built synthetic data for post-training textual or multimodal models.

  • Can reproduce a published benchmark result and identify where the original methodology is fragile or misleading.

  • You write Python that other people can build on. Our whole stack is Python; we want someone who has shipped and maintained production code and who factors messy problems into clean abstractions others can extend.

  • You can write efficient LLM inference setups, including sensible orchestration of parallel calls, retries, rate-limit handling.

  • An AI power-user — fluent with frontier models and coding agents day to day.

A big plus

  • Automated red-teaming experience

  • Have worked across a range of agentic scaffolds and reproduced public benchmark results on them

  • Strong knowledge of existing reward-model / monitoring / safety benchmarks

  • One or more published papers in the evals / safety-evaluation space

Compensation & benefits

  • Competitive compensation, including equity

  • Flexible time off

  • Office in central London/Paris with flexible hybrid setup

  • Relocation support if you’re moving to Paris, available after your probationary period

  • Premium private health insurance

  • Mental health support, including coverage for therapy when you need it

  • Lunch and dinner covered when you work from the office

  • Learning and development support for courses, conferences, and opportunities to grow your skills

  • All the hardware, subscriptions, tools, and services you need

  • Team off-sites twice a year: we’ve recently been to the Alps, Saint-Tropez, and Marbella

Process

  1. Intro call with Talent

  2. Test assignment

  3. Technical interview with Head of Fundamental Research

  4. Final interview with CEO

Similar Jobs

9 Hours Ago
Hybrid
Internship
Internship
eCommerce • Information Technology • Retail • Software
Support and progressively own seller onboarding on Mirakl Connect, guide users through onboarding and enablement, troubleshoot and optimize catalogs using Catalog Transformer, create documentation, and identify automation opportunities. Collaborate with Sales, Product, Support, and Data Science/AI teams to improve seller experience. The role requires strong communication, organization, project management, technology interest, and professional English proficiency.
Top Skills: AIAPIsCatalog TransformerConfluenceDustGongGoogle WorkspaceMirakl ConnectSalesforce
Yesterday
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Leads the strategy, delivery, scaling, governance, and adoption of agentic AI products across Pfizer’s regulated manufacturing network. Owns product roadmaps, agent lifecycles, evaluation frameworks, responsible AI controls, value realization, and stakeholder engagement. Partners with manufacturing, engineering, data, quality, cybersecurity, and site leadership teams to transform operational knowledge into intelligent digital products and scale successful capabilities globally.
Top Skills: Advanced AnalyticsAgentic AiAi AgentsAi OrchestrationCloud Data PlatformsDigital Operations Centre (Doc)HistoriansLimsLlmopsMesMlopsPlant ConnectivityScadaSerialization
Yesterday
In-Office
Senior level
Senior level
Artificial Intelligence • Cloud • Information Technology • Consulting
Senior Account Manager responsible for hunting new business across approximately 200 Île-de-France strategic accounts. The role involves prospecting and closing complex B2B IT sales, developing territory strategy, managing long sales cycles with C-level stakeholders, leveraging technology and integration partners, maintaining Salesforce and Clari pipelines, forecasting accurately, and representing HPE at regional technology events.
Top Skills: Challenger SaleClariCloud ComputingCybersecurityIt InfrastructureMeddpiccSaaSSalesforceSpin Selling

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account