Mercor Logo

Mercor

Mercor Research Fellowship — APEX

Posted 14 Days Ago
In-Office or Remote
Hiring Remotely in London, Greater London, England, GBR
Entry level
In-Office or Remote
Hiring Remotely in London, Greater London, England, GBR
Entry level
Design, build, and validate new AI benchmarks and evaluation methodologies. Fellows create task specifications and grading rubrics, collaborate with domain experts, run frontier models, analyze failures, test for contamination and gaming, and publish findings through papers, datasets, leaderboards, or internal methodologies. The fellowship provides mentorship, compute, expert labor, and access to enterprise evaluation problems.
The summary above was generated by AI
About Mercor

Mercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.

 

Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.

About the Fellowship

Mercor’s APEX benchmark family measures whether frontier AI models can actually do economically valuable work: multi-hour agentic tasks in investment banking and corporate law, real professional accounting workflows, real-world software engineering, and graduate-level science. Every APEX benchmark is built and validated with Mercor’s network of domain experts — not written from a textbook.

Alongside APEX, Mercor's economics team works to understand how AI is changing the labor market and tries to quantify its economic impacts. To do so, we leverage Mercor’s unique access to data, including: a marketplace with millions of candidates, internal AI usage metrics, enterprise data, and more.

The Mercor Research Fellowship funds people to build the next generation of benchmarks, evaluation techniques, and economic analyses of AI. You can pitch a benchmark or eval methodology you want to build — a new domain, a harder task format, a better way to measure agentic reliability — and if selected, you get the time, compute, expert labor, and mentorship to design, implement, and release it end to end. Or, on the economics side, you can pitch a study using Mercor’s proprietary data to better understand an aspect of AI’s impact on the economy and firms.

You’ll work directly with the APEX research team, get access to real enterprise evaluation problems from Mercor’s Fortune 500 and frontier-lab partners, and see your work shape how the industry measures AI capability.

Program Details

  • Duration: 3–6 months, rolling admission

  • Commitment: minimum 30 hours/week; full-time preferred

  • Location: remote, or in-person at Mercor’s San Francisco office

  • Admission: apply with a specific benchmark or eval technique you want to build — the fellowship is funded around your pitch, not a generic research rotation

What You’ll Do

  • Propose and scope a new benchmark evaluation technique, or economic study in an area not covered well by existing work

  • Build and validate it. For benchmarks, that means designing task specifications and grading rubrics with Mercor's network of vetted experts — lawyers, accountants, engineers, scientists, consultants — then piloting tasks, calibrating scoring, and running frontier models to analyze where and why they fail. For economic studies, this can mean anything from designing and running field experiments with experts on our platform to conducting empirical analyses of enterprise data.

  • Publish your results: a paper, an open dataset, a new leaderboard on APEX, or a methodology the team adopts internally — and partner with Mercor's research and engineering teams to fold what you learn back into our public work.

Focus Areas

  • Long-horizon, multi-app agentic tasks in professional services (law, finance, consulting) — extending APEX-Agents

  • Real-world software engineering evaluation beyond issue resolution — extending APEX-SWE

  • Professional accounting and finance workflows — extending APEX-Accounting

  • AI-for-Science evals: research-level mathematics, biology, materials science, and theoretical physics

  • New economic benchmarks — negotiation, management, and other capabilities that carry economic value but resist standard task formats

  • Novel evaluation methodology: contamination resistance, rubric design, human-vs-model grading agreement, cost-adjusted scoring

  • The economics of human data platforms like Mercor – pricing, matching, elasticity of supply and demand.

  • AI Theory of the Firm: what an AI-native firm looks like from the inside, and how work is actually organized within one, with a focus on empirical work.

  • Strong pitches outside this list are welcome — we fund the best ideas, not the closest fit to a template.

What We’re Looking For

  • Genuine interest in evaluation as a research discipline — not just a stepping stone to a model-building role.

  • Background in economics, CS, ML, statistics, or an adjacent field (measurement, psychometrics, HCI, social science)

  • A specific, well-scoped idea for a benchmark, eval technique, or empirical study you want to build — the fellowship is built around your pitch.

  • Comfortable in a startup environment: fast iteration, direct access to real customer problems, less hand-holding than an academic lab.

  • Able to commit at least 30 hours/week for the duration of the fellowship — during a leave, over a summer, or a flexible stretch of a PhD.

  • Bonus: experience with agentic evaluation, RL environments, or domain expertise in law, finance, medicine, or a scientific field.

Compensation & Benefits

  • 3-month stipend of $40,000 or 6-month stipend of $80,000

  • Unlimited API credits, plus a dedicated budget for GPU compute and paid expert/human-data time

  • Weekly 1:1 mentorship with a member of the APEX research team, plus regular access to the broader research org

  • Access to Mercor's marketplace and expert-network data for empirical work, subject to review

  • Access to frontier model APIs, Mercor’s internal evaluation infrastructure, and — where appropriate — real enterprise evaluation problems from Mercor’s customers

  • Optional desk in Mercor’s San Francisco office for fellows who want to be in person

  • Introductions to Mercor’s network of researchers across frontier labs and academia

  • Standout fellows are considered for a full-time offer on the APEX research team at the end of the fellowship

Similar Jobs

4 Hours Ago
Remote or Hybrid
Senior level
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Provide assistant-controller level accounting support for healthcare clients: manage month-end close, maintain general ledgers, prepare and review monthly reporting packages and KPIs, ensure balance sheet accuracy, update client procedure manuals, coordinate project tasks, and supervise/account-assign work to meet client needs and budgets.
Top Skills: Microsoft Office Suite
4 Hours Ago
Remote or Hybrid
Senior level
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Manage day-to-day lead routing, qualification, and CRM data quality in Microsoft Dynamics 365. Support campaign capture, attribution, tracking, reporting, and analysis. Collaborate with Marketing, Business Development, IT, and offshore teams to improve lead processes, implement CRM enhancements, and document operational procedures.
Top Skills: CRMMicrosoft Dynamics 365
7 Hours Ago
Remote or Hybrid
Junior
Junior
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handles inbound calls and warm leads to assess customers’ insurance needs, recommend appropriate Property & Casualty coverage, and convert prospects into policyholders. The role includes paid training and licensing, customer consultation, sales closing, and remote collaboration. Representatives must work a set weekday and weekend schedule, maintain a professional home workspace, and meet high-speed internet requirements.
Top Skills: Cable InternetDsl InternetFiber InternetPcWired High-Speed Internet

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account