Lead high-value AI data operations projects from client specifications through delivery. Responsibilities include optimizing workflows and pipelines, managing quality and cost, coordinating over 1,000 distributed contributors, recruiting and training domain experts, maintaining client relationships, and providing frequent progress reporting. The role requires hands-on execution in a fast-paced, high-pressure environment with occasional weekend responsiveness.

Design, build, and validate new AI benchmarks and evaluation methodologies. Fellows create task specifications and grading rubrics, collaborate with domain experts, run frontier models, analyze failures, test for contamination and gaming, and publish findings through papers, datasets, leaderboards, or internal methodologies. The fellowship provides mentorship, compute, expert labor, and access to enterprise evaluation problems.

Source, vet, and recruit specialized experts using LinkedIn and other channels; scale sourcing pipelines; build and maintain expert relationships; collaborate cross-functionally to improve workflows; and drive growth by delivering qualified talent at scale.