Jobs at Anyone AI

Design and own frontier evaluation methodology and benchmarks for LLMs across reasoning, coding, agents, tool use, and multi-modal tasks. Build expert-verified benchmark packages, recruit and calibrate subject-matter experts, act as technical liaison to labs, and deliver lab-ready pilot evaluation packages with rigorous QC and validation.

We seek Quantitative Finance Experts to train and evaluate AI models, ensuring accuracy in AI-generated responses through extensive analytical review.

Design rigorous, deterministic advanced mathematics problems and verified solutions to evaluate and train state-of-the-art AI models. Produce reproducible computational workflows (using Python and scientific libraries), document clear reasoning in English, and create problems that test deep mathematical reasoning rather than memorization. Contract, part-time role (20 hrs/week) with immediate start.

Design and evaluate realistic multi-file software engineering tasks: bug fixes, feature implementations, refactors, migrations, and test generation. Write specifications and reference implementations, extend unit/integration tests, review peer submissions, identify edge cases, and ensure alignment between specs, code, and expected outputs. Part-time, project-based consultant role, remote.