Evaluate and compare AI/LLM-generated legal responses against a standardized rubric. Assess legal accuracy, reasoning, completeness, relevance, and commercial risk. Identify errors and differences, provide concise written feedback, and deliver consistent, objective evaluations on schedule.
This role is for one of our clients
Compensation: $150-$160 per hour
We are seeking experienced in-house legal counsel based in the United Kingdom to support a legal AI benchmarking initiative focused on evaluating how effectively AI systems handle real-world questions involving UK law.
As an expert reviewer, you will assess responses generated by two AI platforms, compare their legal reasoning and conclusions, and evaluate each response against a standardized rubric. Your professional expertise will help establish reliable benchmarks for the quality, accuracy, and practical relevance of AI-generated legal work.
RequirementsKey Responsibilities
- Run identical legal prompts across two AI/LLM platforms.
- Review and compare AI-generated legal responses side by side.
- Evaluate each response against a standardized assessment rubric.
- Assess legal accuracy, reasoning quality, completeness, relevance, and practical applicability.
- Identify material differences, omissions, inconsistencies, and potential legal inaccuracies.
- Provide concise, precise, and well-reasoned written feedback for every evaluation.
- Apply evaluation criteria consistently and objectively across assigned tasks.
- Complete assignments independently while adhering to project guidelines and deadlines.
- 5+ years of experience as in-house legal counsel practicing in the United Kingdom.
- Strong command of UK law, particularly commercial and contract matters.
- Practical experience advising businesses and assessing real-world legal and commercial risks.
- Excellent attention to detail and strong analytical judgment.
- Exceptional written English and the ability to communicate complex legal concepts clearly and concisely.
- Ability to distinguish legally accurate analysis from plausible but incorrect or incomplete reasoning.
- Comfortable working independently with structured evaluation rubrics.
- Strong ability to manage deadlines and consistently deliver high-quality assessments.
- Initial Commitment: Approximately 10 hours
- Potential: Strong possibility of additional work based on project requirements and performance
- Work Arrangement: Fully remote
- Confidentiality: All project work will be subject to applicable confidentiality requirements and NDA obligations.
- Engagement Type: Independent contractor
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms- This is a fully remote engagement that can be completed on a flexible schedule.
- Projects may be extended, shortened, or concluded early depending on project requirements and performance.
- Work will not require access to confidential or proprietary information belonging to any employer, client, or institution.
- Payments are made weekly based on services rendered through supported payment platforms.
Similar Jobs
Productivity • Software • App development • Automation
Manage and close high-value B2B software license opportunities across the DACH region. Responsibilities include expanding existing accounts, cross-selling products, conducting roadmap discussions, partnering with solution engineers, developing account strategies, analyzing market and competitive intelligence, and achieving sales quotas. The role requires consultative engagement with enterprise clients and technical executives, German and English fluency, CRM proficiency, and occasional travel.
Top Skills:
DoolyLinkedin Sales NavigatorOutreachSalesforce CRMZoominfo
AdTech • Artificial Intelligence • Big Data • Machine Learning • Marketing Tech • Mobile • Software
Drafts, reviews, and negotiates vendor, customer, licensing, and insertion order contracts. Collaborates with Legal, Commercial, Sales, Product, Engineering, Finance, and Accounting teams on contractual matters. Maintains contract workflows, tracks milestones, supports compliance and approvals, improves templates, trains employees, and monitors relevant laws. The role is UK-based or remote within the UK and is offered initially as a contract position.
Top Skills:
Contract Management Software
Cloud • Security • Software • Cybersecurity • Automation
Leads GitLab’s distributed EMEA Deal Desk team and owns regional quoting, pricing, order management, and sales-booking operations. The role manages hiring and enablement, handles complex transactions and escalations, advises Sales leadership on pricing and commercial strategy, and ensures alignment with global policies. It also develops executive insights on deal quality, discounts, cycle times, exceptions, and pricing effectiveness while coordinating downstream billing, fulfillment, revenue recognition, and customer execution.
Top Skills:
AICpqCRMSaaS
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
