AI Evaluation Rubric Reviewer
Status: Open
- Pay
- $40–$75/hr
- Location
- Remote
- Employment type
- Contractor
- Hours
- 15 hrs/week
- Posted
- 2026-11-16
Status: Open
Not the right fit? These open roles are close matches. Browse all AI gigs →
Role Overview Mercor is hiring experienced FP&A professionals to build and review evaluation tasks for AI agents. Each task is set in a realistic simulated company, with the budgets, forecasts, models, emails and business apps a finance team really uses. You make sure each task reads like a real request, the reference answer holds up against the source data, and the grading rubric checks what a senior FP&A lead would check. Key Responsibilities Refine AI-drafted task prompts so they read like a real request from a CFO or business partner, without giving the answer away. Check reference models and outputs against the world's files and app records, and correct what is wrong. Write and tighten grading rubrics: pass/fail criteria with exact values, plus the judgment calls a generalist would miss. Read how leading AI models attempt each task and confirm they fail for fair, defensible reasons. Work across annual budgeting and long-range planning, rolling, revenue, cash-flow and headcount forecasts, variance analysis and KPI reporting, board and investor reporting, three-statement and scenario modeling, and business partnering on pricing and cost decisions. Ideal Qualifications 3+ years of hands-on FP&A experience (Analyst, Senior Analyst, Manager or above). Time in the field matters more than title. Bachelor's degree in finance, accounting, economics or a related field. Ownership of budgeting or forecasting cycles, strong driver-based and scenario modeling, and fluency in a planning tool such as Anaplan, Adaptive or Planful. CFA, MBA or CPA is a plus, as is prior experience on a Mercor RL project. Details Pay: $100/hour. You start with a short onboarding session and a paid skills assessment. Once you pass, you can claim your first task right away. Strong performers can move into reviewer and world lead roles.
Status: Open
$100/hr
Verified Nov 15, 2026
Role Overview Mercor is hiring experienced investment bankers to build and review evaluation tasks for AI agents. Each task is set in a realistic simulated bank or deal team, with the filings, models, data-room documents, emails and deal tools bankers really work from. You make sure each task reads like a real request, the reference model and outputs hold up against the source documents, and the grading rubric checks what a VP or MD would check. Key Responsibilities Refine AI-drafted task prompts so they read like a real request from a deal team or client, without giving the answer away. Check reference models and outputs against the world's files and app records, and correct what is wrong. Write and tighten grading rubrics: pass/fail criteria with exact values, plus the judgment calls a generalist would miss. Read how leading AI models attempt each task and confirm they fail for fair, defensible reasons. Work across sell-side and buy-side M&A, purchase-price mechanics and diligence, comps, precedents, DCF, LBO and merger models, IPOs and follow-ons, debt capital markets and leveraged finance, restructuring and liability management, and sector coverage from FIG and healthcare to TMT, consumer, industrials and energy. Ideal Qualifications 3+ years in investment banking (Analyst, Associate, VP or above). Time in the industry matters more than title. Bulge-bracket or elite-boutique experience preferred. Hands-on valuation and transaction modeling (DCF, LBO, comps) in M&A, ECM / DCM, leveraged finance or restructuring. Bachelor's degree or higher in business, economics, finance, accounting or a related field. Prior experience on a Mercor RL project is a plus. Details Pay: $110/hour. You start with a short onboarding session and a paid skills assessment. Once you pass, you can claim your first task right away. Strong performers can move into reviewer and world lead roles.
Status: Open
$110/hr
Verified Nov 15, 2026
Role Overview Mercor is hiring experienced HR professionals to build and review evaluation tasks for AI agents. Each task is set in a realistic simulated company, with the policies, employee records, case files, emails and HR systems a people team really uses. You make sure each task reads like a real request, the reference answer holds up against the source records, and the grading rubric checks what a senior HR leader would check. Key Responsibilities Refine AI-drafted task prompts so they read like a real request from an HR director or manager, without giving the answer away. Check the reference answer against the world's files and app records, and correct what is wrong. Write and tighten grading rubrics: pass/fail criteria with exact values, plus the judgment calls a generalist would miss. Read how leading AI models attempt each task and confirm they fail for fair, defensible reasons. Work across talent acquisition and onboarding, performance management and succession, compensation, benefits and leave, employee relations and workplace investigations, separations, HR policy and employment-law compliance, people analytics, and organization design. Ideal Qualifications 3+ years of HR experience. A leadership title or major-company background is a plus, but time in the field matters more. Bachelor's degree in human resources, business or a related field. Ownership of talent programs, employee-relations matters or compensation design, and working knowledge of employment law (Title VII, FLSA, ADA, or UK / EU equivalents). SHRM-SCP, SPHR or an international equivalent strongly preferred. Prior experience on a Mercor RL project is a plus. Details Pay: $95/hour. You start with a short onboarding session and a paid skills assessment. Once you pass, you can claim your first task right away. Strong performers can move into reviewer and world lead roles.
Status: Open
$95/hr
Verified Nov 15, 2026