AI Evaluation

Physics Quality Assurance Lead (QAL)

Status: Open

SME Careers

Pay
$75/hr
Location
Remote — India, The United States
Employment type
Contractor

About this opportunity

In this hourly, remote contractor role, you will work as a Physics Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across physics AI training projects. You will review AI-generated physics content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure contributors follow expected quality standards. You will assess work for scientific accuracy, physical reasoning, calculation correctness, unit consistency, formula use, conceptual clarity, experimental understanding, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your physics quality leadership will directly help improve the world’s premier AI models by ensuring that physics training data is accurate, physically sound, clearly explained, well-documented, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter.

Required skills

  • thermodynamics
  • Mechanics
  • Physics QA
  • Scientific review
  • Physics
  • Electromagnetism
  • AI Training
  • Trainer Feedback
  • quantum mechanics
  • LLM evaluation

What you'll do

  • Spot-check physics items, identify quality issues, provide feedback through DMs, and escalate recurring or critical issues.
  • Review AI-generated physics explanations, calculations, diagrams, derivations, experimental interpretations, and step-by-step reasoning.
  • Update trainers/QAs on Discord about guidelines, workflow updates, and physics-specific quality expectations.
  • Respond to questions around physical assumptions, formulas, units, derivations, diagrams, experimental setups, and rubric interpretation.
  • DM inactive contributors, encourage activation, track follow-ups, and flag availability issues.
  • Create and maintain physics documentation, style guides, trackers, FAQs, examples, honeypots, and onboarding materials.
  • Run onboarding/training calls for physics contributors.
  • Flag misleading, numerically incorrect, physically impossible, unsafe, or poorly contextualized physics claims.
  • Identify recurring quality gaps and improve physics QA workflows.

Requirements

  • Bachelor’s, Master’s, or PhD degree in Physics, Applied Physics, Engineering Physics, Astrophysics, Mathematics, Engineering, or a closely related quantitative/scientific field.
  • Strong grasp of the English language to follow guidelines, communicate with teams, and provide clear technical feedback.
  • 3+ years of experience in physics research, teaching, tutoring, laboratory work, science writing, academic review, engineering analysis, or related scientific workflows.
  • Strong understanding of classical mechanics, electromagnetism, waves, optics, thermodynamics, statistical mechanics, quantum mechanics, relativity, units, dimensional analysis, and mathematical modeling.
  • Ability to evaluate physics content against rubrics and identify issues such as incorrect assumptions, wrong formulas, unit errors, flawed reasoning, sign convention mistakes, physically impossible claims, or misleading explanations.
  • Familiarity with tools or methods such as Python, MATLAB, Mathematica, LaTeX, laboratory methods, data analysis, simulations, scientific visualization, and numerical methods is preferred.
  • Experience leading or supporting remote teams of educators, reviewers, researchers, annotators, science writers, or QAs is strongly preferred.
  • Comfortable with Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
  • Highly organized and able to maintain style guides, FAQs, trackers, onboarding materials, honeypots, calibration tasks, and documentation.
  • Experience with AI training, data annotation, LLM evaluation, scientific QA, academic review, or rubric-based review is a strong plus.
  • Native fluency in Punjabi

Compensation

Rates by country (hourly): India: up to USD 20; The United States: up to USD 75

Not the right fit? These open roles are close matches. Browse all AI gigs →

Expert WorkSME Careers

Accountant

In this hourly, remote contractor role, you will work as an Accounting Subject Matter Expert (SME) to review AI-generated accounting and finance responses and/or create expert accounting content, evaluating reasoning quality and step-by-step problem-solving while providing precise written feedback. You will assess solutions for accuracy, clarity, completeness, and adherence to the prompt; identify errors in bookkeeping logic, journal entries, accruals, reconciliations, financial statement presentation, and controls; fact-check technical accounting claims; write high-quality explanations and model solutions that demonstrate correct methods; and rate and compare multiple responses based on correctness and reasoning quality. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — Austria, Bangladesh, Belgium, Bhutan, Brazil, Cambodia, Denmark, Finland, France, Germany, Gibraltar, Greece, Iceland, India, Indonesia, Ireland, Italy, Liechtenstein, Luxembourg, Malaysia, Malta, Monaco, Nepal, Norway, Pakistan, Portugal, San Marino, Singapore, Spain, Sri Lanka, Sweden, Switzerland, Thailand, the Netherlands, The Philippines, The United Kingdom, The United States, Timor Leste, Vietnam

Status: Open

$65/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
Expert WorkSME Careers

Advertising Expert

In this hourly, remote contractor role, you will work as an Advertising Subject Matter Expert (SME) to review AI-generated advertising outputs and/or create expert ad copy and campaign assets, evaluating reasoning quality, strategy alignment, and step-by-step creative decision-making while providing precise written feedback. You will assess solutions for clarity, persuasion, brand fit, platform fit, and adherence to the prompt; identify issues in audience targeting logic, messaging hierarchy, offer framing, hooks/CTAs, compliance/claims risk, and creative-testing strategy; fact-check claims where needed; write high-quality explanations and model deliverables (ads, variations, briefs) that demonstrate best practices; and rate and compare multiple responses based on effectiveness, correctness, and reasoning quality. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — Bangladesh, Bhutan, Brazil, Cambodia, Germany, India, Indonesia, Malaysia, Nepal, Pakistan, Singapore, Sri Lanka, Thailand, The Philippines, The United States, Timor Leste, Vietnam

Status: Open

$70/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
Expert WorkSME Careers

Arabic Language Expert

You will review AI-generated Arabic and English responses and/or generate high-quality bilingual training content, evaluating reasoning quality and step-by-step problem-solving while providing expert feedback that helps models produce answers that are accurate, logical, and clearly explained. You will assess solutions for accuracy, clarity, and adherence to the prompt; identify errors in methodology or conceptual understanding; fact-check information; write high-quality explanations and model solutions that demonstrate correct methods; and rate and compare multiple AI responses based on correctness and reasoning quality. This is an hourly paid, fully remote contractor role with flexible work-from-anywhere hours. This job is with SME Careers (a subsidiary of SuperAnnotate), a fast-growing AI Data Services company providing training data for many of the world’s largest AI companies and foundation model labs—your work directly helps improve the world’s premier AI models. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — Egypt, Saudi Arabia, South Africa

Status: Open

$15/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)