AI Evaluation Jobs & Gigs

Browse 49 currently open AI Evaluation opportunities. Availability can change quickly.

Open AI Evaluation opportunities

Showing 24 of 49 currently listed opportunities.

Browse all AI gigs →
AI EvaluationSME Careers

Legal Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as a Legal Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across legal AI training projects. You will review AI-generated legal content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for legal reasoning quality, issue spotting, jurisdictional awareness, citation and source handling, clarity, risk awareness, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong legal expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote legal-review teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your legal quality leadership will directly help improve the world’s premier AI models by ensuring that legal training data is accurate, well-reasoned, clearly explained, appropriately cautious, well-documented, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — The United States

Status: Open

$120/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Astronomer Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as an Astronomy / Astrophysics Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across astronomy and astrophysics AI training projects. You will review AI-generated astronomy/astrophysics content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for scientific accuracy, physical reasoning, mathematical correctness, terminology quality, unit handling, observational context, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong astronomy/astrophysics expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote expert teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your astronomy/astrophysics quality leadership will directly help improve the world’s premier AI models by ensuring that astronomy and astrophysics training data is accurate, physically sound, clearly explained, well-documented, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — The United States

Status: Open

$110/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Biomedical Engineering Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as a Biomedical Engineering Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across biomedical engineering AI training projects. You will review AI-generated biomedical engineering content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for technical accuracy, biomedical reasoning, calculation correctness, standards awareness, regulatory awareness, unit consistency, safety considerations, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong biomedical engineering expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote technical teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your biomedical engineering quality leadership will directly help improve the world’s premier AI models by ensuring that biomedical engineering training data is accurate, logically sound, clearly explained, well-documented, safety-aware, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter.

Contractor· Remote — The United States

Status: Open

$105/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Chemical Engineer Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as a Chemical Engineering Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across chemical engineering AI training projects. You will review AI-generated chemical engineering content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for technical accuracy, engineering reasoning, calculation correctness, unit consistency, process safety awareness, standards awareness, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong chemical engineering expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote technical teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your chemical engineering quality leadership will directly help improve the world’s premier AI models by ensuring that engineering training data is accurate, logically sound, clearly explained, well-documented, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter.

Contractor· Remote — The United States

Status: Open

$105/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Civil Engineer Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as a Civil Engineering Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across civil engineering AI training projects. You will review AI-generated civil engineering content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for technical accuracy, engineering reasoning, calculation correctness, standards awareness, unit consistency, safety considerations, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong civil engineering expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote technical teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your civil engineering quality leadership will directly help improve the world’s premier AI models by ensuring that engineering training data is accurate, logically sound, clearly explained, well-documented, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter.

Contractor· Remote — The United States

Status: Open

$105/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Electrical Engineer Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as an Electrical Engineering Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across electrical engineering AI training projects. You will review AI-generated electrical engineering content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for technical accuracy, engineering reasoning, circuit analysis correctness, calculation validity, standards awareness, unit consistency, safety considerations, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong electrical engineering expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote technical teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your electrical engineering quality leadership will directly help improve the world’s premier AI models by ensuring that engineering training data is accurate, logically sound, clearly explained, well-documented, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter.

Contractor· Remote — The United States

Status: Open

$105/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Chemical Safety Expert for AI Model Safety Audit

## Description SME Careers is hiring chemists and chemical safety professionals to audit how AI models respond to sensitive questions in the field. Each task gives you a user request and the answers three different models gave to it. You classify the request (benign, dual-use or adversarial), mark each answer as safe or unsafe and say why, rank the three against each other, and write the answer the model should have given. For dual-use requests you also note what makes it sensitive, what legitimate purpose it serves, and who should be able to get an answer. The requests are realistic: what synthetic and analytical chemists, toxicologists, industrial hygienists, process safety engineers, regulators and occasionally bad actors actually ask. Some are ordinary professional questions that models wrongly refuse, and catching those matters as much as catching the dangerous ones. ## Who we're looking for Synthetic and analytical chemists; toxicologists and pharmacologists; industrial hygienists and chemical safety/process safety professionals; CWC or chemical-security specialists; hazmat, poison-control or chemical incident responders; and chemical regulators (EPA, OSHA, HSE, OPCW-adjacent, or equivalent). Usually a relevant degree plus five or more years of professional experience. Experience with safety data sheets, exposure assessment, incident reports or regulatory review is a strong plus. ## Before you apply Open only to citizens or permanent residents of the US, UK, Canada, Australia, New Zealand and the European Union.

Full-time· Remote — Australia, Austria, Belgium, Bulgaria, Canada, Croatia, Cyprus, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, New Zealand, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden, The Czech Republic, the Netherlands, The United Kingdom, The United States

Status: Open

$100/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Explosives & Energetic Materials Expert for AI Safety Audit

## Description SME Careers is hiring explosives and energetic materials professionals to audit how AI models respond to sensitive questions in the field. Each task gives you a user request and the answers three different models gave to it. You classify the request (benign, dual-use or adversarial), mark each answer as safe or unsafe and say why, rank the three against each other, and write the answer the model should have given. For dual-use requests you also note what makes it sensitive, what legitimate purpose it serves, and who should be able to get an answer. The requests are realistic: what mining and blasting engineers, pyrotechnicians, propellant chemists, bomb technicians, investigators and occasionally bad actors actually ask. Some are ordinary professional questions that models wrongly refuse, and catching those matters as much as catching the dangerous ones. ## Who we're looking for Commercial blasting engineers and mining/quarry explosives specialists; military or police EOD and bomb technicians; energetic materials, propellant or pyrotechnics chemists; post-blast investigators and forensic examiners; explosives safety officers and regulators (ATF, HSE, DoD explosives safety, or equivalent). Usually a relevant degree or certification plus five or more years of hands-on professional experience. Experience writing incident reports, safety cases or expert opinions is a strong plus. ## Before you apply Open only to citizens or permanent residents of the US, UK, Canada, Australia, New Zealand and The European Union

Full-time· Remote — Australia, Austria, Belgium, Bulgaria, Canada, Croatia, Cyprus, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, New Zealand, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden, The Czech Republic, the Netherlands, The United Kingdom, The United States

Status: Open

$1–$100/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationMicro1

QA & Source Inspection

Role Title: QA & Source Inspection Role Type: Contractor Location: Remote micro1 is engaging QA & Source Inspection professionals to contribute their expertise to a dynamic customer project spanning aerospace, defense, and marine sectors. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. Scope of Work - Evaluate and disposition First Article Inspections (AS9102) for compliance with regulatory and customer requirements. - Assess cosmetic defect acceptance in manufacturing and assembly contexts, documenting detailed justifications for acceptance or rejection. - Conduct virtual surveys and provide input on hull & marine structures based on provided documentation and data. - Analyze web/line inspection data to identify quality trends and inform source inspection recommendations. - Apply knowledge of Government Source Inspection, including DCMA protocols and FAR Part 46 requirements, to simulated scenarios. - Deliver clear, concise written and verbal feedback on inspection findings to support AI model development. - Generate high-quality reports and data sets reflecting your expert judgments and rationale. Preferred Qualifications - 8+ years conducting complex quality inspections, with significant experience in first article, cosmetic, or production line disposition calls. - Deep familiarity with AS9102 First Article standards and the practical application of government inspection criteria (DCMA, FAR Part 46). - Background in US defense or aerospace manufacturing, or marine surveying with exposure to regulated environments. - Demonstrated expertise in Hull & Marine Survey processes and standards. - Strong written and verbal communication skills, including the ability to clearly document disposition decisions and explain technical rationale. - Proficiency in digital tools for documentation, reporting, and remote collaboration. - Experience as a senior QA inspector, supplier quality engineer, DCMA QAR, or marine surveyor is strongly preferred.

Contractor· Remote

Status: Open

$60–$100/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Red-Teaming Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as a Red-Teaming Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across AI red-teaming and safety-evaluation projects. You will review AI-generated safety evaluations, adversarial prompts, risk analyses, and trainer/QA work; evaluate output quality against project guidelines; provide precise written feedback; and ensure that all contributors follow the expected quality standards. You will assess work for risk identification, adversarial reasoning, policy awareness, safety taxonomy alignment, prompt quality, scenario realism, vulnerability coverage, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong AI safety/red-teaming judgment, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote expert teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your red-teaming quality leadership will directly help improve the world’s premier AI models by ensuring that safety training data is realistic, nuanced, policy-aligned, well-documented, and useful for identifying model vulnerabilities. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — The United States

Status: Open

$100/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationMicro1

Research Engineer - Code Generation & Model Evaluation

Role Title: Research Engineer - Code Generation & Model Evaluation Role Type: Contractor Location: Remote micro1 is engaging Research Engineers to participate in a project focused on code generation and model evaluation for a customer's initiative. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. Scope of Work - Analyze, debug, and resolve issues across diverse codebases written in Python3, Java, Rust, C++, Go, or TypeScript. - Contribute to the design and implementation of new features and enhancements for code generation workflows. - Refactor and optimize codebases to improve performance, maintainability, and adaptability. - Develop and review real-world coding tasks to evaluate AI model performance and accuracy. - Author clear, actionable feedback and annotations to support model training and assessment. - Collaborate with other open-source contributors and technical stakeholders to set technical direction and ensure robust outputs. - Document technical decisions, best practices, and solutions to drive project transparency and knowledge sharing. Required Skills and Qualifications: - Expertise in competitive programming and coding problem analysis. - Expertise in at least one of: Python3, Java, Rust, C++, Go, or TypeScript, with solid knowledge of algorithms and data structures. - Proven track record of open-source contributions or participation in collaborative software projects. - Strong analytical abilities to interpret complex problem constraints and multiple solution paths. - Exceptional written and verbal communication skills; ability to articulate technical details clearly. - Meticulous attention to detail in code validation and output consistency. - Experience working independently in a remote, collaborative environment. - Commitment to producing high-quality, well-documented code under tight deadlines. Compensation Structure Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week. Start Timeline & Availability We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.

Contractor· Remote

Status: Open

$50–$100/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationMicro1

Senior Hospitalist Clinical Reviewer

Role Title: Senior Hospitalist Clinical Reviewer Role Type: Contractor Location: Remote micro1 is engaging Senior Hospitalist Clinical Reviewers to contribute to a high-impact project with a customer focused on inpatient quality and documentation. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. This is a unique opportunity for experts who care deeply about clinical excellence and enjoy articulating nuanced clinical reasoning and judgment in both written and verbal formats. Scope of Work - Review inpatient cases for clinical quality, documentation accuracy, and appropriate care. - Use clinical judgment to identify unclear, complex, or unusual cases. - Provide clear feedback and explain the reasoning behind your decisions. - Help improve guidelines and review standards used to train AI models. - Document findings clearly and support decisions with clinical standards when needed. - Work with the project team to clarify difficult cases and questions. - Help maintain high-quality and consistent review standards. Preferred Qualifications - MD or DO with 10+ years of attending-level hospitalist experience. - Experience with clinical quality, documentation review, medical auditing, or QA. - Strong clinical judgment and ability to make clear decisions on complex or ambiguous cases. - Strong written and verbal communication skills. - Experience leading or contributing to inpatient quality, documentation improvement, or coding/QA programs is a plus. - Experience with hospital quality assurance or medical audit processes. - Comfortable working independently in a remote environment.

Contractor· Remote

Status: Open

$70–$100/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Medical Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as a Medicine Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across medical AI training projects. You will review AI-generated medical content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for medical accuracy, clinical reasoning quality, guideline awareness, patient-safety awareness, terminology correctness, clarity, risk sensitivity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong medical expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote medical-review teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your medical quality leadership will directly help improve the world’s premier AI models by ensuring that medical training data is accurate, clinically sound, clearly explained, appropriately cautious, safety-aware, well-documented, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — The United States

Status: Open

$95/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Economics Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as an Economics Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across economics-focused AI training projects. You will review AI-generated economics content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for economic accuracy, model reasoning, assumptions, data interpretation, calculation correctness, graph interpretation, policy nuance, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong economics expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote expert teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your economics quality leadership will directly help improve the world’s premier AI models by ensuring that economics training data is accurate, analytically sound, well-explained, assumption-aware, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — India, The United States

Status: Open

$90/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Financial Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as a Finance Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across finance AI training projects. You will review AI-generated finance content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for financial accuracy, analytical reasoning, calculation correctness, terminology quality, market and accounting awareness, risk sensitivity, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong finance expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote finance-review teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your finance quality leadership will directly help improve the world’s premier AI models by ensuring that finance training data is accurate, logically sound, clearly explained, appropriately cautious, well-documented, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — India, The United States

Status: Open

$90/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Neuroscience Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as a Neuroscience / Cognitive Science Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across neuroscience and cognitive science AI training projects. You will review AI-generated neuroscience/cognitive science content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for scientific accuracy, conceptual precision, research literacy, experimental-method understanding, brain-behavior reasoning, statistical caution, ethical awareness, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong neuroscience/cognitive science expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote expert teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your neuroscience/cognitive science quality leadership will directly help improve the world’s premier AI models by ensuring that scientific training data is accurate, evidence-aware, ethically appropriate, clearly explained, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — The United States

Status: Open

$90/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Nuclear & Radiological Safety Expert for AI Model Audit

## Description SME Careers is assembling a small panel of nuclear and radiological professionals to audit how AI models respond to sensitive questions in the field. Each task gives you a user request and the answers three different models gave to it. You classify the request (benign, dual-use or adversarial), mark each answer as safe or unsafe and say why, rank the three against each other, and write the answer the model should have given. For dual-use requests you also note what makes it sensitive, what legitimate purpose it serves, and who should be able to get an answer. The requests are realistic: the kinds of things reactor engineers, health physicists, regulators, students and occasionally bad actors actually ask. Some are ordinary professional questions that models wrongly refuse, and catching those matters as much as catching the dangerous ones. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your nuclear physics expertise directly helps improve the world’s leading AI models by making their nuclear science, radiation, and physics outputs more accurate, safe and reliable. ## Who we're looking for Nuclear engineers and reactor physicists, safeguards and nonproliferation specialists (IAEA, NRC or equivalent, export control, national labs), health physicists and radiation safety officers, radiochemists, and former military or government nuclear personnel. Usually a relevant degree plus five or more years of professional experience. Experience reviewing technical work against a standard (licensing, inspection, peer review) or AI red teaming is a strong plus. ## Before you apply This role is open only to citizens or residents of the US, UK, Canada, Australia, New Zealand and the European Union.

Contractor· Remote — Australia, Austria, Belgium, Bulgaria, Canada, Cyprus, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Latvia, Luxembourg, Malta, New Zealand, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden, The Czech Republic, the Netherlands, The United Kingdom, The United States

Status: Open

$90/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Psychology Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as a Psychology Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across psychology-focused AI training projects. You will review AI-generated psychology content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for psychological accuracy, theory application, research literacy, ethical awareness, mental-health safety, diagnostic caution, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong psychology expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote expert teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your psychology quality leadership will directly help improve the world’s premier AI models by ensuring that psychology training data is accurate, ethical, appropriately cautious, research-informed, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — The United States

Status: Open

$80/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Tax and Audit Expert

In this hourly, remote contractor role, you will work as a Tax & Audit Subject Matter Expert (SME) to review AI-generated tax and audit responses and/or create expert accounting content, evaluating reasoning quality and step-by-step problem-solving while providing precise written feedback. You will assess solutions for accuracy, clarity, completeness, and adherence to the prompt; identify errors in tax treatment, compliance logic, audit methodology, risk assessment, internal controls, and financial reporting linkages; fact-check technical claims; write high-quality explanations and model solutions that demonstrate correct methods; and rate and compare multiple responses based on correctness and reasoning quality. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — Bangladesh, Bhutan, Brazil, Cambodia, Germany, India, Indonesia, Malaysia, Nepal, Pakistan, Singapore, Sri Lanka, Thailand, The Philippines, The United States, Timor Leste, Vietnam

Status: Open

$80/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Architecture and Design Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as an Architecture / Design Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across architecture, interior design, urban design, and built-environment AI training projects. You will review AI-generated architecture/design content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for design accuracy, spatial reasoning, architectural terminology, building-systems awareness, code/safety sensitivity, sustainability considerations, visual/design logic, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong architecture/design expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote expert teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your architecture/design quality leadership will directly help improve the world’s premier AI models by ensuring that architecture and design training data is accurate, context-aware, visually coherent, practical, well-explained, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — The United States

Status: Open

$75/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Biology Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as a Biology Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across biology AI training projects. You will review AI-generated biology content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for scientific accuracy, biological reasoning, terminology correctness, experimental logic, unit consistency, safety awareness, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong biology expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote technical teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your biology quality leadership will directly help improve the world’s premier AI models by ensuring that biology training data is accurate, logically sound, clearly explained, safety-aware, well-documented, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — The United States

Status: Open

$75/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Chemistry Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as a Chemistry Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across chemistry AI training projects. You will review AI-generated chemistry content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for scientific accuracy, chemical reasoning, calculation correctness, reaction logic, unit consistency, safety awareness, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong chemistry expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote technical teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your chemistry quality leadership will directly help improve the world’s premier AI models by ensuring that chemistry training data is accurate, logically sound, clearly explained, safety-aware, well-documented, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter.

Contractor· Remote — The United States

Status: Open

$75/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Mathematics Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as a Mathematics Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across mathematics AI training projects. You will review AI-generated math content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for mathematical accuracy, logical reasoning, calculation correctness, proof validity, notation quality, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong mathematics expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote technical teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your mathematics quality leadership will directly help improve the world’s premier AI models by ensuring that math training data is accurate, logically sound, clearly explained, well-documented, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter.

Contractor· Remote — India, The United States

Status: Open

$75/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI EvaluationSME Careers

Mechanical Engineer Quality Assurance Lead (QAL)

In this hourly, remote contractor role, you will work as a Mechanical Engineering Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across mechanical engineering AI training projects. You will review AI-generated mechanical engineering content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for technical accuracy, engineering reasoning, calculation correctness, standards awareness, clarity, safety considerations, unit consistency, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong mechanical engineering expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote technical teams. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your mechanical engineering quality leadership will directly help improve the world’s premier AI models by ensuring that engineering training data is accurate, logically sound, clearly explained, well-documented, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Contractor· Remote — The United States

Status: Open

$75/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)

More AI gig categories