Is Data Annotation Legit? How to Tell Real Work from Scams

Updated · Independent guide by AI Gig Scout

Short answer: data annotation is a real, well-established kind of work — AI systems need large amounts of human-labelled data (IBM, Wikipedia). But that doesn't make every company or recruiter offering it legitimate. Scammers advertise remote jobs exactly the way honest employers do (FTC). This guide explains how real annotation work usually operates and how to check an offer before you share anything.

What data annotation work actually involves

Annotators add labels that give raw data context — for example marking whether a photo contains a bird or a car, transcribing what was said in a recording, or tagging the sentiment of a sentence (AWS). Newer projects also ask people to compare and rate chatbot answers, write ideal responses, or check code. See What is data annotation? for a fuller explanation.

How legitimate data annotation jobs typically work

Processes differ between platforms, but a typical flow looks like this:

  1. Apply on the platform's own site with basic details and, for expert roles, your background or CV.
  2. Qualification assessment. A test of your attention to detail, writing, language or subject knowledge. These are usually unpaid.
  3. Onboarding to a project with written guidelines you're expected to follow closely.
  4. Tasks and quality review. Your work is checked; quality affects whether you keep getting tasks.
  5. Payment on a set schedule through the method the platform names in its terms. You never pay them.

Warning signs of a scam or misleading offer

  • You are asked to pay for a job, "training", a starter kit, equipment or a certification. Honest employers don't charge you to get hired (consumer.gov, FTC).
  • A check arrives and you're asked to send part of it back — the classic fake-check scam (FTC).
  • Unexpected texts, WhatsApp or Telegram messages offering a remote "assessor" job, often with a daily or weekly rate but no real job details. The FTC says real employers won't recruit that way (FTC, 2026).
  • "Tasks" that require depositing your own money, such as rating or liking products to unlock earnings — a task scam (FTC, 2026).
  • Big money for little effort. Claims of thousands per month with almost no work are "almost certainly a scam" (FTC).
  • Payment demanded by gift card, crypto, payment app or wire transfer (consumer.gov).
  • Recruiters using personal email accounts, chat-only "interviews", and early requests for bank details or ID numbers (FTC).

How to verify a platform before applying

  1. Apply only through the platform's own website. Contact the company using details you found yourself, not ones supplied by whoever messaged you (FTC).
  2. Search the company name plus "scam", "review" or "fraud" (consumer.gov). Read several sources and check the dates.
  3. Check the domain. Make sure the sign-up page is on the company's real domain, not a lookalike or a form hosted somewhere else.
  4. Read the terms before sharing tax or bank details: who pays you, how, how often, and whether you're a contractor or employee.
  5. Talk it through with someone you trust before sending money or sensitive data (consumer.gov).
  6. If something went wrong, report it at ReportFraud.ftc.gov (US).

Realistic expectations

Even on genuine platforms, this work is usually contract or freelance, not salaried employment. Things people commonly underestimate:

  • Assessments come first. Many platforms screen applicants with unpaid qualification tests, and some don't tell you if you didn't pass.
  • Work can be uneven. Projects start and end; there can be weeks with plenty of tasks and weeks with none. Don't plan your rent around a single platform.
  • Pay varies by project, skill level and, often, country. Treat any figure as specific to that listing, not to the platform as a whole.
  • Eligibility is real. Many roles are limited to certain countries, languages or credentials. Each job page on AI Gig Scout shows the stated location and requirements — always confirm on the official listing.
  • Quality rules are strict. Accounts can lose access for breaking guidelines or time-tracking rules.

Finding annotation work on AI Gig Scout

Every listing on AI Gig Scout links to the platform's official job page, shows when we last checked it, and is removed from open results once it closes. We are an independent directory — a listing is not an endorsement, so still run the checks above. Some apply links are referral links; see our referral disclosure.

Frequently asked questions

Do I have to pay to start data annotation work?

No. Being asked to pay for a job, training or equipment is one of the clearest scam signs the FTC lists.

Is data annotation a full-time job?

Usually not guaranteed. Most roles are contract-based and task volume can change from week to week.

Why didn't I hear back after the assessment?

Some platforms don't notify applicants who aren't selected. Silence alone isn't proof of a scam, but a request for money or bank details before any work is.

Sources

AI TrainingMicro1

Open Source GitHub Maintainer

Role Title: Open source GitHub maintainer Role Type: Contractor (15 hrs a week) Location: Remote, Open Globally Schedule: Flexible, any hours/days of the week. As long as there is constant activity. micro1 is engaging expert Senior Software Engineers to support a customer’s innovative project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. As a subject-matter expert, you'll review code patches generated by an LLM for the repository (or repositories) you maintain, and provide your professional assessment of each one. Applicants must have clear open source contributions and profiles to showcase it like GitHub or GitLab. Scope of Work - Evaluate code patches generated by LLMs and offer detailed feedback on each one - Provide written justification to support your assessments - Conduct peer reviews of work submitted by other subject-matter experts Preferred Qualifications - Experience maintaining an open source repository. - Experience reviewing code from contributors Process: - Apply to the role, filling out the screening questions - Complete AI interview (aprox. 10 minutes) - Hiring Manager review Compensation Structure Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week. Start Timeline & Availability We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.

Contractor· Remote, Open Globally

Status: Open

$150–$300/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI TrainingMicro1

Bilingual Indonesian Psychiatrist

Role Title: Bilingual Indonesian Psychiatrist Role Type: Contractor Location: Remote micro1 is engaging Bilingual Indonesian Psychiatrists to contribute to a customer-focused project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. Scope of Work - Develop and evaluate complex psychiatric case studies to inform AI model training with real-world, culturally nuanced scenarios. - Conduct thorough psychological assessments and provide expert annotations reflecting Indonesian psychiatric practices and perspectives. - Produce clear, precise documentation and written analyses in both Indonesian and English, ensuring cultural and clinical accuracy. - Participate in interdisciplinary collaboration, sharing insights with AI project teams to enhance model understanding of psychiatric concepts. - Apply ethical decision-making in the review and critique of sensitive case content, maintaining patient confidentiality and best practices. - Contribute to the creation of bilingual communication frameworks for accurate psychiatric information exchange. - Offer expert feedback on the analytical evaluation methods used by AI systems in mental health contexts. Preferred Qualifications - Medical degree (MD, MBBS, or equivalent) with completed psychiatry residency and a valid medical license - Native fluency in Indonesian and advanced proficiency in English, with demonstrated ability in both written and verbal communication. - Extensive experience in psychiatric assessment, treatment planning, and case documentation within Indonesian clinical settings. - Proven capability to apply cultural sensitivity and ethical reasoning to complex mental health scenarios. - Strong background in developing teaching materials or case studies for educational or research purposes. - Experience collaborating on interdisciplinary projects, ideally involving technology, research, or digital health. - Familiarity with both Western and Indonesian psychiatric frameworks, with a commitment to high standards of professional integrity.

Contractor· Remote

Status: Open

$100–$200/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI TrainingMicro1

Bilingual Japanese Psychiatrist

Role Title: Bilingual Japanese Psychiatrist Role Type: Contractor Location: Remote micro1 is engaging Bilingual Japanese Psychiatrists to contribute to a customer-focused project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. Scope of Work - Develop and evaluate complex psychiatric case studies to inform AI model training with real-world, culturally nuanced scenarios. - Conduct thorough psychological assessments and provide expert annotations reflecting Japanese psychiatric practices and perspectives. - Produce clear, precise documentation and written analyses in both Japanese and English, ensuring cultural and clinical accuracy. - Participate in interdisciplinary collaboration, sharing insights with AI project teams to enhance model understanding of psychiatric concepts. - Apply ethical decision-making in the review and critique of sensitive case content, maintaining patient confidentiality and best practices. - Contribute to the creation of bilingual communication frameworks for accurate psychiatric information exchange. - Offer expert feedback on the analytical evaluation methods used by AI systems in mental health contexts. Preferred Qualifications - Medical degree (MD, MBBS, or equivalent) with completed psychiatry residency and a valid medical license - Native fluency in Japanese and advanced proficiency in English, with demonstrated ability in both written and verbal communication. - Extensive experience in psychiatric assessment, treatment planning, and case documentation within Japanese clinical settings. - Proven capability to apply cultural sensitivity and ethical reasoning to complex mental health scenarios. - Strong background in developing teaching materials or case studies for educational or research purposes. - Experience collaborating on interdisciplinary projects, ideally involving technology, research, or digital health. - Familiarity with both Western and Japanese psychiatric frameworks, with a commitment to high standards of professional integrity.

Contractor· Remote

Status: Open

$100–$200/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI TrainingMicro1

Bilingual Malay Psychiatrist

Role Title: Bilingual Malay Psychiatrist Role Type: Contractor Location: Remote micro1 is engaging Bilingual Malay Psychiatrists to contribute to a customer-focused project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. Scope of Work - Develop and evaluate complex psychiatric case studies to inform AI model training with real-world, culturally nuanced scenarios. - Conduct thorough psychological assessments and provide expert annotations reflecting Malay psychiatric practices and perspectives. - Produce clear, precise documentation and written analyses in both Malay and English, ensuring cultural and clinical accuracy. - Participate in interdisciplinary collaboration, sharing insights with AI project teams to enhance model understanding of psychiatric concepts. - Apply ethical decision-making in the review and critique of sensitive case content, maintaining patient confidentiality and best practices. - Contribute to the creation of bilingual communication frameworks for accurate psychiatric information exchange. - Offer expert feedback on the analytical evaluation methods used by AI systems in mental health contexts. Preferred Qualifications - Medical degree (MD, MBBS, or equivalent) with completed psychiatry residency and a valid medical license - Native fluency in Malay and advanced proficiency in English, with demonstrated ability in both written and verbal communication. - Extensive experience in psychiatric assessment, treatment planning, and case documentation within Malay clinical settings. - Proven capability to apply cultural sensitivity and ethical reasoning to complex mental health scenarios. - Strong background in developing teaching materials or case studies for educational or research purposes. - Experience collaborating on interdisciplinary projects, ideally involving technology, research, or digital health. - Familiarity with both Western and Malay psychiatric frameworks, with a commitment to high standards of professional integrity.

Contractor· Remote

Status: Open

$100–$200/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI TrainingMicro1

Clinician (Oncology / Hematology)

Role Title: Clinician (Oncology / Hematology) Role Type: Contractor Location: Remote micro1 is engaging Clinician (Oncology / Hematology)s to contribute to a customer’s project at the forefront of AI in healthcare. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. Scope of Work - Author and review evaluation tasks that require nuanced clinical judgment, leveraging Clinical Study Reports, periodic safety reports, and regulatory correspondence in oncology and haematology. - Assess the clinical defensibility of efficacy and safety conclusions, ensuring endpoints and effect sizes reflect true clinical significance. - Apply advanced judgment to dose escalation, dose-limiting toxicity, modifications, adverse event grading and attribution, and the coherence of patient narratives. - Evaluate benefit-risk reasoning, scrutinizing the durability of conclusions in light of new events, and the realism of described management strategies. - Identify and flag content that is clinically implausible or internally inconsistent, distinguishing these from legitimate clinical variation. - Provide structured, guideline-based written rationales that clearly explain the validity or limitations of clinical interpretations for a non-clinical audience. Preferred Qualifications - Specialist registration or board certification in medical oncology and/or haematology, with 5+ years of post-training clinical experience. - Direct involvement in clinical trials as investigator, sub-investigator, or sponsor-side medical monitor, safety physician, or clinical development physician. - Proficiency with CTCAE grading, relevant response criteria (RECIST, Lugano, IMWG, IWCLL, ELN), and outcome endpoints (ORR, DoR, PFS, OS, MRD). - Hands-on experience with trial documents such as protocols, investigator brochures, CSRs, safety narratives, or DSMB/IDMC materials. - Demonstrated excellence in written communication, with clear, structured explanations of clinical reasoning tailored for non-clinical readers. - Previous roles in medical monitoring or as medical director on oncology or haematology programmes, and committee participation (IDMC, DSMB, adjudication, or independent review committees). - Peer-reviewed publication record or authorship on clinical trial manuscripts, with any exposure to AI-assisted clinical review tools seen as a plus.

Contractor· Remote

Status: Open

$160–$200/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI TrainingMicro1

Georgian Speaking Psychiatrist

Role Title: Georgian Speaking Psychiatrist Role Type: Contractor Location: Remote micro1 is engaging Bilingual Georgian Psychiatrists to contribute to a customer-focused project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. Scope of Work - Develop and evaluate complex psychiatric case studies to inform AI model training with real-world, culturally nuanced scenarios. - Conduct thorough psychological assessments and provide expert annotations reflecting Georgian psychiatric practices and perspectives. - Produce clear, precise documentation and written analyses in both Georgian and English, ensuring cultural and clinical accuracy. - Participate in interdisciplinary collaboration, sharing insights with AI project teams to enhance model understanding of psychiatric concepts. - Apply ethical decision-making in the review and critique of sensitive case content, maintaining patient confidentiality and best practices. - Contribute to the creation of bilingual communication frameworks for accurate psychiatric information exchange. - Offer expert feedback on the analytical evaluation methods used by AI systems in mental health contexts. Preferred Qualifications - Medical degree (MD, MBBS, or equivalent) with completed psychiatry residency and a valid medical license - Native fluency in Georgian and advanced proficiency in English, with demonstrated ability in both written and verbal communication. - Extensive experience in psychiatric assessment, treatment planning, and case documentation within Georgian clinical settings. - Proven capability to apply cultural sensitivity and ethical reasoning to complex mental health scenarios. - Strong background in developing teaching materials or case studies for educational or research purposes. - Experience collaborating on interdisciplinary projects, ideally involving technology, research, or digital health. - Familiarity with both Western and Georgian psychiatric frameworks, with a commitment to high standards of professional integrity.

Contractor· Remote

Status: Open

$100–$200/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)