Expert Work

Big Data Engineer

Status: Open

Micro1

Pay
$30–$80/hr
Location
Remote
Employment type
Contractor
Openings
50
Posted
2026-04-17

About this opportunity

Job Title: Big Data Engineer Job Type: Contractor Location: Remote Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Key Responsibilities: - Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions. - Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives. - Implement data integration, transformation, and processing solutions using Python and relevant big data technologies. - Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability. - Monitor, troubleshoot, and enhance data systems to ensure high availability and performance. - Enforce data quality, security, and governance standards across all solutions. - Document solutions and communicate complex technical concepts effectively, both in writing and verbally. Required Skills and Qualifications: - Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines. - Advanced proficiency in Python for data processing, automation, and integration. - Deep understanding of relational and NoSQL databases, including optimization and management techniques. - Experience with distributed data processing frameworks (e.g., Hadoop, Spark, Flink). - Strong foundation in data modeling, ETL processes, and data warehousing principles. - Excellent written and verbal communication skills, with the ability to convey technical ideas clearly to both technical and non-technical stakeholders. - Detail-oriented, proactive, and self-motivated, thriving in remote and autonomous work environments. Preferred Qualifications: - Prior experience in fast-paced or startup-like environments supporting global teams. - Expertise with cloud-based big data platforms (e.g., AWS, GCP, Azure). - Familiarity with machine learning operations and data science workflows is a plus.

Required skills

  • big data
  • Python
  • databases
  • data engineering

What you'll do

  • Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions.
  • Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives.
  • Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.
  • Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability.
  • Monitor, troubleshoot, and enhance data systems to ensure high availability and performance.
  • Enforce data quality, security, and governance standards across all solutions.
  • Document solutions and communicate complex technical concepts effectively, both in writing and verbally.

Requirements

  • Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.
  • Advanced proficiency in Python for data processing, automation, and integration.
  • Deep understanding of relational and NoSQL databases, including optimization and management techniques.
  • Experience with distributed data processing frameworks (e.g., Hadoop, Spark, Flink).
  • Strong foundation in data modeling, ETL processes, and data warehousing principles.
  • Excellent written and verbal communication skills, with the ability to convey technical ideas clearly to both technical and non-technical stakeholders.
  • Detail-oriented, proactive, and self-motivated, thriving in remote and autonomous work environments.

Preferred qualifications

  • Prior experience in fast-paced or startup-like environments supporting global teams.
  • Expertise with cloud-based big data platforms (e.g., AWS, GCP, Azure).
  • Familiarity with machine learning operations and data science workflows is a plus.

Related opportunities

AI TrainingMicro1

Senior AI Trainer

Role Title: Senior AI Trainer Role Type: Contractor, Remote Location: Northern America and Germany. micro1 is engaging Senior AI Trainers to collaborate on a customer-driven project enhancing AI system quality through expert-level model training and evaluation. In this role, you'll apply your generalist expertise and hands-on experience with AI products to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Key Responsibilities: - Evaluate the performance of AI chat and search tools under standardized, repeatable conditions. - Apply detailed grading guidelines to accurately evaluate, rank, and annotate model responses, providing structured feedback that improves model performance. - Write, refine, and stress-test prompts that probe model capabilities, ensuring coverage of diverse scenarios, edge cases, and user intents. - Verify consistency and accuracy across evaluations, correcting discrepancies between ratings and the underlying rubric or guidelines. - Utilize AI training tools and platforms to record findings and submit evaluation datasets in alignment with project standards and milestones. - Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team. - Participate in ongoing quality reviews, incorporating feedback to maintain rigorous training and annotation standards. Required Skills and Qualifications: - Exceptional attention to detail and accuracy in reviewing and evaluating AI-generated content. - Strong written and verbal communication skills for effective collaboration, reporting, and timely updates on progress and challenges. - Demonstrated time management and self-organization abilities for independent, remote project participation. - Analytical and problem-solving mindset, with a proactive approach to resolving evaluation challenges. Preferred Qualifications: - Proven experience with AI model training, RLHF, data labeling, or similar data-centric evaluation projects. - Familiarity with AI products and tools, including prompt engineering and understanding of model behaviors and limitations. - Experience writing evaluation rubrics, grading model outputs, or reviewing AI responses for accuracy, helpfulness, and safety. - Background in AI training, machine learning data preparation, or LLM-focused projects (strongly preferred).

Contractor· Remote — Northern America and Europe

Status: Open

$14–$36/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)
AI TrainingMicro1

Software Engineer

In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. You'll create realistic, interesting and challenging coding tasks for AI to solve involving feature implementation and bug fixes, and implement deterministic verifiers that accept reasonable valid solutions and reject everything else. What we're looking for Strong backend experience in Java, Node.js, Go, Rust, Typescript, Python, C++ or similar A track record building scalable services and APIs Comfort with debugging, performance work and automated testing Solid code review instincts A strong testing background is a big plus — experience designing test strategy, building and maintaining large test suites, diagnosing flaky tests, or raising the testing bar on a team.

Contractor· Remote

Status: Open

$30–$100/hr

Verified Oct 5, 2026

Apply → (opens in a new tab)
CodingMicro1

TypeScript + Rust Developer

Job Title: TypeScript + Rust Developer Job Type: Contractor Location: Remote Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. Key Responsibilities: - Collaborate with cross-functional teams to deliver robust solutions in TypeScript and Rust. - Design, implement, and refactor complex systems, with a focus on codebase migrations or rewrites between language ecosystems. - Create and curate high-quality human data for AI training and evaluation tasks. - Follow best practices for software engineering, including code reviews, testing, and documentation. - Communicate technical concepts clearly via written and verbal communication to both technical and non-technical stakeholders. - Troubleshoot, debug, and optimize codebases in both TypeScript and Rust environments. - Maintain 6+ hours of daily work overlap with the Eastern Time zone to ensure effective collaboration. Required Skills and Qualifications: - 5+ years of professional software development experience, with a proven track record of production-level work. - Idiomatic fluency in TypeScript and Rust, demonstrated through hands-on experience. - Strong background in codebase migrations, rewrites, or working within multiple language environments. - Excellent written and verbal communication skills, with the ability to explain complex technical issues clearly. - Experience producing or working with human-labeled data, ideally for AI or ML applications. - Ability to work independently and as part of a remote, global team. - Fluent English proficiency. Preferred Qualifications: - Previous experience on AI/ML data engineering or data labeling teams. - Contributions to open-source TypeScript or Rust projects. - Background in developing scalable cloud-native applications.

Contractor· Remote

Status: Open

$30–$100/hr

Verified Oct 3, 2026

Apply → (opens in a new tab)