Job Description

Role Overview

Help improve next-generation AI systems by creating realistic data entry and validation evaluation tasks. This remote contract role applies hands-on data accuracy, error detection, and format-reconciliation expertise to produce high-quality training materials for AI agents.

Key Responsibilities

• Design expert-level evaluation tasks that reflect real-world data entry and validation challenges.
• Build and curate complex datasets, including CSV files, PDFs, spreadsheets, and technical documents, with realistic issues such as malformed records, missing data, and inconsistent formats.
• Define the correct final state for each task, including exact error cases and reconciliation requirements.
• Create detailed grading rubrics with 35 or more criteria to assess AI outputs for accuracy and completeness of error detection.
• Ensure tasks reflect the complexity and standards of regulated or audit-sensitive environments.
• Collaborate asynchronously through clear written and verbal communication to refine evaluation materials.

Qualifications

• Strong accuracy discipline, error-detection ability, format-reconciliation skills, and attention to detail.
• Extensive experience in data entry, quality assurance, or data validation, ideally in regulated or audit-sensitive settings such as healthcare claims, finance back-office operations, or legal operations.
• Ability to achieve and document measurable accuracy standards, error rates, and outcomes.
• Experience identifying data inconsistencies, silent truncations, and formatting irregularities across multiple file types.
• Proficient written English for drafting detailed evaluation tasks and comprehensive grading rubrics.
• A disciplined, process-oriented approach and comfort working independently in a remote, distributed environment.
• Experience on work where compliance, accuracy, or data integrity carries significant importance is highly valued.
• No prior AI experience is required.

Work Terms

• Remote contract engagement.
• Work is paid per task that meets project specifications, and completion time varies by experience and workflow.
• Minimum submission requirements apply, including submission of a minimum number of tasks each week.
• Selected candidates should be ready to begin their first tasks within 24 to 48 hours after completing onboarding.

Compensation

• Advertised compensation is $20 to $35 per hour.
• Payment is output-based and tied to tasks that meet project specifications.

Job Tags

Similar Jobs