Data Labeling Jobs

Skills
Analytical SkillsComputer VisionDriftEnglishEnhanced Data Rates For GSM EvolutionLabelsLarge Language Models
Role

What the job involves

The main requirements, responsibilities and hiring steps.

Requirements

  • 3+ years experience in data labeling data annotation or LLM evaluation
  • Strong written English for rationale-based labeling and RLHF feedback
  • Ability to follow guidelines with high inter-annotator agreement
  • Experience with QA evaluation workflows sampling and error analysis
  • Comfort working in remote metrics-driven operations

Nice to have

  • Detail-oriented
  • Analytical
  • Independent
  • Process-focused
  • Quality-minded

Day to day

  • Support AI/ML training pipelines by creating and evaluating high-quality training data for NLP computer vision and large language model evaluation.
  • Deliver consistent labels across NLP CV and content safety datasets while applying annotation guidelines and taxonomy rules accurately.
  • Perform RLHF ranking prompt evaluation response grading QA checks and careful documentation of ambiguous cases.