How Remoteville checks and expires listings
Generalist Jobs India
Skills
Data OperationsEnglishLarge Language ModelsMachine LearningOperationsPattern RecognitionQuality Assurance
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Mid-senior experience in operations QA or structured review work
- Strong written English and ability to apply detailed rubrics consistently
- Familiarity with LLM evaluation concepts helpfulness harmlessness factuality relevance
- Comfort working remotely with productivity and quality targets
Nice to have
- Detail-oriented
- Analytical
- Consistent
- Remote-ready
- Collaborative
Day to day
- Support reliable LLM training pipelines through data labeling and QA review across multiple AI workflows.
- Apply RLHF rubrics for preference ranking and helpfulness or harmlessness scoring with strong consistency.
- Perform prompt evaluation response grading NLP tagging computer vision annotation and content safety labeling as needed.