LLM Data Quality

• Title:
  LLM Data Quality (Remote)
• Engagement:
  Hourly contract (independent contractor)
• Location:
  Remote

Role Overview

A global AI-focused organization is seeking an LLM Data Quality & Tooling Specialist to support large language model training initiatives through structured data validation and lightweight tooling development. This role blends hands-on quality control with practical tool-building to improve dataset reliability, clarity, and evaluation standards across STEM and humanities domains.

You will work closely with internal experts and AI teams to ensure training data meets rigorous quality standards while building simple, effective workflows to scale review processes.

Key Responsibilities

• Perform quality checks (QC) on generated datasets including Q&A pairs, rubric-based datasets, evaluation samples, and agentic workflows
• Review content across both STEM and humanities domains for logica...