Analytical Evaluator - AI Feedback

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position

Position: Generalist Expert
Type: Contract
Compensation: $100/hour
Location: Remote

Role Responsibilities

• Evaluate AI-generated responses to enhance reasoning and rigor in model outputs.
• Provide structured written feedback to improve training data quality and downstream performance.
• Develop clear, precise, and well-evidenced written rationales beyond surface-level observations.
• Collaborate with AI research teams to ensure consistency and coverage across datasets.
• Work independently and asynchronously to meet deadlines while improving AI model performance....