Generalist Expert for AI Evaluation

Become a Generalist Expert at Mercor, evaluating AI outputs remotely. Use your analytical skills to provide structured feedback and enhance AI model performance.
In this contract role, you will assess AI-generated responses and work collaboratively with research teams. The position demands strong analytical and writing skills, where you will be expected to craft well-evidenced rationales that reflect nuanced understanding. Native English fluency and critical reading abilities are required to spot gaps in reasoning effectively.
Key Responsibilities:
• Evaluate and improve reasoning in AI-generated content
• Offer structured feedback to enhance training data quality
• Create clear, evidence-based written rationales for outputs
• Collaborate to ensure dataset consistency from teams
• Manage independent tasks while improving AI performance
Requirements:
• Bachelor's degree from a top-100 university
• Strong analytical and written communication skills
• Abil...