Generalist Evaluator Expert

This role is for one of our clients

Compensation: $35-$40 per hour

We are seeking detail-oriented writing professionals to contribute to a high-impact AI research initiative in collaboration with a leading research lab. In this role, you will develop high-quality prompt–golden answer pairs used to train and evaluate advanced language models.

This is a short-term, flexible opportunity ideal for individuals with strong academic foundations and exceptional clarity in written communication. The role is well-suited for professionals who enjoy translating complex ideas into structured, precise, and easy-to-understand content.

Requirements

Key Responsibilities

• Design and Optimize Prompts: Develop detailed, constraint-rich prompts with clear instructions and multiple requirements
• Define Evaluation Standards: Establish expectations for high-quality respo...