ML Evaluation Designer - Expert

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Code-Data Eval Author — Machine Learning Engineer
Type: Contract
Compensation: $45–$140/hour
Location: Remote
Commitment: 30+ hours/week

Role Responsibilities

• Design ML/LLM evaluation tasks, rubrics, and metrics to enhance model performance.
• Grade model/agent outputs and improve evaluation quality through thorough review.
• Apply training-side judgment...