Simplified Chinese Bilingual Evaluator Expert

About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Multilingual Prompt Designer
Type: Freelance
Compensation: $25–$30/hour
Commitment: 20+ hours/week
Role Responsibilities
Create detailed prompts in Simplified Chinese and/or English with constraints and instructions. Ensure natural phrasing and real-world relevance for Simplified Chinese users.
Establish high-level expectations for correct responses in Simplified Chinese contexts. Develop comprehensive rubrics accounting for linguistic nuance, tone, and cultural conventions.
Run prompts through models and assess outputs for accuracy, fluency, and cultural fit in Simplified Chinese. Compare results against English where needed.
Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor. Mai...