Product Evaluation Specialist | Remote

• Design and develop robust evaluation rubrics to assess AI model outputs from a user experience (UX) perspective.
• Execute product validation tasks to identify risks that could negatively impact user experience, safety, or accuracy.
• Analyze AI outputs to flag usability issues, inconsistencies, or potential failure modes.
• Collaborate with cross-functional teams to define, refine, and uphold product validation and safety standards.
• Translate user insights and evaluation findings into clear, actionable recommendations for model improvement.
• Document results and recommendations with clarity to ensure stakeholders understand user impact.
• Continuously monitor evolving AI product usage and proactively surface emerging UX risks or concerns.

Requirements

• Exceptional written and verbal communication skills with a strong focus on clarity and precision.
• Strong analytical skills and attention to deta...