Quality Specialist

Position:
LLM – AI Quality Analyst (Personalization) – Thai

Type:
Short-Term Contract

Location:
Remote

Commitment:
30–40 hours/week, 4-hour overlap with PST

Engagement Length:
2 months

Start Date:
Immediate

Role Responsibilities

• Design multi-turn conversational prompts (1–5 turns) using personal context
• Evaluate personalized AI responses for grounding, integration, and helpfulness
• Assess correct usage of personal data and identify flawed inferences or hallucinations
• Review integration quality to ensure personalization feels natural and not over-narrated
• Conduct side-by-side (SxS) evaluation and ranking of model responses
• Identify personalization errors, reasoning gaps, and grounding issues
• Write clear, structured rationales referencing specific conversation turns
• Extract and verify Debug Info to confirm correct data source utilization
• Mainta...