QA Engineer - AI

Key Responsibilities

• Design and execute test plans for voice and chat AI agents.
• Perform load testing , latency measurement , and barge-in handling for voicebots.
• Test chatbot flows across different LLMs, embeddings , tools, and agents (LangChain/LangGraph).
• Build and maintain automated testing frameworks for regression testing (e.g., prompt consistency, tool behavior).
• Evaluate intent accuracy , NLU robustness , and fallback handling .
• Simulate edge cases : noisy environments, overlapping speech, disconnections, multilingual input.
• Report bugs, behavioral inconsistencies, hallucinations, and voice UX issues.
• Monitor and interpret analytics, call logs, response latencies, prompt token usage, etc.
• Collaborate closely with engineers and product leads to prioritize fixes.

Requirements

• ...