Job Description
Key Responsibilities:
-
Design and execute test plans for voice and chat AI agents.
-
Perform load testing, latency measurement, and barge-in handling for voicebots.
-
Test chatbot flows across different LLMs, embeddings, tools, and agents (LangChain/LangGraph).
-
Build and maintain automated testing frameworks for regression testing (e.g., prompt consistency, tool behavior).
-
Evaluate intent accuracy, NLU robustness, and fallback handling.
-
Simulate edge cases: noisy environments, overlapping speech, disconnections, multilingual input.
-
Report bugs, behavioral inconsistencies, hallucinations, and voice UX issues.
-
Monitor and interpret analytics, call logs, response latencies, prompt token usage, etc.
-
Collaborate closely with engineers and pro...
Apply for this Job
Submit your application for the SQA Automation Engineer position at Kavak GCC.
Apply Now Save for Later