Senior AI Quality Engineer

Mitratech
Full-time India, India Computer Occupations
Posted:
June 04, 2026
Location:
India, India, India

Job Description

  • Design and execute manual and automated test cases for backend APIs, frontend interfaces, and end-to-end AI workflows.

  • Conduct exploratory testing of new generative AI features and user interactions.

  • Develop and maintain automated test frameworks for UI and API.

  • Build automation scripts for AI/ML pipelines using pytest, unittest, or custom frameworks.

  • Create comprehensive test plans, manage defects, and report results using Jira, or similar tools.

  • Validate RAG (Retrieval-Augmented Generation) pipelines, including embedding accuracy, retrieval quality, and model response evaluation.

  • Test AI agents and orchestration flows, ensuring correctness in multi-step reasoning and tool invocations.

  • Perform performance and scalability testing for ML inference endpoints (SageMaker, Bedrock, custom APIs), monitoring latency and throughput.

  • Conduct...
  • Apply for this Job

    Submit your application for the Senior AI Quality Engineer position at Mitratech.

    Apply Now Save for Later

    Job Overview

    Job Type: Full-time
    Location: India, India
    Posted: June 04, 2026
    Deadline: July 14, 2026