QA Lead - Capital Markets

QA Lead – Capital Markets

Location: Montreal, Quebec (OR) Halifax, Noca Scotia (Hybrid)
Job Type: Contract
Experience Required: 7+ Years
Domain: Capital Markets
Work Authorization: Candidates must be legally authorized to work in Canada without sponsorship.

Job Summary

Location: Halifax or Montreal

AI Systems and Models Testing

Design and execute comprehensive test strategies for AI systems and models, including prompt engineering, output evaluation, and bias/safety testing. Develop deep understanding of LLM behavior—tokenization, embeddings, attention mechanisms, and inference—to anticipate failure modes. Construct effective prompts, recognize hallucinations and off-target outputs, and assess quality across accuracy, tone, coherence, and bias dimensions. Apply evaluation metrics specific to generative AI and establish appropriate thresholds.

Test AI systems integrated ...