A

AI Quality Engineering Team Lead

Aviva Canada · Poland - Warsaw - ASEC · posted 26 Oct 2026
Full-timeManufacturing

About the job

Hi, we're glad you're here! We are hiring to our Aviva Services Excellence Centre! Take a look at our job description - maybe it suits you or one of your friends? We are looking for an AI Quality Engineering Team Lead to help establish trustworthy, scalable quality engineering for GenAI and agentic AI solutions at Aviva. You will combine hands-on evaluation with team leadership, helping stakeholders understand whether AI solutions are accurate, safe, reliable and ready for release.  This is a role for someone who can connect business risk with datasets, AI behaviour, evaluation metrics and engineering controls. You will shape reusable quality practices, challenge weak evidence and guide engineers in producing clear, auditable findings. What will you be doing? • Leading the quality engineering approach for AI solutions, from risk assessment through release and monitoring. • Evaluating multi-turn, RAG and agentic AI behaviour, including grounding, guardrails and tool use. • Building representative datasets and assessing coverage, balance, leakage, label quality and freshness. • Assessing correctness, relevance, hallucination, safety, bias, privacy and behavioural drift. • Investigating unexpected outcomes across data, prompts, models, retrieval, integration, orchestration and evaluators. • Building reusable evaluation components, automated test pipelines, reporting and evidence-generation patterns for multiple AI products. • Combining test methods and validating automated evaluators against human judgement. • Using baselines, key metrics and risk-based regression tests to support release decisions. • Integrating evaluation into CI/CD, observability and engineering workflows with traceability across datasets, prompts, models and metrics. • Producing concise, auditable findings that explain confidence, uncertainty, customer impact and residual risk. • Partnering with product, engineering, architecture, data, risk, compliance and quality stakeholders to influence…

Read the full description on Aviva Canada's site ↗

Skills

Upload your CV on LitCareer to see which of these you match.

Similar jobs

Senior Logistics - Analyst
Western Digital · Ladkrabang, Bangkok, th · 17 Nov 2026
Planner, Production Control
Western Digital · BangPa-in, PHRA NAKHON SI AYUTTHAYA, th · 17 Nov 2026

Collected from Aviva Canada's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.