Jobiglo

No results.

Senior QA Engineer (AI Testing)

Gallagher · Colombo

New
Senior 🇬🇧 English
Azure DevOps Postman JMeter CI/CD Agile Prompt engineering Retrieval-augmented generation

Job description

About the role

Gallagher is hiring a Senior QA Engineer (AI Testing) in Colombo, Sri Lanka, who reports to the QA Practice Lead. The role ensures the quality and reliability of AI-enabled solutions across their lifecycle, including testing, evaluation and production monitoring, working with stakeholders to define acceptance criteria, assess risks and set testing strategies for generative AI, machine learning and intelligent automation.

Key responsibilities

  • Develop and maintain comprehensive test strategies for AI-enabled solutions.
  • Evaluate AI behaviour for accuracy, robustness, fairness and safety.
  • Test AI-specific risks such as hallucination, data leakage and model drift.
  • Build automated regression suites and integrate them into CI/CD pipelines.
  • Collaborate with stakeholders to clarify requirements and communicate quality risks.
  • Monitor AI quality in production and contribute to continuous improvement.
  • Stay up to date on industry trends and introduce advanced testing tools and techniques.

Required profile

  • Proven experience in software testing, including AI-specific testing.
  • Experience with performance, accessibility and security testing.
  • ISTQB certification and training in AI or machine learning are advantageous.

Required skills

  • Expertise in AI risks, retrieval-augmented generation and prompt engineering.
  • Familiarity with secure software engineering practices and Agile methodologies.
  • Knowledge of CI platforms such as Azure DevOps and tools such as Postman and JMeter.

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec Gallagher.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 6 hours ago

Expires 1 month from now

9 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

Gallagher

Colombo