Senior QA Engineer (AI Testing)
Gallagher · Colombo
Job description
About the role
Gallagher is hiring a Senior QA Engineer (AI Testing) in Colombo, Sri Lanka, who reports to the QA Practice Lead. The role ensures the quality and reliability of AI-enabled solutions across their lifecycle, including testing, evaluation and production monitoring, working with stakeholders to define acceptance criteria, assess risks and set testing strategies for generative AI, machine learning and intelligent automation.
Key responsibilities
- Develop and maintain comprehensive test strategies for AI-enabled solutions.
- Evaluate AI behaviour for accuracy, robustness, fairness and safety.
- Test AI-specific risks such as hallucination, data leakage and model drift.
- Build automated regression suites and integrate them into CI/CD pipelines.
- Collaborate with stakeholders to clarify requirements and communicate quality risks.
- Monitor AI quality in production and contribute to continuous improvement.
- Stay up to date on industry trends and introduce advanced testing tools and techniques.
Required profile
- Proven experience in software testing, including AI-specific testing.
- Experience with performance, accessibility and security testing.
- ISTQB certification and training in AI or machine learning are advantageous.
Required skills
- Expertise in AI risks, retrieval-augmented generation and prompt engineering.
- Familiarity with secure software engineering practices and Agile methodologies.
- Knowledge of CI platforms such as Azure DevOps and tools such as Postman and JMeter.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Sri Lanka.
Salary: Senior DevOps Engineer Based on 11 job offers in Sri LankaSalaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 6 hours ago
Expires 1 month from now
9 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Gallagher
Colombo
Related job offers
-
Senior QA Automation Engineer (Playwright)
Gallagher Colombo -
Senior QA Engineer - Playwright Automation
GSS HR Solutions Private Limted Colombo -
Service Desk Consultant
HCLTech Sri Lanka Colombo -
IT Procurement Executive (Night Shift)
TECEZE District de Jaffna -
Senior QA Lead - Banking Integration & Migration Testing
Schemax Export Techno Craft Pvt. Ltd Province de l'Ouest