T

QA AI Automation Engineer

tektora • United Arab Emirates
Visa Sponsorship Relocation
Apply Now
AI Summary

Own testing strategy and build Python frameworks to validate internal AI and LLM models across production and synthetic data. Test LLM outputs for quality, accuracy, consistency, edge cases and failure modes; integrate eval into CI/CD with quality gates. Python-strong engineer with AI/LLM evaluation experience, pytest, FastAPI, Docker, Linux, CI/CD pipelines.

Key Highlights
Own testing strategy for internal AI and LLM models
Build Python automation frameworks and test suites from scratch
Integrate evaluation into CI/CD with quality gates
Test LLM outputs for quality, accuracy, consistency and failure modes
Combine real production data with synthetic test data

Looking to advance your QA & Testing career with relocation support? Explore QA & Testing Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.

Key Responsibilities
Build and maintain Python automation test suites and frameworks from scratch
Test LLM outputs for quality, accuracy, consistency, edge cases and failure modes
Build and manage test datasets combining real production and synthetic data
Write automated test scripts for model and prompt updates
Run regression tests, golden-dataset evaluations and performance benchmarks
Integrate evaluation into CI/CD with quality gates
Track and report model performance through dashboards and alerting
Work with AI, ML and product teams to define and encode quality criteria
Technical Skills Required
Python Testing AI/LLM Evaluation

Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.

Benefits & Perks
Competitive tax-free salary
Full relocation support
Visa sponsorship
Family status available

Interested in relocating to United Arab Emirates? Check out our comprehensive Relocation Jobs in United Arab Emirates page with detailed relocation packages and benefits.

Nice to Have
Vector search and embeddings
Model fine-tuning concepts, prompt engineering or observability tooling
MCP (Model Context Protocol)
GPU and CPU optimisation
ISTQB CT-AI certification

Job Description

Location: Abu Dhabi, United Arab Emirates
Working Pattern: On-site, 5 days per week
Type: Permanent, full-time
Salary: Competitive tax-free package, dependent on experience
Relocation: Full relocation support, visa sponsorship and family status available

Tektora are supporting an established technology client in Abu Dhabi who are looking to speak with QA AI Automation Engineers for a permanent opportunity owning the testing strategy for their internal AI and LLM models.

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

Ready to apply?

Apply Now
See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Nov 10, 2026
Employment Full-time
Experience Not Applicable
Location United Arab Emirates
Category Testing
Company tektora
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Relocation Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.