A

Senior QA Lead (AI Systems)

agilegrid solutions • United State
Visa Sponsorship Relocation
Apply Now
AI Summary

We are seeking a Senior QA Lead to own quality assurance for our AI platform, ensuring reliability and accuracy of AI-driven products. You will design and implement testing frameworks, evaluation systems, and automation strategies, and lead the QA function as the first dedicated hire. This hands-on role requires deep Python expertise, CI/CD knowledge, and experience with AI/LLM evaluation.

Key Highlights
First dedicated QA hire, owning quality assurance for an AI platform
Design and implement evaluation frameworks for LLMs and agent-based systems
Build automated testing infrastructure with Python and Playwright
Establish CI/CD quality gates and automated release workflows
Test agent workflows for failure modes like tool misuse, looping, hallucinations, and prompt injection

Looking to advance your QA & Testing career with relocation support? Explore QA & Testing Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.

Key Responsibilities
Develop and implement evaluation frameworks for large language models and agent-based systems to measure performance and output quality.
Design and execute regression tests to validate model, prompt, and workflow modifications.
Create and maintain automated testing infrastructure utilizing Python and Playwright tools to ensure continuous quality checks.
Manage end-to-end testing processes for web applications, APIs, and AI components, ensuring seamless integration and performance.
Establish and oversee CI/CD quality gates, automating release workflows to streamline deployment processes.
Conduct manual and exploratory testing on new features, providing critical feedback and insights.
Monitor production systems, analyze failures, and develop repeatable tests to prevent recurrence of issues.
Test agent workflows for failure modes such as tool misuse, looping, hallucinations, and prompt injection vulnerabilities.
Collaborate with engineering and product teams to define, implement, and uphold quality standards and best practices.
Define the scope of QA activities, build scalable processes, and scale the QA function as the organization grows.

Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.

Technical Skills Required
Python Playwright CI/CD

Interested in relocating to United State? Check out our comprehensive Relocation Jobs in United State page with detailed relocation packages and benefits.

Benefits & Perks
Competitive base salary ranging from $160,000 to $300,000
Meaningful equity package
Comprehensive medical, dental, and vision insurance
401(k) retirement plan with company matching
Visa sponsorship available
Relocation support to New York City
Unlimited paid time off
Professional development stipend

Job Description

Storm3 is a rapidly expanding Series A AI startup dedicated to revolutionizing the life sciences industry through innovative software solutions. Our cutting-edge platform empowers enterprise clients to create, review, and manage complex, regulated content efficiently by leveraging AI-powered workflows. We collaborate with leading organizations in the sector, pushing the boundaries of large language models (LLMs), agentic systems, and applied artificial intelligence to deliver impactful solutions. Our team is committed to fostering a dynamic, innovative environment where technological advancement and industry expertise converge to shape the future of life sciences technology.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

Apply Now
See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Date Oct 07, 2026
Employment Type Full-time
Experience Level Associate
Location United State
Category Testing
Company agilegrid solutions
Mentioned Skills
python artificial intelligence ai technical expertise machine learning

Similar Jobs

Explore other opportunities that match your interests

QA Engineer
Testing
•
7h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

foundation health

United State

Principal Integration and Test Engineer

Testing
•
16h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Northrop Grumman

United State

Senior Wi-Fi Test Engineer
Testing
•
1d ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Entry level

stonecliff solutions - talent...

United State

Subscribe our newsletter

New Things Will Always Update Regularly