S

QA Lead

solstice • United States
Visa Sponsorship Relocation
Apply Now

First dedicated QA lead to own quality for Solstice's AI-powered pharmaceutical marketing platform. Build evaluation systems, test infrastructure, end-to-end Playwright suites, and CI/CD quality gates. Requires strong Python, Playwright automation, and hands-on manual/exploratory testing experience.

Key Highlights
First dedicated QA lead owning quality for Solstice's AI-powered pharmaceutical marketing platform
Build evaluation systems for probabilistic AI/LLM outputs and catch regressions before clients do
Senior hands-on engineering role combining automated test infrastructure with manual/exploratory testing
Own end-to-end Playwright suite, CI/CD quality gates, and compliance-critical path testing
Competitive NYC salary: $160,000–$300,000; visa sponsorship and relocation support available
Key Responsibilities
Build evaluation systems to score quality of AI/LLM outputs and decide what is good enough to ship
Flag drops in model quality, cost increases, or latency regressions caused by model swaps and prompt changes
Test agentic systems for failure modes including goal drift, tool loops, wrong tool selection, and injection attacks
Protect compliance-critical paths by testing checks that prevent unsupported claims or missing safety disclosures
Build and maintain an end-to-end Playwright test suite covering real user flows
Run hands-on manual and exploratory QA to catch edge cases automation misses
Implement CI/CD quality gates including automated tests, linting, and type checks on pull requests
Use production traces and monitoring signals for drift detection and regression test generation
Harden background job pipelines to survive retries, timeouts, and worker crashes
Define testing standards and help the team write code that is easy to trust
Technical Skills Required
Python Playwright CI/CD
Benefits & Perks
Health, dental, and vision insurance
Ground-floor equity opportunity
Unlimited PTO
401(k) + 4% company match
In-office lunches 5 days/week
Professional growth stipend
Relocation support
Nice to Have
Experience with agent or LLM frameworks (LangChain, LangGraph)
Experience with eval and LLM-observability tools (LangSmith, Langfuse, Arize Phoenix, Braintrust, RAGAS, Promptfoo, OpenAI Evals)
Comfort with TypeScript and React
Adversarial or red-team testing experience
Backend experience with async Python services and task queues
Experience in regulated industries (pharma, healthcare, finance)
MLOps or LLMOps experience including defining quality SLOs

Job Description

Why you should join us

Solstice is redefining how life sciences organizations commercialize their therapeutics. We are building a commercial engine that allows pharmaceutical marketers to launch campaigns at 100x the speed.

Rapid growth: Over the past year, we have been working with some of the world's top life sciences manufacturers including Pfizer and AstraZeneca and are working with over 50+ pharma brands.

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Ladders

United States

New

Product Lead

  • AI
  • Prototypes
Visa Relocation

Akeno

Germany

New

Marketing Lead

  • AI
  • Ai Tools
Relocation

Sitemate

Kenya

QA Tester

  • AI
  • IOS
  • Android
  • Saas
Full Remote

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Relocation Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.