Quality Engineering Manager - AI & SaaS Platforms

Caseware is one of Canada's original Fintech companies, having led the global audit and accounting software industry for over 30 years, with more than 500,000 users across 130 countries and available in 16 different languages. While you might not have heard of us (yet) over 36,000 accounting and audit professionals list Caseware as a skill on their LinkedIn profiles!

We’re hiring a QA Manager to lead the next evolution of quality engineering across Caseware’s SaaS product teams—driving scalable, modern approaches to testing, automation, and developer enablement. Reporting into the Data Analytics, Interoperability, and AI Platform organization, this role is uniquely positioned to define quality strategy across foundational platform areas that underpin our most critical innovations.

What makes this role especially exciting: we’re not just building traditional apps. We’re accelerating delivery of advanced analytics, LLM-based GenAI features, and moving toward agentic AI capabilities—systems that defy conventional testing and require new thinking around test strategy, observability, and statistical validation. You’ll help build teams and architect a quality practice that is not only robust and scalable, but capable of handling the complexity and nuance of modern, non-deterministic systems.

If you’re energized by the challenge of enabling velocity while maintaining trust and quality in data- and AI-driven systems, this is the opportunity to shape that future.

❗ This is a full-time permanent position

📍 Location: This is a fully remote position located in Colombia.

Contact

Maira Russo - Senior Talent Acquisition Partner

What You’ll Be Doing

• Build and Lead Central Quality Engineering Function
  
  
  

Recruit and lead a team of Software Developers in Test (SDETs) who partner closely with product teams to embed quality into every phase of development—through tooling, automation, infrastructure, reporting and best practices.

• Set and Execute Quality Strategy Across the Platform
  
  
  

Define and implement a scalable quality strategy for a growing SaaS platform—shifting testing left, reducing UI test reliance, and strengthening component and contract coverage. Improve E2E test stability, data setup, and isolation to boost reliability and speed. Enable fast, actionable feedback loops without slowing team velocity.

• Design for Quality in AI & Analytics Systems
  
  
  

Collaborate with data and AI teams to design quality strategies for non-deterministic systems like pipelines, statistical models, and GenAI features. Apply advanced validation methods such as golden datasets, LLM-as-judge, behavioral testing, and synthetic test generation to support continuous delivery.

• Improve CI/CD and Developer Workflows
  
  
  

Optimize CI/CD pipelines for speed and reliability. Define meaningful, maintainable quality gates that provide early warning without blocking delivery. Champion tooling and practices that reduce flaky tests and noisy signals.

• Lead Non-Functional and Production Testing
  
  
  

Establish frameworks and processes for performance, scalability, and resilience testing across our services. Enable testing-in-production approaches through canary releases, synthetic monitoring, and fault injection.

• Manage Platform Release Management
  
  
  

Oversee release management from a quality lens—ensuring readiness through test coverage, risk assessment, and coordination of validation activities across environments.

• Build Test Data and Observability Systems
  
  
  

Drive the creation of scalable, privacy & regulatory compliant test data management strategies. Integrate logs, traces, and monitoring into automated test systems to improve diagnosis and root cause analysis of test failures.

• Define and Measure Quality KPIs
  
  
  

Track key DORA metrics such as test coverage, defect trends, test effectiveness and execution health, flakiness, and regression rates. Use these insights to continually refine the quality strategy and guide investments in automation and infrastructure.

• Drive Culture and Practice Alignment
  
  
  

Partner with engineering and product leaders to instill a quality-first mindset. Educate developers and SDETs on effective test strategies. Participate in incident reviews and technical planning to ensure that lessons learned are translated into durable quality improvements.

What You Will Bring

• 7+ years' experience leading QA or quality engineering teams within modern SaaS or platform organizations in cloud-native environments (AWS).
• Expertise in building and scaling automated testing infrastructure, including integration with modern CI/CD pipelines (GitHub Workflows).
• Knowledge of testing strategies across the pyramid, from unit to E2E, including contract and performance testing (Cypress, Pact, K6).
• Solid front-end knowledge and testing fluency in HTML/CSS/JavaScript/TypeScript, and back-end knowlege in RESTFul APIs.
• Experience applying AI tools in the testing lifecycle, such as for test generation, defect prediction, or intelligent automation, to improve coverage and efficiency.
• Experience testing non-deterministic systems such as LLM applications, or statistical algorithms—along with familiarity with validation approaches for GenAI or agentic systems (e.g. snapshot testing, LLM-as-a-judge, synthetic test case generation).
• Hands-on familiarity with observability tools (New Relic) and best practices for improving test signal and pipeline feedback loops.
• Experience integrating QA tools like Zephyr Scale and on-prem CI/CD systems (GitHub)
• A strategic mindset paired with a pragmatic, systems-thinking approach to quality at scale.
  
  
  

Perks & Benefits

• Contrato a termino Indefinido¨ with all the legal benefits
• Prepaid Medicine
• Life insurance and funeral assistance
• Internet allowance
• Home office stipend

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

• 5 Personal Time Off days per year
• Sick Leave Top up to total 100% of salary paid by the employer from Day 3 to 90.
• Recognition Award, additional paid time off in recognition of the corresponding year of service
• Upgrade vacation starting at 5 years of service
• Competitive compensation — above the market average
• 100% remote work environment and an excellent work-life balance
• Opportunity to work for a growing global SaaS leader company
• A culture that promotes independence, innovation, trust, and accountability
• Open space to be creative, innovative and strategize for the future
• Mentorship by highly experienced professional
• Budget for training, we want you to grow
• AI-first environment: Be part of an AI-first engineering organization that embraces modern tools, automation, and AI-driven ways of working
  
  
  

What's in it for you:

▪️Innovation is at our core. We work with cutting-edge technology in accounting and financial reporting, constantly pushing the boundaries to create impactful software solutions.

▪️We are committed to a collaborative culture, where your ideas are valued, and knowledge sharing is encouraged within a supportive, inclusive team.

▪️Work-life balance is important to us. We offer flexible work options, remote opportunities, and generous time-off policies to ensure a healthy work-life balance.

▪️We offer competitive compensation, including a competitive salary and comprehensive benefits such as health insurance and retirement plans.

▪️We are driven by impactful work. Your contributions directly affect how our clients manage financial processes and drive their success.

▪️Recognition and rewards matter to us. We celebrate hard work through recognition programs, performance bonuses, and opportunities for career growth.

▪️We embrace global opportunities. Work on international projects and collaborate with a diverse, global team.

About Caseware:

Caseware's cutting-edge software products are meticulously designed for accounting firms, corporations, and governments. Our teams are continually collaborating, innovating, and building upon our existing suite of products. With a customer-focused mindset, we are building technology that is shaping what the future of audits, financial reporting, and financial data analytics will look like.

With a recent strategic investment from Hg Capital in 2020, Caseware is now in its next major growth phase as we double down on the people and products that have made Caseware so successful to date.

One of Caseware's core values is Many Voices, One Team and with that in mind, we're dedicated to building teams as diverse as our customers in an equitable and inclusive way. We welcome and encourage candidates of all backgrounds to apply. Should you require accommodations or have any questions at any point during the application or interview process, please e-mail our People Operations team at [email protected].

AI Usage:

The recruitment process may use AI assisted tools but not for candidate screening or assessment. All final hiring decisions are made by humans to ensure fairness, transparency, and oversight.

Background Check:

Any candidates successful in obtaining an offer for a position will need to successfully complete a background check through Certn.co which typically includes an Identity Verification and Criminal Record Check. Executives and Senior Managers will undergo a Soft Credit Check as well. Candidates residing in the Netherlands and Germany are excluded from undergoing background checks via Certn.co

Security and Fraud:

Caseware takes the security of candidates seriously. All legitimate communication from us will come from email addresses ending in @caseware.com and our open positions are always listed on reputable job boards and on our website https://jobs.lever.co/caseware. We will NEVER ask for payment or financial information from you. If you receive an unsolicited job offer, proceed with extreme caution.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.