Senior QA Automation Engineer

CSI Companies is seeking a Senior QA Automation Engineer with strong experience testing modern data platforms and big data environments. This role will focus on validating data pipelines, distributed systems, and cloud-based workflows using Databricks and PySpark. The ideal candidate will bring a strong automation mindset, experience with end-to-end testing strategies, and the ability to collaborate closely with cross-functional teams including product, engineering, and leadership.

Hours/Location/Pay/Position Type

Hours: Monday–Friday standard business hours | 40 hours/week

Location: Fully Remote

Pay: $40-$53/hour based on experience

Position Type: Contract – No C2C

Work Authorization

Candidates must be eligible to work on W2 and must not require sponsorship.

What you’ll do

• Design and execute test strategies for data pipelines, big data workflows, and distributed systems within Databricks environments.
• Develop and maintain automated tests using PySpark to validate large-scale data processing and transformations.
• Perform end-to-end validation of data workflows across Spark-based systems and data lake architectures.
• Integrate automated testing into CI/CD pipelines to support continuous delivery of data solutions.

Interested in remote work opportunities in Data Science? Discover Data Science Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

• Use QMetry to manage test cases, track defects, and maintain reporting on QA efforts.
• Collaborate with product owners, scrum masters, and technical leads to align testing with business and technical requirements.
• Identify defects, data inconsistencies, and performance issues across complex data systems.

What we’re looking for

• 6–9+ years of experience in QA with a strong focus on automation and data testing.
• Hands-on expertise in Databricks and PySpark for testing data pipelines and large-scale data workflows.
• Proven experience using QMetry for test management, defect tracking, and reporting.
• Strong understanding of Spark architecture, distributed computing, and data lake ecosystems.
• Experience working with cloud platforms and modern data engineering environments.
• Experience integrating automated tests into CI/CD pipelines.
• Strong collaboration skills with the ability to guide QA efforts and work cross-functionally with product and engineering teams.

Nice to have

• Experience testing ETL pipelines or data warehouse solutions.
• Familiarity with performance testing in big data environments.
• Exposure to additional automation frameworks or scripting languages.

Who Should Apply?

This role is ideal for a senior QA professional who thrives in data-heavy environments and enjoys working with modern big data technologies. Candidates who have hands-on experience testing Databricks and PySpark-based systems and want to take ownership of QA strategy in a collaborative environment will be a strong fit.

About Us

The CSI Companies is a leading staffing and recruiting firm, providing healthcare organizations with highly skilled professionals since 1994. We have been recognized as a “Best of Staffing” award winner for over a decade, and we pride ourselves on delivering exceptional talent to leading healthcare organizations. For consideration, please submit your resume with relevant experience. Only candidates selected for interviews will be contacted.

Benefits Offered

• Weekly pay
• Medical, dental, and vision coverage
• Voluntary Life and AD&D coverage
• Paid Training
• Opportunity for advancement upon performance and availability