Senior Data Engineer (Databricks & Big Data)

System Soft Technologies • United State

Remote Visa Sponsorship

Apply Now

AI Summary

Lead the design, development, and management of scalable data pipelines and workflows using Databricks, PySpark, and Delta Lake. Oversee ETL/ELT processes, SQL-based transformations, and Azure Databricks integrations to optimize data warehousing and analytics. Collaborate with cross-functional teams to ensure seamless data flow and system reliability.

Key Highlights

12-15 years of hands-on experience in Databricks, PySpark, and Delta Lake

Expertise in developing and managing Databricks Jobs/Workflows and YAML-based CI/CD pipelines

Deep knowledge of Azure Databricks, ADLS Gen2, and dimensional modeling for data warehousing

Searching for Data Science roles that provide visa sponsorship? Connect with international employers through Data Science Jobs with Visa Sponsorship opportunities actively seeking talented professionals.

Key Responsibilities

Design, implement, and maintain scalable data pipelines using Databricks, PySpark, and Delta Lake

Develop and manage Databricks Jobs/Workflows to automate data processing and analytics workflows

Develop and optimize SQL-based transformations and ETL/ELT processes for data warehousing

Collaborate with teams to integrate Azure Databricks with ADLS Gen2 and other Azure services

Ensure data quality, performance, and reliability of data infrastructure

Technical Skills Required

Databricks PySpark SQL

Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.

Benefits & Perks

Remote work eligibility

Visa sponsorship available

Job Description

REMOTE

ONLY W2 - NO CORP TO CORP

OPEN TO SPONSORSHIP

MUST HAVE 12-15 YEARS OF EXP

MUST HAVE

Strong hands-on experience with Databricks, PySpark, Spark SQL, and Delta Lake.
Experience developing and managing Databricks Jobs/Workflows.
Strong SQL and Python programming skills.
Experience with YAML-based CI/CD pipelines and source control tools such as Git.
Experience with Azure Databricks, ADLS Gen2, and Azure ecosystem.

Knowledge of data warehousing, dimensional modeling, and ETL/ELT design patterns