Senior Data Engineer (Databricks & Big Data)
Lead the design, development, and optimization of scalable data pipelines and lakehouse architectures using Databricks, Apache Spark, and cloud platforms. Drive automation, CI/CD, and performance tuning while ensuring data governance and integration across hybrid environments. Collaborate with cross-functional teams to deliver robust ETL/ELT solutions and enhance data-driven decision-making.
Key Highlights
Key Responsibilities
Technical Skills Required
Benefits & Perks
Nice to Have
Job Description
HYBRID - Atlanta GA
Only W2 - No Corp to Corp
Open to Sponsorship
Required Skills & Experience
Searching for Devops roles that provide visa sponsorship? Connect with international employers through Devops Jobs with Visa Sponsorship opportunities actively seeking talented professionals.
- 8+ years of experience in Data Engineering / Big Data.
- 5+ years of hands-on experience with Databricks.
- Strong experience with Apache Spark / PySpark.
- Strong programming skills in Python and SQL.
- Extensive experience with Delta Lake and Databricks Workflows/Jobs.
- Strong understanding of data lake and lakehouse architectures.
- Hands-on experience with Azure, AWS, or GCP.
- Strong DevOps experience with CI/CD pipelines and automation.
- Experience with Azure DevOps, GitHub, GitLab, or Jenkins.
- Experience with Terraform or Infrastructure as Code.
- Strong experience with Git and source-code management.
- Experience deploying Databricks solutions across multiple environments.
- Strong understanding of ETL/ELT concepts and data integration.
- Experience with performance tuning and optimization of Spark/Databricks workloads.
Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.
Interested in opportunities specifically in United State? Discover our dedicated Visa Sponsorship Jobs in United State page featuring roles from top employers in this location.
Preferred Skills
- Experience with Azure Data Factory (ADF) or similar orchestration tools.
- Experience with Kafka or other streaming technologies.
- Experience with Unity Catalog and Databricks security/governance.
- Experience with REST APIs and Databricks APIs.
- Knowledge of Docker and Kubernetes.
- Experience with automated testing and code-quality tools.
- Databricks or cloud certifications are a plus.
Similar Jobs
Explore other opportunities that match your interests