T
AI Summary
Design, build, and optimize scalable ETL/ELT pipelines using Databricks and Apache Spark. Develop high-performance data solutions on cloud platforms, primarily Azure. Collaborate with IT and business stakeholders to deliver curated and analytics-ready datasets.
Key Highlights
Design and optimize ETL/ELT pipelines
Develop high-performance data solutions on Azure
Collaborate with IT and business stakeholders
Key Responsibilities
Design, build, and optimize scalable ETL/ELT pipelines using Databricks and Apache Spark.
Develop high-performance data solutions on cloud platforms, primarily Azure.
Ensure data quality, reliability, scalability, and performance across data workflows.
Collaborate with IT and business stakeholders to deliver curated and analytics-ready datasets.
Automate and orchestrate workflows using Databricks Jobs, CI/CD pipelines, and related tools.
Implement best practices around data governance, monitoring, and platform security.
Technical Skills Required
Benefits & Perks
100% remote work
EST hours
Nice to Have
Retail industry experience
Job Description
Duration: 12+ months
Location: 100% remote (EST hours)
Responsibilities
- Design, build, and optimize scalable ETL/ELT pipelines using Databricks and Apache Spark.
- Develop high-performance data solutions on cloud platforms, primarily Azure.
- Ensure data quality, reliability, scalability, and performance across data workflows.
- Collaborate with IT and business stakeholders to deliver curated and analytics-ready datasets.
- Automate and orchestrate workflows using Databricks Jobs, CI/CD pipelines, and related tools.
- Implement best practices around data governance, monitoring, and platform security.
Interested in remote work opportunities in Data Science? Discover Data Science Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
Qualifications
- Strong hands-on experience with Databricks, Apache Spark (PySpark and/or Scala), SQL, and Kafka.
- Experience building data solutions in cloud environments such as Azure, AWS, or GCP.
- Knowledge of Delta Lake, CDC, distributed data processing, and data modeling concepts.
- Familiarity with Git, CI/CD pipelines, and workflow orchestration tools.
- Solid understanding of data architecture, performance tuning, and optimization techniques.
- Retail industry experience is a plus.
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
Similar Jobs
Explore other opportunities that match your interests
Visa Sponsorship
Relocation
Remote
Job Type
Contract
Experience Level
Mid-Senior level
Delta System & Software, Inc.
United State
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Associate
talenthop
United State
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Not Applicable
KBR Careers
United State