S

Senior Data Engineer (Databricks & PySpark)

System Soft Technologies • United State
Remote Visa Sponsorship
Apply Now

Experienced Data Engineer required to build and maintain cloud-based ETL/ELT pipelines using Databricks Lakehouse Architecture. Responsibilities include developing large-scale data migrations and supporting production data pipelines for financial and regulatory reporting. Requires 12-15 years of overall experience with deep expertise in PySpark, Spark SQL, and AWS ecosystem.

Key Highlights
12-15 years of overall professional experience
Expertise in Databricks Lakehouse Architecture and PySpark
Experience with large-scale data migration and modernization
Key Responsibilities
Develop cloud-based ETL/ELT pipelines using Databricks and modern data engineering platforms.
Implement data processing solutions using PySpark, Spark SQL, and Apache Spark.
Manage data storage and orchestration using AWS S3, Snowflake, Apache Airflow, and AWS Glue.
Design and implement data modeling and data warehousing solutions for big data processing.
Support production data pipelines and perform data validation and reconciliation.
Execute large-scale data migration and modernization projects.
Develop analytics for customer segmentation, campaigns, and AML/regulatory reporting.
Technical Skills Required
Databricks PySpark Amazon Web Services
Benefits & Perks
Remote work
Visa sponsorship
Nice to Have
Experience in regulatory reporting, AML, compliance, or financial data
CI/CD and DevOps experience
Experience with Delta Lake, Databricks Workflows, and Unity Catalog
Knowledge of Agile/Scrum methodologies

Job Description

Remote

Only W2 - No Corp to Corp

Open to Sponsorship

Please - NO - OPT's or EAD's

Must have 12-15 years overall exp

Required Skills

  • Hands-on experience with Databricks and modern data engineering platforms.
  • Strong expertise in PySpark, Spark SQL, Apache Spark, and Databricks Lakehouse Architecture.
  • Experience developing cloud-based ETL/ELT pipelines.
  • Strong experience with AWS S3, Snowflake, Apache Airflow, and AWS Glue.
  • Knowledge of data modeling, data warehousing, and big data processing.
  • Experience with JSON, Parquet, Avro, and CSV.
  • Hands-on experience with data quality frameworks and monitoring.
  • Strong SQL and data analysis skills.

Preferred Skills

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources

Similar Jobs

Explore other opportunities that match your interests

Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

Serco

United State

Azure Cloud Engineer

Devops
•
3h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

intellibee inc

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

ronaj recruitment

United State

Subscribe our newsletter

New Things Will Always Update Regularly