T

Senior Data Engineer

the brixton group United State
Remote
Apply
AI Summary

Design, build, and optimize scalable data platforms for enterprise analytics and data-driven decision-making. Develop modern batch and real-time data processing solutions, cloud-based data infrastructure, and high-performance data pipelines. Requires 10+ years of Data Engineering experience with strong expertise in Apache Spark and Python.

Key Highlights
10+ years of Data Engineering experience required
Strong expertise in Apache Spark and Python
Design and build scalable batch and real-time data processing pipelines
Key Responsibilities
Design, develop, and maintain scalable batch and real-time data processing pipelines
Build high-performance, fault-tolerant data processing systems using technologies such as Apache Spark, Apache Flink, Apache Druid, or similar frameworks
Develop and optimize Extract, Transform, Load (ETL) pipelines and data models supporting analytics and reporting
Write and optimize complex SQL queries for large-scale data analysis
Build and maintain cloud-based data warehousing and data infrastructure solutions
Collaborate with cross-functional teams to integrate data from multiple sources while ensuring data quality, consistency, and reliability
Monitor, troubleshoot, and optimize pipeline performance, scalability, and operational efficiency
Evaluate and implement modern data engineering best practices and emerging technologies
Technical Skills Required
Apache Spark Python
Benefits & Perks
100% REMOTE

Job Description



Duration: 6+ months
Location: 100% REMOTE

*** U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor or transfer visas at this time. ***

 *** No Vendors/3rd parties. ***

We are seeking an experienced Senior Data Engineer to design, build, and optimize scalable data platforms that support enterprise analytics and data-driven decision-making. This role is responsible for developing modern batch and real-time data processing solutions, cloud-based data infrastructure, and high-performance data pipelines that enable reliable, efficient, and secure data operations.

Requirements:
  • 10+ years of Data Engineering experience.
  • Strong expertise in Apache Spark and Python.
  • Experience building scalable ETL pipelines and distributed data processing systems.
Responsibilities:
  • Design, develop, and maintain scalable batch and real-time data processing pipelines.
  • Build high-performance, fault-tolerant data processing systems using technologies such as Apache Spark, Apache Flink, Apache Druid, or similar frameworks.
  • Develop and optimize Extract, Transform, Load (ETL) pipelines and data models supporting analytics and reporting.
  • Write and optimize complex SQL queries for large-scale data analysis.
  • Build and maintain cloud-based data warehousing and data infrastructure solutions.
  • Collaborate with cross-functional teams to integrate data from multiple sources while ensuring data quality, consistency, and reliability.
  • Monitor, troubleshoot, and optimize pipeline performance, scalability, and operational efficiency.
  • Evaluate and implement modern data engineering best practices and emerging technologies.
26-00723

Similar Jobs

Explore other opportunities that match your interests

Senior Data Engineer (Azure)

Data Science
1h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

Talener

United State

AI Data Engineer

Data Science
6h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

Bright Vision Technologies

United State

Senior Finance Analytics & BI Specialist

Data Science
9h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Dynatrace

United State

Subscribe our newsletter

New Things Will Always Update Regularly