Senior Data Engineer - End-to-End Data System & Analytics

agapi • Ho Chi Minh City Metropolitan Area

Relocation

This Job is No Longer Active This position is no longer accepting applications

AI Summary

Lead end-to-end data system development, optimize Spark performance, design data models, and build complex reports. Requires 4+ years of experience in Data Engineering with strong SQL, Spark SQL, and PySpark skills.

Key Highlights

Build and operate end-to-end data system

Design and develop data pipelines from Bronze to Gold layer

Optimize Spark performance and build data quality frameworks

Design Gold and Diamond data models for analytics and reporting

Looking to advance your Data Science career with relocation support? Explore Data Science Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.

Key Responsibilities

Build and operate the company’s end-to-end data system

Design and develop data pipelines from Bronze to Gold layer

Optimize Spark performance, including partitioning, Z-ordering, and compaction

Develop shared frameworks and reusable components

Understand business requirements and KPI definition

Design Gold and Diamond data models for analytical purposes

Build complex reports and transformations using SQL and PySpark

Implement standardized incremental and backfill workflows

Build and maintain Data Quality frameworks

Perform cross-table and cross-source data validation

Implement anomaly detection and alerting mechanism

Conduct root-cause analysis and reduce recurring data issues

Technical Skills Required

SQL Spark SQL PySpark

Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.

Benefits & Perks

Competitive Compensation

Comprehensive Benefits

Work-Life Balance

Top-Tier Equipment

Thriving Culture

Job Description

Relocation is required; the company will provide a relocation assistance package

Responsibilities: The candidate will be responsible for building and operating the company’s end-to-end data system, including

Track P – Pipeline & Platform

Design and develop data pipelines from Bronze to Silver to Gold layer
Build batch and streaming pipelines, handling late-arriving data, CDC (Change Data Capture), and schema.
Optimize Spark performance, including partitioning, Z-ordering, and compaction
Develop shared frameworks and reusable components (e.g., joins, utilities, data quality pre-checks

Track A – Analytics & Reporting

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.