Senior Data Engineer, Digital Transformation

Bounteous • United States

Visa Sponsorship

This Job is No Longer Active This position is no longer accepting applications

AI Summary

Bounteous seeks a Senior Data Engineer to lead pipeline and consumption pattern migration to a Lakehouse environment. Responsibilities include refactoring logic, data transfer, and stakeholder engagement. Requires 5+ years of coding experience, Python/Java proficiency, and expertise in data modeling and SQL.

Key Highlights

Lead migration of data pipelines and consumption patterns to a Lakehouse environment.

Ensure data integrity and functional equivalence through rigorous validation and reconciliation.

Act as a technical liaison, facilitating stakeholder sign-offs and ensuring business requirements are met.

Searching for Data Science roles that provide visa sponsorship? Connect with international employers through Data Science Jobs with Visa Sponsorship opportunities actively seeking talented professionals.

Key Responsibilities

Refactoring and migrating extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment.

Executing the physical migration of underlying datasets while ensuring data integrity.

Acting as a technical liaison to internal clients, facilitating "handoff and sign-off" conversations with data owners to ensure migrated assets meet business requirements.

Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility with Snowflake and Iceberg.

Understanding usage patterns to deliver the required data products.

Working with reconciliation frameworks to build confidence that migrated data is functionally equivalent to that already used within production flows.

Promote and enforce awareness of key information security practices, including acceptable use of information assets, malware protection, and password security protocols.

Identify, assess, and report security risks, focusing on how these risks impact the confidentiality, integrity, and availability of information assets.

Understand and evaluate how data is stored, processed, or transmitted, ensuring compliance with data privacy and protection standards (GDPR, CCPA, etc.).

Ensure data protection measures are integrated throughout the information lifecycle to safeguard sensitive information.

Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.

Technical Skills Required

Python Java SQL Spark Kafka ANSI SQL FTP JSON Avro Parquet Hadoop HDFS Hive Snowflake Apache Iceberg Sybase IQ CI/CD K8s

Interested in opportunities specifically in United State? Discover our dedicated Visa Sponsorship Jobs in United State page featuring roles from top employers in this location.

Benefits & Perks

$110,000 - $125,000 a year

Job Description

Bounteous is a premier end-to-end digital transformation consultancy dedicated to partnering with ambitious brands to create digital solutions for today’s complex challenges and tomorrow’s opportunities. With uncompromising standards for technical and domain expertise, we deliver innovative and strategic solutions in Strategy, Analytics, Digital Engineering, Cloud, Data & AI, Experience Design, and Marketing.

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.