Re-engineer existing ingestion and lakehouse platforms on AWS, focusing on Apache Iceberg table management and automated recovery processes. Redesign retention, compaction, and recovery strategies to automate manual restores and introduce publish gates. Requires 5+ years of data engineering experience with AWS, strong Python proficiency, and advanced English skills.
Key Highlights
Re-engineer existing ingestion and lakehouse code across Lambda, Glue, EventBridge, and Step Functions
Manage Apache Iceberg tables in the Gold zone, including retention and compaction strategy
Redesign recovery processes to automate restores that were previously manual
Interested in remote work opportunities in Devops? Discover Devops Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
Key Responsibilities
Read and re-engineer existing ingestion and lakehouse code across Lambda, Glue, EventBridge, and Step Functions
Manage Apache Iceberg tables in the Gold zone, including retention and compaction strategy
Redesign recovery processes to automate restores that were previously manual
Introduce write-audit-publish patterns to prevent bad writes from landing silently
Work with Kafka on MSK for event processing across the pipeline
Technical Skills Required
Amazon Web Services
Apache Iceberg
Python
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
Benefits & Perks
100% remote work (from anywhere)
Excellent compensation in USD or your local currency if preferred
Hardware and software setup for you to work from home
Flexible hours: create your own schedule
Paid parental leaves, vacations, and national holidays
Job Description
At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.Senior AWS Data Engineer at BairesDev
Want the full job description?
Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn
This is a short excerpt. All rights to the full description belong to its original publisher.
