B

Senior Data Engineer - Databricks Lakehouse Architect

BairesDev Greater Rio De Janeiro
Remote
Apply
AI Summary

Design and optimize scalable data pipelines and models in Databricks lakehouse environments for high-throughput processing. Transform raw datasets into production-ready data products using Medallion Architecture and dbt. Ensure data integrity, reliability, and governance through automated testing and quality checks.

Key Highlights
4+ years of experience in Data Engineering or Software Engineering
Expertise in Databricks lakehouse environments and Medallion Architecture
Proficiency in Apache Airflow, dbt, SQL, and Apache Spark
Key Responsibilities
Architect and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark for high-throughput data processing
Design and implement durable data models and schemas within a Medallion Architecture (Bronze, Silver, Gold layers)
Orchestrate complex data workflows and manage task dependencies using Airflow to ensure data freshness and reliability
Leverage dbt and SQL to transform raw datasets into clean, well-documented, and production-ready data products
Optimize pipeline performance and compute resource usage through effective partitioning, caching, and query tuning
Implement data quality checks and automated testing standards to ensure the integrity and governance of the data lakehouse
Technical Skills Required
Databricks Apache Spark SQL
Benefits & Perks
100% remote work
Hardware and software setup for home office
Flexible hours and paid time off

Job Description


At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Data Engineer (Databricks) at BairesDev

As a Senior Data Engineer (Databricks), you will design and optimize robust data pipelines and models within lakehouse environments. You will ensure data assets are scalable, reliable, and accessible, acting as a technical anchor to drive analytics and operational excellence.

What You'll Do

  • Architect and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark for high-throughput data processing.
  • Design and implement durable data models and schemas within a Medallion Architecture (Bronze, Silver, Gold layers).
  • Orchestrate complex data workflows and manage task dependencies using Airflow to ensure data freshness and reliability.
  • Leverage dbt and SQL to transform raw datasets into clean, well-documented, and production-ready data products.
  • Optimize pipeline performance and compute resource usage through effective partitioning, caching, and query tuning.
  • Implement data quality checks and automated testing standards to ensure the integrity and governance of the data lakehouse.

What We Are Looking For

  • 4+ years of experience in Data Engineering or Software Engineering.
  • Proven expertise in designing and optimizing data pipelines in Databricks lakehouse environments.
  • Proficiency in orchestrating complex workflows using Apache Airflow.
  • Hands-on experience with data transformation and modeling using dbt and SQL.
  • Strong background in building scalable and maintainable analytics-ready datasets.
  • Advanced proficiency in English.

How we do make your work (and your life) easier:

  • 100% remote work (from anywhere).
  • Excellent compensation in USD or your local currency if preferred
  • Hardware and software setup for you to work from home.
  • Flexible hours: create your own schedule.
  • Paid parental leaves, vacations, and national holidays.
  • Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
  • Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!

Apply now!

#BD-PRIO-2026

Similar Jobs

Explore other opportunities that match your interests

Databricks Data Engineer (Apache Spark) at BairesDev

Data Science
1d ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

BairesDev

Greater Rio De Janeiro

Senior Data Engineer

Data Science
1d ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

BairesDev

Greater Rio De Janeiro

Senior Data Engineer (Azure Databricks) - Cloud Data Pipeline Architect

Data Science
1w ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

BairesDev

Greater Rio De Janeiro

Subscribe our newsletter

New Things Will Always Update Regularly