Senior Data Engineer (Databricks, AI Data Governance)

arionkoder • Greater Rio De Janeiro

Remote

Apply Now

AI Summary

Lead the design and implementation of a governed data foundation on Databricks, ensuring data accuracy, consistency, and security for AI agents, applications, and business teams. Own data modeling, access control, and API development while collaborating with stakeholders to resolve business definitions and conflicts. Drive autonomous, high-impact data engineering with AI tools to accelerate workflows.

Key Highlights

Own end-to-end data governance, including entity resolution, temporal validity, and access control in production

Build and maintain scalable data pipelines, APIs, and MCP tools on Databricks with Unity Catalog

Work autonomously with business stakeholders to challenge unclear definitions and prioritize risk-driven outcomes

Key Responsibilities

Design and implement ingestion pipelines for structured/unstructured data from ERP, CRM, and document repositories

Resolve entity conflicts across systems and model business facts with provenance, validity periods, and access controls

Enforce row-level security, column masking, and role-based access in Databricks and derived data layers

Develop APIs/webhooks for deterministic data access with caller identity and permission enforcement

Collaborate with AI engineers to provide trusted data for knowledge retrieval and agent behavior

Document and hand over work to client teams while maintaining data quality and observability

Optimize data modeling for history-aware techniques (SCD Type 2, effective dating) and temporal validity

Interested in remote work opportunities in Data Science? Discover Data Science Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

Technical Skills Required

Databricks (Unity Catalog) SQL Python

Benefits & Perks

Monthly USD Service Fee

20 business days of paid Agreed Time Off (Annual + 6 Local Holidays)

Caregiver Time Off

Dynamic remote work culture (work from anywhere)

Entrepreneurial environment

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Nice to Have

Multi-tenant data isolation for customer-facing products

Finance/CRM data experience (NetSuite, Salesforce)

Unstructured content ingestion (documents, contracts) alongside structured data

FinOps/cost attribution on data platforms

Experience with change data capture (CDC) and streaming frameworks

Job Description

Arionkoder is an AI consulting firm helping companies build, embed, and own AI systems that drive real business outcomes. We combine Product Development, Artificial Intelligence, and Team Augmentation to craft digital products and solutions that create lasting impact — guided by a human-centric approach and a commitment to pushing the boundaries of what technology can do.

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.