D

Data Platform Engineer (Senior) - Databricks & Azure

delphi-us • United States
Full Remote
Apply Now

Senior Data Platform Engineer role focused on managing and optimizing enterprise data infrastructure on Databricks and Azure. Responsibilities include administering Databricks workspaces, managing Azure data services, tuning Spark jobs, and developing AI-native DataOps capabilities. Requires 5+ years of platform engineering experience with deep expertise in Databricks, Azure, and data governance.

Key Responsibilities
Administer and optimize Databricks workspace and Delta Lake lifecycle management
Manage Unity Catalog access controls, governance policies, and data lineage
Tune Spark jobs for performance, reliability, and cost efficiency
Operate Azure data services stack (ADLS Gen2, ADF, Azure Monitor, etc.)
Collaborate on networking, security, and resource provisioning with Azure teams
Drive cost governance and storage lifecycle policies
Support multi-platform data systems (ADF, Synapse, Cosmos DB, Azure SQL Server)
Own CI/CD pipelines for data workflows with automation and testing
Manage identity and access via Azure AD, RBAC, and Unity Catalog permissions
Maintain environment parity across Dev, Staging, and Production
Build AI-powered platform observability tools with ML models
Design disaster recovery strategies for Delta tables and workspaces
Technical Skills Required
Databricks (Unity Catalog, Delta Lake, Spark) Azure (ADLS Gen2, ADF, Azure Monitor, Key Vault) Infrastructure-as-Code (Terraform)
Nice to Have
Experience with Synapse Analytics, Cosmos DB, or Azure SQL Server
Familiarity with Databricks Mosaic AI or Genie
Data lineage and metadata management experience
Background in legacy BI migration or platform modernization
Experience with Linear for sprint planning

Job Description

The Data Platform Engineer role focuses on managing and optimizing enterprise data infrastructure built on Databricks and Azure. This senior-level position requires deep technical expertise in platform operations, governance, and supporting AI-enabled data workflows within a cloud environment.

Key Responsibilities

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Remote Work Guides

Practical guides for finding and thriving in remote roles.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.