Seeking an experienced senior architect to design scalable data solutions on Databricks and AWS for organizational analytics. The role involves leading architecture, integration, security, and automation efforts in a remote setting. Ideal candidates will have extensive experience in data architecture, cloud platforms, and team leadership.
Key Highlights
Technical Skills Required
Benefits & Perks
Job Description
Role: Databricks Senior Architect
Location: Remote Role but looking resources from Philadelphia PA or Washington DC.
Duration: 1 year and ideally contract to hire.
Job Overview:
We are seeking an experienced Data Platform Architect to guide the design and implementation of a scalable data solution for Databricks on AWS. The ideal candidate will have a strong background in data architecture, data integration, and data processing frameworks, with prior hands-on expertise in Databricks and a passion for optimizing diverse workloads.
Key Responsibilities:
•Design the data architecture for the platform and organizational use cases, focusing on scalability, performance, and support for advanced analytics and data science workloads.
•Ensure the platform supports multi-cloud operations, data sharing, and integration with various data sources, including on-premises and cloud environments.
•Ensure the platform integrates with various data delivery mechanisms including architecting data delivery mechanisms such as streaming, batch, and leveraging API’s for encryption and decryption.
•Collaborate with Cloud Architects and Engineers to implement data governance, financial governance, and compliance features .
•Identify and architect automation approaches to simplify and accelerate CI/CD across multiple environments, onboarding of new users to the platform, creation of development workspaces, data quality enforcement, and integrated testing.
•Optimize the platform for handling diverse workloads, relational operations, and multi-model data processing.
•Develop and implement data ingestion and data processing frameworks, ensuring efficient and scalable data pipelines for common patterns.
•Architect and maintain data Lakehouse storage solutions, emphasizing best practices for data modeling and schema design.
•Provide guidance on best practices for data preparation exploration, and visualization within the platform.
•Lead client facing workshops and influence change and acceptance to modern data platform practices.
•Provide client-facing support, ensuring clear communication and understanding of technical solutions.
•Collaborate with stakeholders to document enterprise rollout strategies, data security blueprints, and architectural standards.
Qualifications:
•Degree in Computer Science, a technical field, or a related business field. Master degree preferred
•3+ years of experience in designing and leading Databricks implementations
•8+ years of experience in relevant technology roles, with a focus on data architecture.
•5+ years in an advanced role, demonstrating leadership in guiding teams directly or indirectly.
•5+ years of experience in architecting and maintaining big data platform architecture utilizing AWS Data & Analytics Services
•Strong Data Modeling experience
•Strong expertise in designing and supporting complex application architectures, including integration of disparate data sources.
•Experience in documenting enterprise rollout strategies and developing data security blueprints.
•Excellent communication skills
Work Environment:
•Remote acceptable.
•Ability to travel to Philadelphia PA or Washington DC.
•Must work Eastern time zone
•This role does not provide visa sponsorship now, nor will it in the future.
Similar Jobs
Explore other opportunities that match your interests