Design, develop and optimize scalable data solutions using Azure Databricks and PySpark. Build and maintain enterprise-scale batch and streaming data pipelines with Python and SQL. Collaborate with engineering teams to deliver production-ready ETL/ELT pipelines in a fully remote UK role.
Key Highlights
Key Responsibilities
Technical Skills Required
Benefits & Perks
Nice to Have
Job Description
Senior Python / PySpark Data Engineer (Azure Databricks)
Remote (UK)
£425/day
Outside IR35
Long-Term Contract
About the Role
We're partnering with a global technology organisation delivering enterprise-scale cloud data platforms for major international clients.
We're looking for an experienced Senior Python / PySpark Data Engineer to join an established Azure Data Engineering team, working on the design, development and optimisation of scalable data solutions within Azure Databricks.
This is a hands-on engineering role suited to someone who enjoys solving complex technical challenges, writing high-quality code and taking ownership of technical delivery.
Key Responsibilities
- Design and develop data solutions using Azure Databricks.
- Build scalable data pipelines with Python and PySpark.
- Develop batch and streaming data processing solutions.
- Analyse complex datasets and build efficient data models.
- Deliver robust, production-ready ETL/ELT pipelines.
- Collaborate with other engineers to deliver high-quality cloud data solutions.
Interested in remote work opportunities in Data Science? Discover Data Science Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
Essential Skills
- Strong commercial experience with Azure Databricks.
- Excellent Python and PySpark skills.
- Strong SQL and core Data Engineering experience.
- Experience building enterprise-scale data pipelines.
- Experience with batch and streaming data processing.
- Understanding of Unity Catalog and core Databricks functionality.
Desirable
- Azure DevOps.
- CI/CD pipelines.
- Infrastructure as Code.
- Experience working within enterprise Azure environments.
What We're Looking For
We're looking for engineers who:
- Have strong technical and problem-solving skills.
- Can work independently with minimal supervision.
- Produce clean, maintainable, production-quality code.
- Enjoy working in highly technical engineering teams.
- Take ownership and pride in delivering high-quality solutions.
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
Technology Stack
Azure Databricks • Python • PySpark • SQL • Azure Data Lake • Unity Catalog • Databricks Jobs • Batch & Streaming Processing • Git • Azure DevOps
What's on Offer
- £425/day.
- Outside IR35.
- Fully remote within the UK.
- Long-term contract.
- Immediate interview process.
Opportunity to work on large-scale cloud data engineering programmes.
Interested?
If you're an experienced Python / PySpark Data Engineer with strong Azure Databricks experience and you're looking for your next Outside IR35 contract, we'd love to hear from you.
Apply today or send your CV for a confidential discussion. We're reviewing applications as they come in, with interviews taking place on a rolling basis.
Similar Jobs
Explore other opportunities that match your interests