H

Data Engineer

hire top talent • United Kingdom
Visa Sponsorship
This Job is No Longer Active This position is no longer accepting applications
AI Summary

Join a growing data and engineering team to build and scale a modern market intelligence platform. Design, develop, and maintain data pipelines, ETL workflows, web scrapers, and cloud-based data solutions. Collaborate with cross-functional teams to support business intelligence and reporting needs.

Key Highlights
Design, build, and maintain scalable ETL/ELT pipelines
Develop and maintain web scraping solutions
Collaborate with cross-functional teams
Key Responsibilities
Design, build, and maintain scalable ETL/ELT pipelines
Develop and maintain web scraping solutions
Collaborate with cross-functional teams
Technical Skills Required
Python SQL GCP AWS Azure Playwright Scrapy Git Docker Linux CI/CD workflows
Benefits & Perks
Hybrid working model
Opportunity to work on cutting-edge AI, automation, and data engineering projects
Exposure to modern cloud and data technologies
Nice to Have
BigQuery
Dataform
Cloud Run
Firestore
LLM APIs
AI-powered workflows
Data testing frameworks
BI and visualisation platforms

Job Description


Data Engineer

📍 Location: London, UK (Hybrid Working)

đź•’ Job Type: Full-Time

🚀 Visa Sponsorship: Considered for the right candidate

The Role

We are looking for a talented Data Engineer to join a growing data and engineering team, helping to build and scale a modern market intelligence platform.

This is a hands-on role where you will design, develop, and maintain data pipelines, ETL workflows, web scrapers, and cloud-based data solutions, supporting the collection and transformation of millions of data points across multiple markets.

You will work closely with data, engineering, and business stakeholders to deliver reliable, high-quality datasets that drive decision-making and innovation.

Key Responsibilities
  • Design, build, and maintain scalable ETL/ELT pipelines using Python and cloud technologies
  • Develop and maintain web scraping solutions to collect large-scale data efficiently
  • Create and optimise SQL transformation workflows and analytics-ready datasets
  • Build and support LLM-powered workflows within data pipelines
  • Implement data validation, quality control, and monitoring frameworks
  • Collaborate with cross-functional teams to support business intelligence and reporting needs
  • Improve performance, reliability, and scalability of data systems
  • Stay up to date with emerging technologies and best practices in data engineering
Required Skills & Experience
  • 3+ years of experience as a Data Engineer or similar role
  • Strong experience with Python and production-grade data pipelines
  • Advanced SQL skills with experience optimising complex queries
  • Experience working with cloud platforms such as GCP, AWS, or Azure
  • Experience with web scraping technologies (Playwright, Scrapy, or similar)
  • Knowledge of Git, Docker, Linux, and CI/CD workflows
  • Experience integrating APIs and modern data services into pipelines
  • Strong analytical, troubleshooting, and problem-solving skills
  • Excellent communication and collaboration abilities
Desirable Skills
  • Experience with BigQuery, Dataform, Cloud Run, Firestore, or similar cloud services
  • Knowledge of LLM APIs (OpenAI, Gemini, etc.) and AI-powered workflows
  • Experience with data testing frameworks such as Pytest or Great Expectations
  • Familiarity with Terraform or Infrastructure as Code (IaC) tools
  • Experience with BI and visualisation platforms (Power BI, Tableau, Looker)
  • Exposure to machine learning or data science environments
Technical Environment

You will work with modern technologies including:

  • Python, SQL, YAML
  • Cloud Platforms (GCP/AWS/Azure)
  • Docker, GitHub, GitHub Actions, Linux
  • Big Data & ETL Tools
  • LLM & AI Integrations
  • Data Validation & Monitoring Frameworks
What We Offer

âś” Hybrid working model

âś” Opportunity to work on cutting-edge AI, automation, and data engineering projects

âś” Exposure to modern cloud and data technologies

âś” Collaborative and fast-growing environment

âś” Career progression and professional development opportunities

Apply

If you are passionate about data engineering, cloud platforms, automation, and AI-driven solutions, we would love to hear from you.

Apply now with your CV.


Similar Jobs

Explore other opportunities that match your interests

Business Analyst

Data Science
•
2d ago
Visa Sponsorship Relocation Remote
Job Type Internship
Experience Level Not Applicable

social security scotland

United Kingdom

Data Engineer

Data Science
•
5d ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

solve intelligence

United Kingdom
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

homeprotect home insurance

United Kingdom

Subscribe our newsletter

New Things Will Always Update Regularly