I

Senior Data Engineer - Real-time ML Data Platform

impala search • Germany
Relocation
Apply
AI Summary

Build and scale high-throughput real-time data pipelines for a leading rewarded advertising platform's AI systems. Key responsibilities include optimizing distributed data systems and enabling intelligent decision-making at scale. Requires 5+ years of data engineering experience with Flink, Kafka, and Java, plus AWS and ML/DS collaboration.

Key Highlights
Build and scale real-time streaming data pipelines for production ML systems.
Optimize large-scale ETL and streaming workloads for performance and reliability.
Shape the future architecture of the company's cloud data platform.
Key Responsibilities
Build and scale real-time streaming data pipelines supporting production ML systems.
Develop and enhance feature engineering infrastructure used by Data Scientists.
Improve data quality through monitoring, validation and governance.
Optimise large-scale ETL and streaming workloads for performance and reliability.
Collaborate closely with Data Science and Backend Engineering teams.
Build ingestion frameworks for new and evolving data sources.
Help shape the future architecture of the company's cloud data platform.
Take ownership of technical decisions and platform scalability.
Technical Skills Required
Apache Flink Kafka Java
Benefits & Perks
Full relocation support
Nice to Have
Go or Python development experience
Experience processing TB-scale datasets and high-throughput event streams.
Hands-on experience with AWS, Airflow, dbt, Terraform, and Kubernetes.
Experience working with Machine Learning or Data Science teams in production environments.
Understanding of Data Lakes, Feature Stores, Lakehouse architecture, and modern data modelling.
Comfortable owning architecture and working across multiple engineering teams.

Job Description



Our client is building the intelligence layer behind one of the world's largest rewarded advertising platforms, helping 770+ million users discover and engage with new mobile apps every year. Their machine learning systems make 200+ million decisions daily, processing 100,000+ predictions per second from a 1PB+ behavioural data platform. Backed by a $100 million strategic investment, they're expanding the engineering team responsible for the real-time data infrastructure powering next-generation AI systems.


You'll join as a Senior Data Engineer, helping build one of the industry's highest-scale ML data platforms. You'll engineer real-time pipelines, optimise distributed data systems, and enable intelligent decision-making across infrastructure handling 100,000+ predictions every second.


Key Responsibilities

  • Build and scale real-time streaming data pipelines supporting production ML systems.
  • Develop and enhance feature engineering infrastructure used by Data Scientists.
  • Improve data quality through monitoring, validation and governance.
  • Optimise large-scale ETL and streaming workloads for performance and reliability.
  • Collaborate closely with Data Science and Backend Engineering teams.
  • Build ingestion frameworks for new and evolving data sources.
  • Help shape the future architecture of the company's cloud data platform.
  • Take ownership of technical decisions and platform scalability.


Qualifications

  • 5+ years of commercial Data Engineering experience building production data platforms.
  • Strong experience with Apache Flink, Kafka, and real-time streaming architectures.
  • Professional Java development experience, with Go or Python considered a bonus.
  • Experience processing TB-scale datasets and high-throughput event streams.
  • Hands-on experience with AWS, Airflow, dbt, Terraform, and Kubernetes.
  • Experience working with Machine Learning or Data Science teams in production environments.
  • Understanding of Data Lakes, Feature Stores, Lakehouse architecture, and modern data modelling.
  • Comfortable owning architecture and working across multiple engineering teams.


Location: Hamburg, Germany (Hybrid, 3 days onsite) with full relocation support available.


If you're excited by the opportunity to build the data platform behind AI systems serving hundreds of millions of users worldwide, while owning architecture and solving genuinely complex engineering challenges at scale, we'd love to hear from you.



Similar Jobs

Explore other opportunities that match your interests

Junior Manager of Price & Discount Strategy

Data Science
•
1h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

HelloFresh

Germany

Data Analyst

Data Science
•
4h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

n26

Germany

Senior Marketing Data Analyst - Marketing Mix Modelling (Acquisition)

Data Science
•
1w ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

n26

Germany

Subscribe our newsletter

New Things Will Always Update Regularly