Job Description
We are seeking a passionate and experienced Data Engineer to join our Fleet IT Products team. You will play a key role in shaping our company-wide fleet data ecosystem, enabling data-driven decision-making across our operations. Your primary focus will be on implementing robust pipelines and building a scalable, high-performance data infrastructure to support various stakeholders in fleet management, operations, and sustainability. If you are driven by innovation and excited to work with cutting-edge cloud and big data technologies, we would love to hear from you.
Why Join Us?
- Play a key role in managing data pipelines and infrastructure using powerful tools to support our fleet operations.
- Work on innovative, data-driven projects that transform our business processes and enhance operational efficiency.
- Be part of a collaborative and forward-thinking team that values continuous improvement and professional development in the data engineering field.
Responsibilities
- Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines to acquire and transform large, complex datasets from vessel-based applications such as sensors, auto-log systems, operational tools, fleet management systems, stowage planning, and nautical systems.
- Cloud Infrastructure Management: Develop and optimize data workflows in cloud environments like AWS and Databricks, ensuring data quality, reliability, and performance standards are met.
- Data Architecture & Modeling: Create and maintain data models and architectures that cater to business requirements, providing a solid foundation for data-driven decision-making.
- CI/CD Implementation: Implement CI/CD pipelines to automate testing, deployment, and integration of data solutions, ensuring seamless delivery and operational efficiency.
- DevOps Practices: Leverage DevOps methodologies and tools (e.g., GitLab CI/CD) to streamline development, deployment, and monitoring of data services.
- Collaboration & Integration: Work closely with cross-functional teams, including Data and Analytics, fleet management, network operations, and sustainability, to understand data needs and translate them into technical solutions.
- Data Exploration & Analytics: Support Data Scientists and BI teams with data explorations and advanced analytics, providing well-structured data sets and optimizing query performance.
- Innovation & Continuous Improvement: Stay up-to-date with emerging trends and technologies in Data Engineering, DevOps, and Cloud Computing to enhance current processes and implement industry best practices.
Qualifications
- Educational Background: Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or a related field.
- Technical Expertise: Knowledge and minimum 3 years of hands-on experience with AWS cloud services, data lake designs and big data technologies in Databricks or Snowflake or relevant other services.
- Programming Skills: Proficiency in programming languages like Python, Pyspark and SQL, with a focus on building scalable data pipelines. Experience with dbt is a plus.
- DevOps & CI/CD Knowledge: Experience with DevOps tools and CI/CD pipelines (e.g., GitLab CI/CD) to ensure continuous integration and delivery of data solutions.
- Orchestration & Workflow Tools: Proficiency with orchestration tools automating complex data workflows (e.g., Airflow). Experience working with Astronomer is a plus.
- Analytical Problem Solving: Proven ability to troubleshoot complex issues, optimize performance, and implement best practices for data engineering.
- Effective Communication: Strong communication skills and the ability to proactively collaborate effectively with cross-functional teams.
Additional Qualifications:
- Fluent in business English, both written and verbal.
- Experience in general operative procedures within logistics/shipping industry is a plus.
About Us
With a fleet of 287 modern container ships and a Vessel Capacity 2.2 million TEU, as well as a Container Capacity 3.2 million TEU including one of the world’s largest and most modern reefer container fleets, Hapag-Lloyd is one of the world’s leading liner shipping companies. In the
Liner Shipping segment, the Company has around 13.500 employees and 400 offices in 139 countries. Hapag-Lloyd has a container capacity of 11.9 million TEU – including one of the largest and most modern fleets of reefer containers. A total of 114 liner services worldwide ensure fast and reliable connections between more than 600 ports across the world. In the
Terminal & Infrastructure segment, Hapag-Lloyd has stakes in 20 terminals in Europe, Latin America, the United States, India, and North Africa. The roughly 2.600 employees assigned to the Terminal & Infrastructure segment deal with terminal-related activities and provide complementary logistics services at selected locations.
About The Team
Knowledge Center in Gdansk
One of the goals of Hapag-Lloyd strategy, is to become more agile in the way we work and to create an environment in which we can make faster and innovative decisions. Knowledge Center in Gdansk enables the further accelerated growth, especially in the area of developing innovative digital solutions, agility and business centricity. To learn more, please check our website - https://knowledgecenter.pl/
We offer:
- Private medical care (Saltus)
- Gym card (Multisport)
- Attractive annual bonus up to 22,5%! (depending on company performance results)
- Group life insurance and employee capital plan (PPK)
- Cafeteria benefit system (cinema tickets, vouchers etc.)
- Focus on healthy lifestyle (fruit days, bike competitions, football trainings)
- Charity and volunteer initiatives
- Modern and well-connected office (Alchemia complex in Gdańsk Oliwa)
- Relocation support (financial support, covering immigration process for non-Polish citizens)
- Internal learning management system
- Development budget (sharing the costs of certifications and conferences/ IT events)
- Flexible working hours and home office possibility (hybrid work model)
