madiff company
The client is a company focused on energy efficiency in buildings, in line with the goals set forth by the European Union to reduce energy consumption. We gather data from various sources such as building management systems, user feedback, and sensors to analyze energy demand and waste. Using machine learning algorithms, we optimize building automation systems in real-time to reduce energy costs while improving user comfort. They aim to reduce energy consumption by up to 40% through innovative technology and data-driven insights.
We are looking for a skilled Data Engineer to join our team. This is a very exciting role with a lot of room for creativity and opportunities for learning and developing your skills. The candidate will work closely with the software and data science teams to develop the company data infrastructure (databases and data pipelines).
Important skills:
- Solid knowledge of relational databases and SQL.
- Around 4 years experience in a similar role.
- Experience with NoSQL databases, especially MongoDB and Bigtable.
- Good understanding of data modeling (ER models, normalization, etc.).
- Experience with streaming data platforms (e.g. Kafka, Spark streaming).
- General knowledge of current tools, best practices, methodologies, etc.
- Excellent coding skills with at least one of Python, Scala, and Java.
- Good communication skills are essential.
Nice to have:
- Experience with AWS.
- Understanding of DBMS's settings, performance, and tuning.
- Aptitude for automation and infrastructure-as-code.
- Ability to lead and coach.
Responsibilities:
- Write and maintain efficient, scalable data pipelines and data processing code.
- Create and maintain data models in collaboration with domain experts and software engineers.
- Set up and own infrastructure and DBMSs (both SQL and NoSQL).
- Evaluate company's data needs with product owners and data scientists.
Perks:
- Flexible office hours and WFH days.
- Learning budget.
- Informal and easygoing environment.
- Room to do things your way.
- Relocation support for those outside of Portugal.