Our client is a provider of IT business analytics applications that harness the power of the cloud to rapidly deliver actionable business insights to IT leaders. Their solutions help organizations improve operational efficiency, reduce risk, and drive strategic decision-making by leveraging advanced analytics.
About the Role:
We are seeking a skilled Data Engineer to join our client's data analytics team. In this remote role, you will be responsible for building and managing data pipelines, working with complex SQL queries, and utilizing Azure Data Factory (ADF) and Synapse Pipelines to orchestrate data across platforms. You will play a key role in implementing dimensional data models to support data warehousing, as well as processing large datasets using PySpark.
What You'll Be Doing:
Design, build, and maintain data pipelines using Azure Data Factory (ADF) and Synapse Pipelines.
Write and optimize complex SQL queries for data extraction, transformation, and loading (ETL).
Implement dimensional data modeling to support data warehousing and reporting needs.
Process large datasets using PySpark and Python, ensuring data accuracy and efficiency.
Collaborate with cross-functional teams and stakeholders using the Agile methodology.
Ensure data quality and reliability by implementing best practices in data orchestration.
Support integration of data across various systems to deliver insights for business intelligence.
Who We Are Looking For:
Bachelor's Degree in Computer Science or a related field.
Minimum of 3 years in data engineering or a related field.
Microsoft Azure-related certification (e.g., Azure Data Engineer), Microsoft Fabric certification (preferred).
Experience in Agile and DevOps environments is essential; exposure to the mining industry is a plus but not required.
Strong command of SQL and experience with large-scale database management.
Proficiency in data orchestration using Azure Data Factory and Synapse Pipelines.
Knowledge of dimensional data modeling for data warehousing.
Experience working with PySpark for data processing in Python.
