Luxoft company
๐ Are you in Poland? If YES this is the project for YOU!
Our benefits:
๐ธ copyrights cost up to 90% - that gives you higher net salary
๐ฉโโ๏ธ Private Medical Care in Luxmed and Life Insurance
๐๏ธโโ๏ธ Multisport Card
๐จโ๐งโ๐ฆ Paid referrals
๐ Self-learning libraries
๐ซ Relocation package for seniors and assistance during all process...and MORE!
Project Description:
We are seeking an experienced Data Engineer (5-8 years' experience) to design, implement, and maintain scalable and efficient data pipelines. This role requires extensive hands-on experience with ETL and ELT using tools like Azure Data Factory (ADF) and Fabric Solutions. The ideal candidate will be an individual contributor with a strong background in data ingestion, transformation, and loading processes.
Responsibilities:
โช Design, develop, and maintain data pipelines and ETL processes on Microsoft Azure.
โช Implement data integration solutions using Azure Data Factory, Fabric Notebooks, Spark jobs, Synapse, and other Azure services.
โช Collaborate with business stakeholders to gather requirements and ensure data solutions meet business needs.
โช Optimize data workflows for performance, scalability, and reliability.
โช Analysis & Troubleshooting: Debug and resolve complex issues with the data pipelines.
โช Ensure data accuracy, consistency, and security across all data pipelines.
โช Develop and maintain documentation for data processes and solutions.
Mandatory Skills Description:
โช 5-8 years of experience in data engineering with a focus on Azure.
โช Strong proficiency in Azure Data Factory, Python, and Azure Synapse.
โช Experience with data modelling, ETL processes, and SQL.
โช Familiarity with Azure DevOps for CI/CD pipelines.
โช Experience with data integration for different sources (SQL, APIs, Flat Files, Data Streams etc.)
โช Excellent problem-solving skills and attention to detail.
โช Strong communication and collaboration skills.
โช Ability to work independently and manage multiple tasks.
โช Bachelor's degree in Computer Science, Information Systems, or a related field.
Nice-to-Have Skills Description:
โช Experience in the financial industry or working with financial data.
โช Experience with Microsoft fabric.
โช Knowledge of data governance and data quality best practices.
โช Hands-on experience with Python in ETL processes.