hadron talent -hadronfinsys company
We are seeking a highly skilled and experienced Data Engineer to join our client team.
Key Responsibilities:
Design, implement, and manage data pipelines using Databricks.
Optimize Databricks clusters for performance and cost-efficiency.
Collaborate with data scientists and analysts to support their data needs using Databricks.
Develop and optimize large-scale data processing jobs using Apache Spark.
Write clean, efficient, and scalable code in Python for data transformation and analysis.
Troubleshoot and resolve issues related to Spark jobs and Python scripts.
Design and implement Big Data solutions for data ingestion, storage, processing, and analytics.
Ensure data quality, integrity, and security in Big Data environments.
Work with various Big Data technologies and tools to support business requirements.
Work closely with cross-functional teams to understand data requirements and deliver solutions.
Provide technical guidance and mentorship to junior data engineers.
Communicate effectively with stakeholders to ensure clarity and alignment on data projects.
Profile:
Minimum of 5-7 years of experience working with Databricks.
Minimum of 5-7 years of experience with Apache Spark and Python.
Minimum of 5-7 years of experience in Big Data technologies and solutions.
Proficient in Databricks for data engineering and analytics.
Strong expertise in Apache Spark for large-scale data processing.
Advanced Python programming skills for data manipulation and analysis.
Deep understanding of Big Data technologies and best practices.
Excellent problem-solving skills and the ability to work in a fast-paced environment.
Strong communication and collaboration skills.
Ability to work independently and manage multiple tasks simultaneously.
Other information
Job Location: EU, 100% Remote
Years of Experience: 05-07 years
Contract Duration: 01+ year / B2B/Freelancer
