Senior Data Engineer
Open to Fully Remote (East Coast Hours)
Day To Day
Our Client is seeking a Data Engineer to support one of our insurance clients in the Richmond, VA area and help scale data operations. This role is ideal for someone who thrives in a collaborative environment and is passionate about building robust data pipelines using modern cloud technologies. You will play a key role in developing ETL processes using Python, integrating with Azure Data Factory, and leveraging Databricks for scalable data solutions. The team currently lacks deep expertise in Python and Databricks, so your contributions will be instrumental in filling this gap and elevating the team's technical capabilities.
- Design, develop, and maintain ETL pipelines using Python.
- Integrate data workflows into Azure Data Factory.
- Build and optimize scalable data solutions in Databricks.
- Collaborate with team members to understand data requirements and deliver actionable insights.
- Provide mentorship and technical guidance on Python and Databricks best practices.
- Troubleshoot and resolve data-related issues across the pipeline.
- Participate in sprint planning, code reviews, and team meetings.
Must Haves
- 10+ years of experience in data engineering roles
- Strong proficiency in Python, especially for ETL development
- Hands-on experience with Azure Data Factory and Databricks
- Solid understanding of cloud-based data architecture and workflows
Plusses
- Experience in the insurance or financial services industry
- Familiarity with Excess and Surplus lines data workflows
- Exposure to other Azure services such as Azure Synapse or Azure SQL
