L

Senior Data Engineer

Relocation
This Job is No Longer Active This position is no longer accepting applications
AI Summary

Collaborate with analytics and business teams to improve data models. Implement processes and systems to monitor data quality. Design and develop data transformations using P y Spark on AWS Databricks.

Key Highlights
Collaborate with analytics and business teams to improve data models
Implement processes and systems to monitor data quality
Design and develop data transformations using P y Spark on AWS Databricks
Create a real-time data ingestion system with AWS Lambda and S3
Troubleshoot data related issues and assist in their solution
Technical Skills Required
Python Spark AWS Databricks AWS Lambda S3
Benefits & Perks
Medical insurance
Life insurance
401K

Job Description


Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.

Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.

Perform data analysis required to troubleshoot data related issues and assist in there solution of data issues.

Work closely with a team of front end and backend engineers, product managers, and analysts.

Design and develop data transformations using P y Spark on AWS Databricks, enhancing the analytics capabilities for financial datasets.

Create a real-time data ingestion system with AWS Lambda and S3, which facilitated efficient data storage and processing.

Position Requirements: Master's degree or a foreign equivalent degree in computer science, Information Technology, Information Systems, Mechanical Engineering, Computer Applications, Electrical and/or Electronics Engineering, Engineering (any) or related field.

Special Skills:Position requires travel/relocation to various unanticipated client locations throughout the U.S. with expenses paid by the employer.

The employer is in the field of Information Technology implementing projects for clients in various states throughout the country.

Depending on the scope of the project, these implementations could sometimes take days, weeks, months, or years. Hence, the beneficiary may have to either travel or relocate to these client sites depending on the duration of the project. Therefore, the employer has indicated that the position requires travel/relocation to various unanticipated client locations throughout the U.S. with expenses paid by the employer.

Since this is a future position, providing a timeline and the frequency of travel for a project that will be assigned at a later stage is currently not possible. Therefore, the employer has indicated that the position requires travel/relocation to various unanticipated client locations throughout the U.S. with expenses paid by the employer.

Benefits: Medical, Life Insurence and 401K.

Similar Jobs

Explore other opportunities that match your interests

Senior Geospatial Data Platform Database Engineer (Mission-Critical Systems)

Data Science
36m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Esri

United State

Data Scientist

Data Science
3h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Entry level

enhance it

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

Caterpillar Inc.

United State

Subscribe our newsletter

New Things Will Always Update Regularly