Senior Big Data Engineer

Title: Big data engineer

Duration: Long term contract(W2)

Location: 100% Remote

We’re looking for:

• Python, SQL, GCP(BQ), Spark, Airflow, Java(Optional)

Interested in remote work opportunities in Data Science? Discover Data Science Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

• GCP Shop - using Big Query
• Does NOT want a machine learning engineer, wants a big data engineer

Required Skills:

9+ years of experience

Python, Airflow, PySpark, Spark SQL, Spark Streaming, Scala, Relational/No SQL databases, Apache Kafka, writing complex sql queries, GCP (Bigquery, Dataproc), working with RESTful APIs in data pipelines, CI/CD (gitlab CI)

Bonus Skills:

Experience with backend stack (Java, Spring boot)

Who the team is and what they do:

The Customer Identity (CI) team is central to the enterprise, focused on ensuring customer data is accurate, consistent, and readily accessible. This critical data is the foundation for essential business processes, including personalized marketing, analytical reporting, and seamless online and in-store checkout and customer service experiences.

The CI team manages a wide array of high-performance, scalable batch and real-time services. These services are utilized at numerous customer interactions, such as in-store purchases, online orders, rewards program enrollments, and activations from various marketing channels (Email, Direct Mail, SMS, Push notifications, etc.). By leveraging modern development practices, tools, and technology platforms, the CI team builds capabilities that empower our customer-facing and checkout teams to deliver personalized, relevant, and frictionless experiences, ensuring customers realize value with every interaction.