C

Senior AWS Data Engineer (Python/Spark)

Centraprise • United State
Visa Sponsorship
Apply
AI Summary

Design, develop, and maintain scalable big data pipelines and AWS-based solutions. Leverage Python, Spark, and AWS services to process, transform, and analyze large datasets. Collaborate cross-functionally to drive data-driven insights and optimize data workflows.

Key Highlights
10+ years of Python development experience for big data applications
5+ years of AWS expertise (EMR, Lambda, Step Functions, Redshift, S3, Glue)
Hands-on experience with CI/CD pipelines, GitLab, and Terraform
Key Responsibilities
Develop and optimize scalable data processing pipelines using Hadoop/EMR, Spark, and Hive
Design and implement AWS-based solutions (Lambda, EventBridge, Step Functions, Redshift, S3, Glue)
Create and maintain API integrations, SQL queries, and data transformations for large datasets
Collaborate with cross-functional teams to analyze datasets and derive actionable business insights
Lead CI/CD pipeline development and automation using GitLab and Terraform
Technical Skills Required
Python Amazon Web Services Apache Spark
Benefits & Perks
H1B transfer workable (visa sponsorship available)
Weekend walk-in drive (in-person hiring flexibility)

Job Description


AWS Data Engineer

Atlanta, GA

Fulltime (Permanent)


Weekend - Walk-in Drive - In-Person


H1b Transfer are workable (Who can join on Receipt Notice)


Job Description:

  • Qualifications (Data Engineer/Python Developer)
  • 10+ years hands-on Python development experience for big data application.
  • Extensive working experience in implementing scalable and efficient data processing pipelines using big data technologies, such as Hadoop/EMR, Spark, Hive.
  • Strong development experience in AWS platforms/services such as Lambda, Eventbridge, Step Functions, Redshift, S3, Glue.
  • Extensive hands-on development experience in making API calls, SQL queries, data manipulation/transformation, analysis and visualization.
  • Strong experience in data analysis/mining, hands-on experience on analyzing large datasets and extracting meaningful insights.
  • Solid understanding and hand-on implementation experience in CI/CD pipeline. Familiar with tools such as Gitlab/Terraform.
  • Critical thinking and strong analytical skills to drive solutions, alternative plans, and conclusions
  • Collaborates effectively and forms positive partnerships with team members in groups and levels across a matrixed organization
  • Possess strong analytical and problem-solving skills


Skills:

  • Required 10+ years of Python development experience for big data application
  • Required 5+ years of development experience in AWS platforms/services such as EMR, Lambda, Eventbridge, Step Functions, Redshift, S3, Glue
  • Required 5+ years of development experience in making API calls, SQL queries, Spark, data manipulation/transformation, analysis and visualization
  • Hands on experience with CI/CD pipeline tools such as Gitlab/Terraform

Similar Jobs

Explore other opportunities that match your interests

Principal Software Engineer

Devops
•
47m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Palo Alto Networks

United State

Senior Technical Support Engineer - Cortex XSIAM

Devops
•
5h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Palo Alto Networks

United State

Junior to Mid-Level IAM Engineer

Devops
•
12h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

intellibee inc

United State

Subscribe our newsletter

New Things Will Always Update Regularly