Job Title: Big Data Engineer
Location: Initially Remote, with eventual relocation to Dallas, TX (Hybrid)
Employment Type: Long-term Contract
Overview:
We are seeking a skilled Big Data Engineer to join our team in Dallas, TX. As a key member of our organization, you will be responsible for designing, implementing, and maintaining robust big data solutions. The ideal candidate will have prior experience in solutions architecture or software architecture, coupled with a strong background in big data technologies.
Key Responsibilities:
- Collaborate with cross-functional teams to design and implement scalable big data solutions.
- Develop and maintain data pipelines using PySpark, ensuring efficient data processing and analysis.
- Implement workflow orchestration using Airflow to automate data workflows and tasks.
- Optimize and tune big data applications for performance and reliability.
- Stay abreast of emerging technologies and trends in big data and recommend improvements to existing systems.
Requirements:
- Bachelor's degree in Computer Science, Engineering, or related field.
- Proven experience in solutions architecture or software architecture.
- Strong proficiency in big data technologies and frameworks.
- Extensive experience with PySpark for data processing and analytics.
- Hands-on experience with Airflow for workflow orchestration and automation.
- Solid understanding of distributed computing principles and big data ecosystem (e.g., Hadoop, Spark, Kafka).
- Proficiency in programming languages such as Python, Java, or Scala.
- Excellent problem-solving skills and ability to troubleshoot complex issues.
- Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
Preferred Qualifications:
- Bachelor's degree in Computer Science, Engineering, or related field.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
- Knowledge of data warehousing concepts and technologies (e.g., SQL, Snowflake, Redshift).
This is an excellent opportunity for a talented Big Data Engineer to join a dynamic team and contribute to the development of innovative big data solutions. If you are passionate about leveraging cutting-edge technologies to solve complex problems, we want to hear from you! Apply now to be part of our team in Dallas, TX.
