Company Description
ThreatXIntel is a startup cyber security company dedicated to protecting businesses and organizations from cyber threats. Our team of experienced professionals offers a range of services, including cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. We provide customized, affordable solutions to meet the specific needs of our clients, ensuring all businesses have access to high-quality cyber security services. Our proactive approach to security includes continuous monitoring and testing of digital environments to identify vulnerabilities before they can be exploited.
Role Description
We are seeking a hands-on Freelance Data Engineer to support and enhance existing data workflows in AWS. This role is focused on maintaining, debugging, and optimizing existing pipelines rather than building new ones from scratch. The ideal candidate has a deep understanding of AWS CDK deployments, SQL/Redshift performance tuning, and S3 integrations, with a proactive approach to improving system reliability and deployment efficiency.
You will work closely with the engineering team to troubleshoot data jobs, refine CI/CD processes, and ensure smooth daily pipeline operations.
Key Responsibilities- Debug and maintain existing data pipelines to ensure stable and efficient execution.
- Manage and optimize AWS CDK deployments, including building, packaging, and releasing infrastructure components.
- Support CI/CD processes and automate deployment workflows where applicable.
- Write, optimize, and troubleshoot SQL queries for performance and accuracy in Amazon Redshift.
- Manage data storage and movement between Redshift, S3, and other AWS services.
- Identify recurring issues and implement long-term fixes to improve reliability.
- Collaborate with team members to streamline operations, monitor job health, and resolve production issues promptly.
Required Qualifications- Strong experience in AWS, especially CDK, Lambda, S3, and Redshift.
- Proven ability to debug and optimize data pipelines in production environments.
- Solid proficiency in SQL, including query optimization and performance tuning.
- Hands-on experience with data integrations between Redshift and S3.
- Familiarity with Python or Node.js for automation and infrastructure scripting.
- Understanding of deployment packaging, versioning, and release management using AWS CDK.
- Detail-oriented with excellent troubleshooting and problem-solving skills.
Preferred Qualifications- Experience with CloudWatch, Step Functions, or Glue for job orchestration and monitoring.
- Exposure to data modeling and ETL optimization best practices.
- Strong communication and collaboration skills in distributed teams.
Why This Role- Focus on stabilizing and improving existing systems, not greenfield builds.
- Opportunity to work with modern AWS infrastructure tools (CDK, Redshift, S3).
- Flexible freelance engagement with potential for long-term collaboration.
- Direct impact on system reliability and deployment efficiency.