Design and maintain scalable, secure, real-time data pipelines using Kafka and Confluent Cloud. Lead the migration from on-prem to AWS and improve reliability. Collaborate with engineering, SRE, security, and product teams.
Key Highlights
Technical Skills Required
Benefits & Perks
Job Description
Please note
Candidates who require sponsorship should not apply.
Kafka Platform Engineer
Location: Remote (EST hours required)
Type: Temp-to-Perm
Contract: 6 Months with possibility of extension
Overview:
Seeking a Kafka Platform Engineer to build and support scalable, secure, real-time data pipelines using Kafka and Confluent Cloud. You’ll help lead the migration from on-prem to AWS, improve reliability, automate infrastructure using Terraform, and support mission-critical financial systems.
Key Responsibilities
- Manage and optimize Kafka clusters, topics, connectors, and Schema Registry.
- Design and maintain AWS-integrated data pipelines (RDS, Aurora, EC2, IAM).
- Build infrastructure automation using Terraform, GitOps, and CI/CD pipelines.
- Implement monitoring dashboards and alerts (Prometheus, Grafana, Datadog).
- Ensure secure access, RBAC, encryption, audit logging, and compliance.
- Troubleshoot Kafka performance, latency, and connector issues.
- Collaborate with engineering, SRE, security, and product teams.
Top Must-Have Skills
- Strong experience with Kafka & Confluent Cloud
- AWS expertise (RDS, Aurora, EC2, IAM, VPC)
- Terraform & infrastructure automation
- CI/CD, GitOps, and infrastructure scripting
Nice-to-Have Skills
- Monitoring/observability tools (Prometheus, Grafana, Datadog)
- Kafka security (ACLs, SSL, IAM integration)
- Docker/Kubernetes experience
- Incident response & cross-functional communication
Minimum Qualifications
- Bachelor’s in CS, IT, Engineering, or equivalent experience
- 2+ years in platform or cloud engineering
- 2+ years with AWS + Terraform/CloudFormation
- At least one cloud/platform certification (AWS, Kafka, DevSecOps, etc.)
Preferred Qualifications
- 5+ years cloud engineering
- 3+ years Kafka experience in mission-critical environments
- Kafka Connect, Schema Registry, Kafka Streams
- Python/Java/Scala development for Kafka pipelines
Certifications Required:
- Confluent Certified Developer for Apache Kafka
- AWS Solutions Architect – Associate
- HashiCorp Certified: Terraform Associate
What You’ll Do Day-to-Day
- Review system health dashboards & alerts
- Update Terraform modules & Kafka configs
- Troubleshoot issues across Kafka + AWS integrations
- Document architecture, runbooks, naming conventions
- Attend stand-ups and collaborate across infra/security/engineering
Pursuant to the California Fair Chance Act, Los Angeles County Fair Chance Ordinance for Employers, Los Angeles Fair Chance Initiative for Hiring Ordinance, and San Francisco Fair Chance Ordinance, qualified applicants will be considered for assignment with arrest and conviction records. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness, meet client expectations, standards, and accompanying requirements, and safeguard business operations and company reputation
Similar Jobs
Explore other opportunities that match your interests