We are seeking a Big Data Engineer (Freelancer) to support advanced AI evaluation initiatives focused on large-scale data processing, distributed computing, data engineering, cloud-based analytics, and big data infrastructure. In this role, you will evaluate AI-generated outputs related to big data architectures, ETL pipelines, distributed systems, data lakes, stream processing, data warehousing, and analytics workflows. This position is ideal for professionals with experience in big data engineering, data platform development, cloud data infrastructure, distributed computing, or large-scale analytics.
Key Highlights
Key Responsibilities
Technical Skills Required
Benefits & Perks
Nice to Have
Job Description
About Us
Deccan AI Experts is a pioneering AI company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in high-quality human-curated data, AI-first operations, and advanced AI evaluation systems.
About the Role
We are seeking a Big Data Engineer (Freelancer) to support advanced AI evaluation initiatives focused on large-scale data processing, distributed computing, data engineering, cloud-based analytics, and big data infrastructure.
In this role, you will evaluate AI-generated outputs related to big data architectures, ETL pipelines, distributed systems, data lakes, stream processing, data warehousing, and analytics workflows. Your expertise will help improve AI systems designed for data engineering, software development, cloud computing, and technical reasoning.
This position is ideal for professionals with experience in big data engineering, data platform development, cloud data infrastructure, distributed computing, or large-scale analytics.
Responsibilities
- Create deliverables addressing common big data engineering and data platform scenarios
- Annotate and evaluate AI-generated data engineering solutions, architecture designs, code, technical documentation, and optimization recommendations
- Assess AI outputs for technical accuracy, scalability, performance, reliability, and engineering best practices
- Review AI-generated content involving distributed computing, ETL pipelines, data lakes, stream processing, batch processing, cloud data platforms, and data warehousing
- Evaluate outputs related to data modeling, pipeline optimization, orchestration, storage architectures, fault tolerance, and data governance
- Identify architectural flaws, performance bottlenecks, data quality issues, coding errors, and scalability limitations in AI-generated outputs
- Provide structured feedback to improve AI performance in data engineering and big data workflows
- Support projects involving data platform design, analytics infrastructure, cloud engineering, and AI-assisted software development
- Review peer-developed deliverables to maintain quality and consistency standards
- Contribute domain expertise to improve AI systems focused on data engineering, distributed systems, and technical problem-solving
Interested in remote work opportunities in Data Science? Discover Data Science Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
Requirements
- Bachelor's or Master's degree in Computer Science, Software Engineering, Information Technology, Data Engineering, or a related field
- 3+ years of experience in Big Data Engineering, Data Engineering, Data Platform Development, Cloud Engineering, or Analytics Engineering
- Strong proficiency in SQL and one or more programming languages such as Python, Java, Scala, or Spark SQL
- Experience designing and maintaining ETL/ELT pipelines and large-scale distributed data processing systems
- Familiarity with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform
- Experience with data lakes, data warehouses, batch processing, real-time streaming, and workflow orchestration
- Understanding of data modeling, partitioning, indexing, query optimization, and distributed storage systems
- Strong analytical thinking and problem-solving skills
- Excellent written English communication skills
- Ability to critically evaluate AI-generated outputs for technical accuracy and engineering quality
- Ability to work independently in a remote, fast-paced environment
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
Preferred Qualifications
- Experience building enterprise-scale data platforms or modern data lakehouse architectures
- Familiarity with Kubernetes, Docker, Terraform, and Infrastructure as Code (IaC)
- Experience with CI/CD pipelines, Git, DevOps, and cloud-native data engineering workflows
- Knowledge of data governance, metadata management, data security, and privacy regulations
- Experience working with machine learning pipelines, MLOps, or AI data infrastructure
- Cloud certifications such as AWS Certified Data Engineer, Azure Data Engineer Associate, or Google Professional Data Engineer
- Contributions to open-source big data projects or technical communities
- Experience mentoring engineers or leading large-scale data engineering initiatives
Why Join Us
- Competitive hourly pay: ₹1,500/hour
- Fully remote with flexible working hours
- Opportunity to contribute to cutting-edge AI and data engineering initiatives
- Exposure to advanced AI systems focused on distributed computing, cloud data platforms, and analytics infrastructure
- Flexible project-based opportunities with global teams
- Work on next-generation AI solutions supporting large-scale data processing, cloud technologies, and intelligent analytics
Similar Jobs
Explore other opportunities that match your interests
uniprep
Senior QA Engineer / QA Developer - Microsoft Power Platform & .NET
Andela
