O

Senior Data Infrastructure Engineer (Transactional Data Lake & Apache Hudi Optimization)

Onehouse • Greater Kolkata Area
Remote
Apply Now
AI Summary

Lead the productionization of Onehouse’s next-gen data tech stack by optimizing Apache Hudi’s transactional engine and building scalable distributed systems for high-throughput data processing. Collaborate with open-source contributors to enhance enterprise-grade data lakehouse capabilities while solving complex concurrency, indexing, and metadata optimization challenges. Drive performance improvements in distributed data processing across Kubernetes clusters for global enterprise workloads.

Key Highlights
Productionize next-gen data tech stack with Apache Hudi optimizations for transactional data lakehouse
Design concurrency control, indexing schemes, and metadata systems for high-throughput, low-latency data processing
Act as SME for database internals, query engines, and distributed systems optimization in production environments
Key Responsibilities
Design and implement concurrency control mechanisms to maximize throughput for competing data writers
Develop optimized indexing schemes for incremental data processing and analytical query performance
Build scalable metadata and data access systems compatible with diverse query/compute engines
Solve optimization problems to improve distributed data processing efficiency over Kubernetes clusters
Prototype and validate solutions using data from existing systems to identify inefficiencies
Collaborate with engineering teams to deploy optimized solutions in production with zero downtime
Contribute to Apache Hudi’s open-source transactional engine for enterprise-grade data lakehouse workloads

Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

Technical Skills Required
Distributed Systems Java Database Internals
Benefits & Perks
Equity compensation with company equity plan
Up to ₹20,000/month reimbursement for health insurance premiums
Provident fund contribution (₹1,800/month from Onehouse)
Unlimited PTO (minimum 1 week/year mandatory)
Uncapped sick days and 17 paid company holidays
Weekly lunch stipend and in-office snacks/drinks allowance
Remote-friendly with international distribution (N. America + India)
$500 USD stipend for initial office/desk setup
26 weeks paid leave for birthing parents, 12 weeks for surrogate/adoptive parents

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Nice to Have
Experience with database systems (e.g., relational databases, NoSQL)
Query engine or Spark codebase familiarity
Optimization mathematics (linear/nonlinear programming)
Publications on optimizing large-scale data systems in top-tier conferences
PhD with 2+ years industry experience in high-impact optimization projects

Job Description

Onehouse is a mission-driven company dedicated to freeing data from data platform lock-in. We deliver the industry’s most interoperable data lakehouse through a cloud-native managed service built on Apache Hudi. Onehouse enables organizations to ingest data at scale with minute-level freshness, centrally store it, and make available to any downstream query engine and use case (from traditional analytics to real-time AI / ML).
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

Apply Now
See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Date Sep 30, 2026
Employment Type Full-time
Experience Level Not Applicable
Location Greater Kolkata Area
Category Programming
Company Onehouse
Mentioned Skills
java artificial intelligence ai c++ unix c storage prototypes design systems kubernetes aws apache linux cloud cloud native spark

Similar Jobs

Explore other opportunities that match your interests

Senior Java Software Engineer - Risk Technology Services

Programming
•
13m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Worldline

Poland

Senior Python Backend Engineer
Programming
•
14m ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

issoft ukraine 🇺🇦

Ukraine

Senior Backend Software Engineer (Fintech, Distributed Systems)
Programming
•
2h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

talenthop

United State

Subscribe our newsletter

New Things Will Always Update Regularly