S

Lead Data Engineer (Data Architect)

SIDRAM TECHNOLOGIES • United States
Visa Sponsorship
Apply Now

Hands-on Lead Data Engineer role focused on designing, building, and optimizing production-grade data pipelines, AI/ML systems, and enterprise data architectures. Requires deep expertise in Python, PySpark, Scala, SQL, and Azure data services (Databricks, ADF, ADLS Gen2). Must demonstrate recent production coding experience, technical leadership, and familiarity with financial services/insurance data, AI-driven data quality, and MLOps/LLMOps.

Key Highlights
Hands-on Lead Data Engineer role with 10–15 years of experience
Mandatory onsite presence in Cary, NC (Tue–Thu) with hybrid flexibility
Explicit H-1B transfer requirements for visa-dependent candidates
Focus on production-grade data pipelines, AI/ML systems, and enterprise data architectures
Key Responsibilities
Design, build, and optimize production-grade data pipelines using Python, PySpark, Scala, and SQL
Lead technical teams in implementing Lakehouse/Medallion Architecture (Bronze/Silver/Gold layers)
Develop and deploy AI/ML and LLM-based solutions (RAG, embeddings, prompt engineering)
Ensure data governance, security, and compliance (PII protection, fine-grained access controls)
Oversee MLOps/LLMOps, model evaluation, and production AI monitoring
Technical Skills Required
Python, PySpark, Scala, SQL Azure Databricks, Delta Lake, Spark LLM Frameworks (LangChain, LlamaIndex, Azure OpenAI)
Nice to Have
Experience with financial services/insurance data (reconciliation, general ledger)
Knowledge graphs, ontologies, or enterprise Text-to-SQL solutions
Terraform and Databricks Asset Bundles for CI/CD automation

Job Description

Role: Data Architect

Location: Cary, NC

Work Model: Day 1 onsite; hybrid schedule, Tuesday–Thursday onsite

Experience: 10–15 years

Employment: Full-time

Visa Requirements

  • Visa-independent candidates:
  • H-1B transfer candidates: Must be able to start upon receipt of the H-1B transfer receipt notice and have a minimum 2 years of gap in 6 years of H1-B.

Day 1 onsite is mandatory. Candidates must be available to work onsite in Cary, NC, Tuesday through Thursday.

Candidates must be comfortable with the stated compensation range and onsite requirements before submission.

Mandatory Skills Must-Have

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Hidden company

Log in to see location

Premium

Senior Data Analyst (Experiment & Growth Analytics) - Remote

Log in free to see the details

Visas, Work Permits & Legal Insights

Stay informed about visa types, work permits, and immigration updates for international professionals.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.