N

Senior Distributed Systems Engineer

United States
Visa Sponsorship
This Job is No Longer Active This position is no longer accepting applications

Design and build a high-performance AI inference platform's scheduling and routing layer. Develop a system that efficiently places work across a heterogeneous multi-cloud GPU fleet. Work independently to own systems end-to-end.

Key Highlights
Design and build a high-performance AI inference platform's scheduling and routing layer
Develop a system that efficiently places work across a heterogeneous multi-cloud GPU fleet
Work independently to own systems end-to-end
Key Responsibilities
Own the scheduling and routing layer — design and build request admission, prioritization, batching, and placement across a heterogeneous GPU fleet spanning multiple clouds and accelerator types
Engineer for latency and utilization at once — drive down tail latency while driving up fleet utilization
Model the system, not just code it — apply queueing theory, control theory, and load-shedding principles to make the platform behave predictably under bursty, multi-tenant traffic
Technical Skills Required
Go Rust GPU infrastructure
Benefits & Perks
Meaningful equity
Medical, dental, and vision coverage
Other benefits
Nice to Have
Kubernetes and multi-cloud operations experience
Open-source contributions to inference, serving, or scheduling projects
Experience operating GPU clusters at scale

Job Description

NeuroSpark builds and operates a high-performance AI inference platform that helps enterprises run large language models faster, cheaper, and at scale. Inference infrastructure is the foundation the entire AI application layer runs on — every AI product ultimately depends on how fast, how reliably, and how affordably models can serve their users. Our vision is to make that layer so efficient that compute is never the reason a good AI product fails.

About the Role

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Visas, Work Permits & Legal Insights

Stay informed about visa types, work permits, and immigration updates for international professionals.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.