P

Senior Distributed Inference Systems Engineer (Protocol Learning)

United States
Full Remote Visa Sponsorship Relocation
This Job is No Longer Active This position is no longer accepting applications

Build and optimize a fully decentralized, trustless inference pipeline for large-scale AI models running on consumer hardware over the public internet. Design novel algorithms for low-bandwidth, high-latency environments and own the end-to-end serving stack for both RL training and model deployment. Requires hands-on experience shipping large-scale serving systems and expertise in distributed inference or related fields.

Key Highlights
Design and implement a decentralized, trustless inference pipeline for large AI models on consumer-grade hardware over the public internet
Invent algorithms for low-bandwidth, high-latency distributed inference and pipeline-parallel execution
Own the end-to-end serving stack, including placement, routing, transport, and failure handling for RL training and model serving
Key Responsibilities
Design and build a decentralized inference pipeline capable of running on consumer GPUs over the public internet
Develop algorithms for efficient pipeline-parallel execution, placement, routing, and failure handling in dynamic environments
Optimize serving systems for low-bandwidth, high-latency conditions to support RL training and future model deployment
Invent and implement novel methods for trustless, permissionless model serving on untrusted hardware
Technical Skills Required
Distributed Systems Large-Scale Inference Systems Low-Bandwidth Networking
Benefits & Perks
Equity-heavy compensation package
Remote-first culture with global flexibility
Visa sponsorship for Australia or the US
Nice to Have
Experience with reinforcement learning post-training
Familiarity with Apple Silicon or MLX
Exposure to peer-to-peer (P2P) networking and NAT traversal
Experience at proprietary, open-weight, or open-source AI labs

Job Description

Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. Despite being dismissed as infeasible, we have made significant advances on this problem, most recently Agora, a permissionless run that pretrained an 8B model from scratch on consumer GPUs spread over the internet, with no single participant ever holding the full weights (tech report). While many of the core research problems have been solved, Protocol Learning unlocks a series of new challenges. For the mission in full, read A Third Path: Protocol Learning.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Hidden company

Log in to see location

Premium

Control Systems Engineer

Log in free to see the details

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Relocation Guides, Remote Work Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.