P

Senior Distributed Systems Engineer (Inference)

pluralis research • United State
Remote Visa Sponsorship Relocation
Apply Now

Build and own the end-to-end inference stack for decentralized Protocol Learning on consumer-grade hardware. Design and implement novel algorithms for fast, reliable model serving over low-bandwidth, high-latency public networks. Requires a proven track record of shipping large-scale inference systems and expertise in distributed systems research.

Key Highlights
Develop a permissionless, trustless inference pipeline for RL training and model serving
Optimize execution for consumer GPUs and Macs across the public internet
Invent new algorithms to handle node volatility and slow network transport
Key Responsibilities
Own the inference stack end-to-end, including pipeline-parallel execution, placement, routing, transport, and failure handling.
Design, validate, and productionize new algorithms to make inference fast on consumer hardware over the public internet.
Maintain and optimize the rollout pipeline for RL training and transition it into a serving layer for trained models.
Technical Skills Required
Distributed Inference LLM Serving Systems Pipeline Parallelism
Benefits & Perks
Equity-Heavy Package
High base salary
Remote-First Culture
Visa Sponsorship
Relocation support
Nice to Have
Familiarity with RL post-training
Exposure to Apple silicon or MLX
Experience with P2P networking and NAT traversal
Experience at proprietary, open-weight and open-source AI labs

Job Description

Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. Despite being dismissed as infeasible, we have made significant advances on this problem, most recently Agora, a permissionless run that pretrained an 8B model from scratch on consumer GPUs spread over the internet, with no single participant ever holding the full weights (tech report). While many of the core research problems have been solved, Protocol Learning unlocks a series of new challenges. For the mission in full, read A Third Path: Protocol Learning.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources

Similar Jobs

Explore other opportunities that match your interests

Postdoctoral Research Associate in Transportation AI & Digital Twins

Programming
•
36m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Oak Ridge National Laboratory

United State

Senior Manager, AI Engineer

Programming
•
37m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Capital One

United State

Senior Fault Management and System Autonomy Engineer

Programming
•
37m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Blue Origin

United State

Subscribe our newsletter

New Things Will Always Update Regularly