T

Senior/Staff Machine Learning Engineer, Distributed Systems

torentify • United States
Remote Visa Sponsorship
This Job is No Longer Active This position is no longer accepting applications
AI Summary

Pluralis Research seeks experienced ML Engineers to build novel infrastructure for distributed ML model training across consumer-grade internet. Responsibilities include designing large-scale distributed training systems, optimizing for low-bandwidth networks, and ensuring system resilience. Requires 5+ years in distributed systems, large-scale ML training, and expert Python skills.

Key Highlights
Build novel infrastructure for distributed ML training.
Optimize training for low-bandwidth and high-latency networks.
Ensure system resilience and fault tolerance in decentralized environments.

Searching for Machine Learning & AI roles that provide visa sponsorship? Connect with international employers through Machine Learning & AI Jobs with Visa Sponsorship opportunities actively seeking talented professionals.

Key Responsibilities
Design and implement large-scale distributed training systems for heterogeneous hardware.
Optimize training systems for low-bandwidth and high-latency network conditions.
Develop model-parallel training strategies, including data, tensor, and pipeline parallelism.
Implement custom sharding techniques to minimize communication overhead.
Optimize GPU utilization, memory efficiency, and compute performance across distributed nodes.
Build robust checkpointing, state synchronization, and recovery mechanisms for long-running training workloads.
Develop monitoring and metrics systems to track training progress, model quality, and system bottlenecks.
Architect resilient distributed training systems capable of handling node failures and network partitions.
Support dynamic participant joining and leaving within distributed environments.
Design and optimize peer-to-peer network topologies for decentralized coordination.
Implement NAT traversal, peer discovery, dynamic routing, and connection lifecycle management.
Profile and optimize communication patterns to reduce latency and bandwidth requirements.
Build systems capable of operating reliably across non-co-located infrastructure.
Technical Skills Required
Distributed Systems Large-scale Machine Learning Training Python

Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.

Benefits & Perks
Equity-heavy compensation
Competitive base salary
Visa sponsorship available
Remote-first working environment

Interested in opportunities specifically in United State? Discover our dedicated Visa Sponsorship Jobs in United State page featuring roles from top employers in this location.

Nice to Have
FSDP, DeepSpeed, Megatron, or comparable frameworks
Data, tensor, and pipeline parallelism
GPU optimization and memory efficiency
Concurrent systems
Peer-to-peer networking
gRPC and distributed coordination
NAT traversal and peer discovery
Fault-tolerant distributed infrastructure

Job Description

## About the Company

Pluralis Research conducts foundational research into Protocol Learning, a distributed approach to training foundation models where no single participant holds or can obtain a complete copy of the model.

The company is focused on enabling community-trained and community-owned frontier models through decentralized infrastructure and sustainable economic models. Its deeply technical team includes ML researchers and engineers with backgrounds at major technology companies and leading startups.

Pluralis Research is backed by Union Square Ventures and other tier-1 investors and is building novel infrastructure for distributed machine learning.

## About the Role

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Date Sep 08, 2026
Employment Type Full-time
Experience Level Entry level
Location United States
Category Machine Learning
Company torentify

Similar Jobs

Explore other opportunities that match your interests

Director, Machine Learning Engineer (AI/ML Solutions)

Machine Learning
•
2d ago

Log in free to see full details

•••••• •••••• ••••••
Technical Skills Required ••••••

Capital One

United States

Machine Learning Scientist - Drug Discovery
Machine Learning
•
3d ago
Visa Sponsorship Relocation Remote
Technical Skills Required
machine learning san

capable

United States

Business Manager - Modeling and Advanced Data Insights
Machine Learning
•
6d ago
Visa Sponsorship Relocation Remote
Technical Skills Required
aws machine learning python san spark +1

Capital One

United States

Subscribe our newsletter

New Things Will Always Update Regularly