P

Senior/Staff Engineer for Distributed ML Model Training

Australia
Full Remote Visa Sponsorship
This Job is No Longer Active This position is no longer accepting applications

We're looking for Senior/Staff engineers with 5+ years of experience in distributed systems and ML large-scale training. You'll be implementing a novel substrate for training distributed ML models that work under consumer grade internet connection. Design and implement large-scale distributed training systems optimized for heterogeneous hardware operating under low-bandwidth, high-latency conditions.

Key Highlights
Distributed Training Architecture & Optimization
Decentralized Networking & Resilience
Strong experience building and operating distributed systems in production
Key Responsibilities
Design and implement large-scale distributed training systems optimized for heterogeneous hardware operating under low-bandwidth, high-latency conditions.
Implement robust checkpointing, state synchronization, and recovery mechanisms for long-running, fault-prone training jobs.
Build monitoring and metrics systems to track training progress, model quality, and system bottlenecks.
Technical Skills Required
Distributed systems ML large-scale training Python FSDP DeepSpeed Megatron P2P systems gRPC NAT traversal distributed coordination GPU utilization memory efficiency compute performance
Benefits & Perks
Equity-heavy compensation
Competitive base salary for senior engineering roles in Australia
Visa sponsorship available
Remote-first with optional access to our Melbourne hub

Job Description

Pluralis Research carries out foundational research on : multi-participant training of foundation models where no single participant has, or can ever obtain, a full copy of the model. The purpose of Protocol Learning is to facilitate the creation of community-trained and community-owned frontier models with self-sustaining economics.We're looking for Senior/Staff engineers with 5+ years of experience in distributed systems and ML large-scale training. You'll be implementing a novel substrate for training distributed ML models that work under consumer grade internet connection.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Remote Work Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.