R

Distributed Systems Engineer, Model Evaluation

reflection • United State
Visa Sponsorship
Apply Now
AI Summary

Build and scale the evaluation infrastructure used to assess model capabilities and guide training decisions. Develop distributed systems for execution, optimize inference performance, and create researcher-facing tools. Requires strong proficiency in Python, C++, or Rust and experience with reliable distributed systems.

Key Highlights
Design and evolve evaluation abstractions and APIs for model tasks and datasets
Build scalable distributed systems for evaluating model checkpoints during pre-training
Optimize GPU utilization and inference throughput to reduce time to results

Searching for Development & Programming roles that provide visa sponsorship? Connect with international employers through Development & Programming Jobs with Visa Sponsorship opportunities actively seeking talented professionals.

Key Responsibilities
Design and evolve evaluation abstractions, APIs, and data models for evaluation tasks and scores.
Develop scalable distributed systems for evaluating model checkpoints with robust orchestration and observability.
Profile inference servers and distributed execution to improve throughput and GPU utilization.
Establish evaluation correctness through validation tests, dataset versioning, and provenance tracking.
Create intuitive interfaces and dashboards for researchers to inspect model outputs and compare experiments.
Monitor evaluation workloads, triage failures, and develop diagnostics to distinguish quality changes from system issues.
Partner with researchers to translate bespoke workflows into reusable, self-service tools.

Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.

Technical Skills Required
Python C++ Rust

Interested in opportunities specifically in United State? Discover our dedicated Visa Sponsorship Jobs in United State page featuring roles from top employers in this location.

Benefits & Perks
Competitive salary and equity
Stock options
Comprehensive medical, dental, vision, and life insurance
Annual wellness allowance
Daily office lunch and dinner
22 weeks paid parental leave
Unlimited paid time off (US) / 30 days (UK)
Visa sponsorship
Team building off-sites and celebrations

Job Description

Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build open models that let anyone control their intelligence and help shape the future of AI. Our mission: make intelligence open and accessible to all.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

Apply Now
See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Date Oct 14, 2026
Employment Type Full-time
Experience Level Not Applicable
Location United State
Category Programming
Company reflection
Mentioned Skills
python rust ai c++ c

Similar Jobs

Explore other opportunities that match your interests

Senior Distributed Systems Engineer (Inference)
Programming
•
17m ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

pluralis research

United State

Senior Engineering Management Specialist – Identity & Access Management (IAM) & Non-Human Identity Security

Programming
•
1h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Deloitte

United State

Research Scientist in Distributed AI Training (Protocol Learning)
Programming
•
1h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

pluralis research

United State

Subscribe our newsletter

New Things Will Always Update Regularly