P

Research Engineer – Large Language Model Pretraining

Prime Intellect • United State
Visa Sponsorship Relocation
Apply Now

Develop and scale pretraining pipelines for 1‑3T parameter models, driving architecture experiments and large‑scale runs. Optimize training throughput, reliability, and hardware utilization across distributed systems. Require strong Python, PyTorch, and distributed training expertise with hands‑on LLM experience.

Key Highlights
Build and extend pretraining code to transition experiments into full training runs
Profile and improve end‑to‑end training throughput and system resilience
Design and execute reproducible ablations to guide large‑scale model research
Key Responsibilities
Build and extend the pretraining code in prime-rl, taking small experiments into full training runs.
Evaluate model architecture changes, including MoE and attention designs, against model quality and training cost.
Profile training jobs and improve end-to-end throughput, working with systems engineers on hardware-aware execution.
Make long runs resilient to failures, with reliable checkpointing and recovery.
Investigate training dynamics and numerical stability, checking that optimizations preserve convergence.
Run controlled ablations to guide larger experiments, keeping the setup and results reproducible.
Work with data and evaluation researchers on training mixtures, including midtraining and long-context experiments.
Technical Skills Required
Python PyTorch Distributed training
Benefits & Perks
Cash compensation $150-350k including equity incentives
Flexible work arrangements with remote or in‑office options
Visa sponsorship and relocation assistance

Job Description

Prime Intellect is building the open superintelligence stack: the infrastructure frontier AI labs build internally, made available to every ambitious AI team.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources

Similar Jobs

Explore other opportunities that match your interests

Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

Prime Intellect

United State

Senior Rust Software Engineer (Embedded Systems) - Mission-Critical Solutions

Programming
•
26m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

L3Harris Technologies

United State

Senior AI Engineer - Intelligent Foundations and Experiences

Programming
•
26m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Capital One

United State

Subscribe our newsletter

New Things Will Always Update Regularly