T

Senior AI Infrastructure Engineer (Post-Training & Reinforcement Learning)

United States
Visa Sponsorship Relocation
This Job is No Longer Active This position is no longer accepting applications

This role focuses on ensuring the reliability, performance, and uptime of large-scale AI training systems, including post-training and reinforcement learning pipelines. The engineer will collaborate closely with research teams to debug failures, optimize infrastructure, and build automation tools, while supporting on-call rotations for critical model runs. Requires 4+ years of production engineering experience with distributed systems, deep Linux/networking knowledge, and strong Python/Go/C++ skills.

Key Highlights
Owns reliability, performance, and uptime of large-scale post-training and reinforcement learning systems
Collaborates directly with research teams during active model runs to debug failures and optimize workflows
Builds monitoring, alerting, and automated recovery systems to minimize downtime and hardware failure impact
Key Responsibilities
Ensure reliability, performance, and uptime of large-scale post-training and reinforcement learning systems
Partner with research teams during active model runs to debug failures and optimize training workflows
Build monitoring, alerting, and automated recovery systems to minimize downtime and hardware failure impact
Improve checkpointing, fault tolerance, and job scheduling to reduce compute waste from hardware failures
Develop internal tools to reduce operational toil and improve cluster utilization
Participate in on-call rotations to support production model runs
Conduct postmortems to address recurring failure patterns and implement permanent infrastructure fixes
Technical Skills Required
Linux systems internals Python Distributed systems
Benefits & Perks
Generous health, dental, and vision benefits
$350,000 - $475,000 annual salary range
Unlimited PTO
Nice to Have
Experience operating GPU or TPU training clusters at scale
Familiarity with post-training and reinforcement learning techniques (e.g., RLHF, PPO, DPO)
Experience with distributed training frameworks (e.g., PyTorch, Ray) and job schedulers (e.g., Slurm, Kubernetes)
High-performance networking expertise (e.g., InfiniBand, RDMA, NCCL)
Experience building observability tooling purpose-built for ML training

Job Description

About Thinking Machines

The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.

About the Role

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

BeaconFire Inc.

United States

New

AI Engineer

  • Javascript
  • Data Structures
  • Java
  • Angular
Visa

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Relocation Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.