Senior Platform & Infrastructure Engineer (AI Training Orchestration)

Prime Intellect • United State

Remote Visa Sponsorship Relocation

Apply Now

AI Summary

Build and scale Prime Intellect’s hosted training platform, orchestrating Kubernetes-based GPU clusters for LoRA and full fine-tuning at frontier scale. Design infrastructure, develop control-plane agents, and create developer-facing APIs and UIs while bridging research and product. Requires deep expertise in AI/GPU landscapes, Kubernetes, and cloud infrastructure.

Key Highlights

Design and operate Kubernetes-based GPU training/inference orchestration across multi-cluster, multi-cloud environments

Develop Helm charts, Python control-plane agents, and FastAPI REST APIs for platform integration

Build real-time monitoring, debugging tools, and Next.js/React UIs for developer-facing surfaces

Looking to advance your Development & Programming career with relocation support? Explore Development & Programming Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.

Key Responsibilities

Design and operate Kubernetes-based GPU orchestration for training/inference workloads across multi-cluster, multi-cloud environments

Build and maintain Helm charts for reproducible 'Training stacks' combining trainers, inference servers, and environment servers

Develop Python control-plane agents to monitor pod states, report run status, and synchronize clusters using Kubernetes APIs

Implement scheduling/autoscaling for heterogeneous GPU hardware (H100/H200/B200) using KEDA, LeaderWorkerSet, and gang scheduling

Build developer-facing APIs (FastAPI) and real-time monitoring tools (streaming logs, step-level metrics) for job submission and run management

Develop Next.js/React UIs with shadcn, Tailwind, and tRPC for model/adapter management and comparisons

Operate observability stack (Prometheus, Grafana, Loki, DCGM) and optimize GPU cluster debugging workflows

Interface with RL trainers, inference servers, and environment servers to productize new training capabilities

Maintain GitOps workflows for CI/CD of Helm values and infrastructure changes

Technical Skills Required

Kubernetes Python GPU Infrastructure (NVIDIA H100/H200/B200, distributed training)

Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.

Benefits & Perks

Cash compensation $150K–$300K with significant equity

Full visa sponsorship and relocation support

Flexible work arrangement (remote or San Francisco office)

Job Description

Prime Intellect is building the open superintelligence stack: the infrastructure frontier AI labs build internally, made available to every ambitious AI team.

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.