R

Senior Inference Systems Engineer (AI Model Serving & Performance Optimization)

river ai • United States
Visa Sponsorship Relocation
This Job is No Longer Active This position is no longer accepting applications
AI Summary

Build high-performance inference engines for River AI’s proprietary AI models, optimizing GPU compute, latency, and reliability. Own serving runtime, distributed execution, and RL sampling workloads while collaborating with researchers and kernel engineers. Focus on dense/mixture-of-experts models, batching, caching, and fault tolerance under production traffic.

Key Highlights
Own end-to-end inference serving stack, including scheduling, batching, KV-cache, and multi-GPU execution
Optimize performance for dense/mixture-of-experts models with strict attention to latency, throughput, and cost
Collaborate with GPU kernel engineers, researchers, and infrastructure teams to scale model serving

Looking to advance your Development & Programming career with relocation support? Explore Development & Programming Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.

Key Responsibilities
Optimize inference for dense and mixture-of-experts models, including fine-tuned models and adapters
Improve batching, caching, and admission control to balance throughput, latency, memory use, and fairness
Accelerate multi-GPU execution, communication, and model loading while preserving model-version consistency
Build reliable streaming, cancellation, and recovery mechanisms under failures and overload conditions
Profile bottlenecks and validate improvements through reproducible performance and correctness tests
Technical Skills Required
GPU Memory Management Distributed Systems Transformer Inference

Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.

Benefits & Perks
Comprehensive health, dental, and vision insurance
Unlimited paid time off (PTO)
Relocation assistance as needed

Interested in relocating to United State? Check out our comprehensive Relocation Jobs in United State page with detailed relocation packages and benefits.

Nice to Have
Experience with SGLang, vLLM, or TensorRT-LLM frameworks
Familiarity with expert parallelism, GPU collectives, and quantized inference
Experience with multi-adapter serving, dynamic checkpoint loading, or RL sampling

Job Description

At River AI, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, bespoke training infrastructure, next-generation UIs, and frontier deep learning research.

Who we are

We are scientists, engineers, and builders from the industry's top tech companies and AI labs. We bring a proven track record of scaling consumer systems for hundreds of millions of users and architecting the pre-training infrastructure behind today's frontier models.

About The Role

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Sep 16, 2026
Employment Full-time
Experience Not Applicable
Location United States
Category Programming
Company river ai
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Hidden company

Log in to see location

Premium

Senior AI Engineer

Programming Full-time 1m ago

Log in free to see the details

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Relocation Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.