R

GPU Kernel Engineer

river ai • United States
Visa Sponsorship Relocation
This Job is No Longer Active This position is no longer accepting applications
AI Summary

Build and optimize high-performance GPU kernels for attention, matrix multiplication, and low-precision computation to accelerate AI training and inference. Own performance-critical operations including expert routing and fused operations while ensuring numerical correctness. Requires strong expertise in CUDA, C++, and GPU architecture with a focus on profiling and benchmarking.

Key Highlights
Develop fast GPU kernels for attention, matrix multiplication, and mixture-of-experts execution.
Optimize memory access, tiling, and synchronization for NVIDIA hardware.
Implement FP8, FP4, and mixed-precision kernels while preserving numerical correctness.

Looking to advance your Development & Programming career with relocation support? Explore Development & Programming Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.

Key Responsibilities
Build fast GPU kernels for attention, matrix multiplication, expert routing, and related operations.
Optimize memory access, tiling, and synchronization to make efficient use of GPU hardware.
Develop FP8, FP4, and mixed-precision kernels while preserving numerical correctness.
Accelerate fine-tuning and RL through optimized adapters, backward passes, and fused operations.
Profile real workloads and integrate improvements into training and inference runtimes.
Build reproducible benchmarks that verify correctness, gradients, and performance.
Technical Skills Required
CUDA C++ Python

Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.

Benefits & Perks
Comprehensive health, dental, and vision insurance
Unlimited PTO
Relocation assistance

Interested in relocating to United State? Check out our comprehensive Relocation Jobs in United State page with detailed relocation packages and benefits.

Nice to Have
Experience optimizing for NVIDIA Blackwell or Hopper GPUs
Work on attention, mixture-of-experts kernels, grouped GEMMs, or low-rank adapters
Experience implementing backward passes and validating gradients
Familiarity with FP8, FP4, and quantized weight layouts
Experience integrating custom operators into PyTorch, SGLang, vLLM, or similar frameworks
Open-source contributions or a track record of shipping substantial kernel optimizations

Job Description

At River AI, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, bespoke training infrastructure, next-generation UIs, and frontier deep learning research.

Who we are

We are scientists, engineers, and builders from the industry's top tech companies and AI labs. We bring a proven track record of scaling consumer systems for hundreds of millions of users and architecting the pre-training infrastructure behind today's frontier models.

About The Role

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Sep 16, 2026
Employment Full-time
Experience Not Applicable
Location United States
Category Programming
Company river ai
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Hidden company

Log in to see location

Premium

Senior AI Engineer

Programming Full-time 23s ago

Log in free to see the details

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Relocation Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.