R

Senior Performance and Kernel Generation Engineer

river ai • United States
Visa Sponsorship Relocation
This Job is No Longer Active This position is no longer accepting applications

Design and implement robust kernel generators and C++ code-generation frameworks to emit optimized assembly for custom silicon. Optimize core deep learning primitives like GEMM and Attention, focusing on microarchitectural tuning and memory hierarchy management. Requires 5+ years of experience in low-level performance programming, advanced C++, and deep understanding of computer architecture.

Key Highlights
Build foundational compute engine for high-performance custom silicon
Bridge gap between high-level compilation and raw hardware capability
Collaborate with compiler engineers, silicon architects, and deep learning researchers
Key Responsibilities
Design and build C++ code-generation frameworks and meta-programming toolchains that automatically emit optimized custom ISA assembly code.
Author and optimize core deep learning primitives (GEMM/MatMul, Attention mechanisms, Convolutions, and element-wise layers) directly targeted at custom hardware.
Hand-craft and automate instruction scheduling, register allocation, and software pipelining to maximize ALU utilization and hide execution latency.
Design sophisticated tiling, double-buffering, and data-movement strategies to optimize on-chip SRAM utilization and minimize memory bandwidth bottlenecks.
Partner with RTL and architecture teams to evaluate hardware simulations, provide feedback on the ISA, and influence the design of future compute units.
Benchmark generated assembly against hardware simulators and silicon, utilizing hardware performance counters to eliminate performance gaps and ensure mathematical correctness.
Technical Skills Required
C++ Computer Architecture Kernel Optimization
Benefits & Perks
Health, dental, and vision benefits
Unlimited PTO
Relocation support
Nice to Have
Deep familiarity with implementing microarchitectural optimizations for Tensor Cores, matrix multiply-accumulate units, or custom vector extensions.
Experience utilizing advanced C++ template metaprogramming or code-generation techniques to automate the creation of heavily parameterized kernel variants.
Advanced experience with low-level hardware profiling tools, execution tracing, and utilizing performance counters to identify cache misses, pipeline stalls, and ALU bubbles.

Job Description

At River, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, custom training infrastructure, next-generation UIs, and frontier deep learning research.

Who we are

We are scientists, engineers, and builders from the industry's top tech companies and AI labs. We bring a proven track record of scaling consumer systems for hundreds of millions of users and architecting the pre-training infrastructure behind today's frontier models.

About The Role

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Hidden company

Log in to see location

Premium

Senior AI Engineer

Programming Full-time 1m ago

Log in free to see the details

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Relocation Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.