Senior ML Inference Optimization Engineer

coffeespace • San Francisco Bay Area

Visa Sponsorship Relocation

This Job is No Longer Active This position is no longer accepting applications

AI Summary

Optimize large multimodal models for real-time video conversation. Collaborate with founders and researchers to ship the company's first major product. Work on frontier AI involving video, speech, and language.

Key Highlights

Optimize models for inference latency, throughput, and cost efficiency

Collaborate with founders and researchers to ship the first major product

Work on frontier multimodal AI involving video, speech, and language

Looking to advance your Machine Learning & AI career with relocation support? Explore Machine Learning & AI Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.

Key Responsibilities

Profile and optimize large multimodal models for inference latency, throughput, and cost efficiency

Identify bottlenecks using tools such as NSight, Torch Profiler, CUDA debugging tools, and production observability systems

Apply acceleration techniques including quantization, pruning, distillation, TensorRT, ONNX, Triton, and vLLM

Build and maintain infrastructure that supports researchers from experimentation through deployment

Develop evaluation frameworks that measure performance, quality, and operational reliability

Collaborate with research teams on model architecture decisions that impact production performance

Technical Skills Required

PyTorch CUDA GPU systems Inference optimization Quantization Pruning Distillation TensorRT ONNX Triton vLLM

Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.

Benefits & Perks

$250K-$450K base + equity

Visa sponsorship available

Relocation support available

Job Description

Job Title: ML Inference Optimization Engineer

Salary: $250K-$450K base + equity

Location: Seattle, WA (5 days in-office)

Visa sponsorship available

Relocation support available

Company Description

Venture-backed AI startup building real-time visual conversational AI.

The team is tackling one of the hardest problems in modern AI: creating systems that can understand and respond to human emotion, behavior, and conversation in real time through video.

Backed by over $60M in funding, the company is moving from research to production and assembling a small team of engineers who can bridge cutting-edge models with real-world deployment.

Job Description

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.