J

Senior Machine Learning Engineer, Inference (Full-time)

Jobgether • United States
Visa Sponsorship Relocation
Apply Now

Leads end-to-end inference optimization for real-time voice and LLM models, improving latency, throughput, and GPU efficiency. Requires 5+ years of senior ML inference or systems engineering experience, expertise in vLLM/TRT-LLM, and hands-on GPU optimization with C++, CUDA, or Rust. Must reside in the United States.

Key Highlights
Owns inference optimization from research to production deployment for real-time voice and LLM models
Requires 5+ years of senior ML inference or systems engineering experience
Must have hands-on experience with vLLM/TRT-LLM and GPU optimization (C++, CUDA, Rust)
Key Responsibilities
Lead end-to-end inference optimization for production ML models
Improve latency and throughput for real-time voice and LLM inference
Develop high-performance GPU workloads using C++, CUDA, Rust, or optimized Python
Build and scale distributed multi-GPU and multi-node inference systems
Collaborate with research and product teams to deploy new models
Technical Skills Required
Machine Learning Inference Optimization GPU Programming (C++, CUDA, Rust) Distributed Systems (Kubernetes, Ray)
Benefits & Perks
$250,000–$300,000 annual base salary
Competitive equity
Visa support (H-1B and OPT transfers)
Relocation assistance for San Francisco Bay Area
English-speaking work environment
Nice to Have
Track record of rapid career progression
Contributions to open-source inference engines or technical publications
PhD in Computer Science, Physics, or Mathematics
Degree from a leading computer science program
Ability to commute to Mountain View, California

Job Description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Machine Learning Engineer, Inference based in the United States.

Join a high-performing engineering team developing advanced real-time voice and large language model (LLM) technology. As a Senior Machine Learning Engineer, you will own inference optimization from research through production deployment, helping bring sophisticated models to consumer-scale applications. You will tackle complex challenges involving latency, throughput, GPU efficiency, and distributed serving infrastructure.

Accountabilities

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Hidden company

Log in to see location

Premium

Lead AI/ML Systems Engineer (Satellite Ground Systems)

Machine Learning Full-time Mid-Senior level 4h ago

Log in free to see the details

Hidden company

Log in to see location

Premium

Research Scientist Intern - Ads Core (PhD, 2027 Start)

Machine Learning Internship Internship 4h ago

Log in free to see the details

Archer Aviation

United States

AI/ML Research Engineer

Machine Learning Full-time Mid-Senior level 10h ago

  • AI
  • Artificial Intelligence
  • Deep Learning
  • Machine Learning
Visa

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Relocation Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.