I

Inference Runtime Engineer

inferact • United States
Remote Visa Sponsorship
This Job is No Longer Active This position is no longer accepting applications

Inferact is seeking an Inference Runtime Engineer to push the boundaries of what's possible in LLM and diffusion model serving. The ideal candidate will have a deep understanding of transformer architectures and their variants, strong programming skills in Python, and experience with LLM inference systems.

Key Highlights
Inference Runtime Engineer
LLM and diffusion model serving
Transformer architectures
Python programming skills
LLM inference systems
Technical Skills Required
Python PyTorch Transformer architectures LLM inference systems KV-cache memory management Prefix caching Hybrid model serving
Benefits & Perks
Annual salary range: $200,000 - $400,000
Equity
Health, dental, and vision benefits
401(k) company match
Remote work option
Visa sponsorship

Job Description

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Hidden company

Log in to see location

Premium

Principal Software Engineer (AI Posture)

Programming Full-time Mid-Senior level 4h ago

Log in free to see the details

Feedinkoo: Remote Jobs

United States

Remote Web Developer

Programming Full-time Associate 4h ago

  • Responsive
  • Responsive Design
  • SEO
  • Wordpress
Remote

Hidden company

Log in to see location

Premium

Engineering Manager, UX AI Enablement (Prototyping Tool)

Programming Full-time Mid-Senior level 6h ago

Log in free to see the details

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Remote Work Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.