I

Inference Runtime Engineer

inferact • United States
Remote Visa Sponsorship
This Job is No Longer Active This position is no longer accepting applications

Inferact is seeking an Inference Runtime Engineer to optimize the execution of large language models across diverse hardware and architectures. The ideal candidate will have a deep understanding of transformer architectures and experience with LLM inference systems. The role requires strong programming skills in Python and the ability to contribute performant and maintainable code.

Key Highlights
Optimize LLM execution across diverse hardware and architectures
Work on the core of vLLM
Impact how the world runs AI inference
Technical Skills Required
Python PyTorch Transformer architectures LLM inference systems
Benefits & Perks
Generous health, dental, and vision benefits
401(k) company match
Equity
Nice to Have
Deep understanding of KV-cache memory management
Familiarity with RL frameworks and algorithms for LLMs
Contributions to open-source ML or system infrastructure projects

Job Description

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Hidden company

Log in to see location

Premium

Principal Software Engineer (AI Posture)

Programming Full-time Mid-Senior level 4h ago

Log in free to see the details

Feedinkoo: Remote Jobs

United States

Remote Web Developer

Programming Full-time Associate 4h ago

  • Responsive
  • Responsive Design
  • SEO
  • Wordpress
Remote

Hidden company

Log in to see location

Premium

Engineering Manager, UX AI Enablement (Prototyping Tool)

Programming Full-time Mid-Senior level 6h ago

Log in free to see the details

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Remote Work Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.