I

Inference Runtime Engineer

inferact • Singapore
Visa Sponsorship
This Job is No Longer Active This position is no longer accepting applications
AI Summary

Design and optimize core inference engine for large language and diffusion models. Implement performance improvements across diverse hardware architectures. Contribute to vLLM's core codebase and research-driven inference techniques.

Key Highlights
Optimize LLM and diffusion model serving at the core of vLLM
Work with transformer architectures and PyTorch internals
Implement KV-cache memory management and prefix caching
Develop performant code for multimodal inference systems
Key Responsibilities
Optimize how models execute across diverse hardware and architectures
Implement performant and maintainable code for complex ML codebases
Debug and contribute to vLLM's core inference engine

Searching for Development & Programming roles that provide visa sponsorship? Connect with international employers through Development & Programming Jobs with Visa Sponsorship opportunities actively seeking talented professionals.

Technical Skills Required
Python PyTorch LLM inference systems KV-cache memory management
Benefits & Perks
Medical coverage
Dental coverage
Vision coverage

Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.

Nice to Have
RL frameworks and algorithms for LLMs
Multimodal inference (audio/image/video/text)
Contributions to open-source ML or system infrastructure projects
Implemented core features in vLLM or other inference engine projects
Contributed to vLLM integrations (verl, OpenRLHF, Unsloth, LlamaFactory)
Written widely-shared technical blogs or side projects on vLLM or LLM inference

Job Description

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Jun 24, 2026
Employment Full-time
Experience Not Applicable
Location Singapore
Category Programming
Company inferact
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Visas, Work Permits & Legal Insights

Stay informed about visa types, work permits, and immigration updates for international professionals.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.