I

Senior Cloud Orchestration Engineer (vLLM Infrastructure)

inferact • United States
Remote Visa Sponsorship
This Job is No Longer Active This position is no longer accepting applications
AI Summary

Design and build scalable cloud orchestration systems for vLLM’s AI inference engine, ensuring reliable GPU cluster management, deployment automation, and production monitoring at global scale. Focus on Kubernetes, custom operators, and cross-cloud infrastructure to enable frictionless AI model serving. Drive operational reliability for large-scale ML workloads with a focus on observability and debugging.

Key Highlights
Build and maintain the operational backbone for vLLM’s global AI inference infrastructure at massive scale
Design Kubernetes-based cluster management, deployment automation, and production monitoring systems
Ensure observability, debuggability, and recoverability for vLLM deployments across cloud and on-premise environments

Searching for Devops roles that provide visa sponsorship? Connect with international employers through Devops Jobs with Visa Sponsorship opportunities actively seeking talented professionals.

Key Responsibilities
Design and implement custom Kubernetes operators for vLLM deployment automation and cluster management
Develop systems for scalable GPU cluster orchestration, multi-tenancy, and resource optimization
Ensure production-grade observability, debugging, and recovery mechanisms for AI inference workloads
Collaborate across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure for seamless deployment
Improve operational reliability and performance of large-scale ML systems
Technical Skills Required
Kubernetes Container Orchestration Python

Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.

Benefits & Perks
Competitive compensation (salary + equity)
Health coverage where applicable
Fully remote work with timezone flexibility

Interested in opportunities specifically in United State? Discover our dedicated Visa Sponsorship Jobs in United State page featuring roles from top employers in this location.

Nice to Have
Experience with ML-specific orchestration tools (Ray, Slurm)
GPU scheduling and multi-tenancy expertise
Familiarity with vLLM deployment patterns and configurations
Experience deploying inference systems on 1,000+ GPU clusters

Job Description

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Aug 25, 2026
Employment Full-time
Experience Not Applicable
Location United States
Category Devops
Company inferact
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Hidden company

Log in to see location

Premium

Senior Principal DevOps Engineer (AIOps)

Devops Mid-Senior level 4h ago

Log in free to see the details

Hidden company

Log in to see location

Premium

Staff Cloud Engineer

Devops Full-time Mid-Senior level 6h ago

Log in free to see the details

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Remote Work Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.