I

Forward Deployed Engineer

inferact • United State
Visa Sponsorship
Apply Now

Deploy, integrate, and optimize vLLM-powered inference systems within real customer environments. Own production problems end-to-end and collaborate with core engineering to build reusable product capabilities. Requires strong software engineering skills in Python or Go and experience operating ML infrastructure at scale.

Key Highlights
Hands-on engineering role focused on customer deployment and system optimization
Directly influences product evolution by turning field learnings into reusable features
High-impact role sitting at the intersection of AI models and hardware infrastructure
Key Responsibilities
Work directly with customers to deploy, integrate, debug, and optimize vLLM-powered inference systems.
Manage production problems end-to-end across cloud, Kubernetes, GPU, and networking environments.
Collaborate with core product and engineering teams to translate customer needs into reusable product capabilities.
Drive implementations and debugging to resolution within ambiguous technical environments.
Reason about latency, throughput, batching, and cost tradeoffs in production inference environments.
Technical Skills Required
Python Kubernetes Machine Learning Infrastructure
Benefits & Perks
Health, dental, and vision benefits
401(k) company match
Visa sponsorship on a case-by-case basis
Equity
Nice to Have
Experience with vLLM, SGLang, TensorRT-LLM, TGI, Ray Serve, or BentoML
Experience with NVIDIA/AMD GPUs, CUDA, ROCm, or GPU scheduling
Experience deploying infrastructure into enterprise or regulated environments
Experience building APIs, SDKs, CLIs, or developer tooling
Experience profiling GPU utilization and performance regressions
Contributions to open-source ML or cloud infrastructure projects

Job Description

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware, a position that took years to build.We're looking for a Forward Deployed Engineer to make Inferact successful inside real customer environments. You'll work directly with customers to deploy, integrate, debug, and optimize vLLM-powered inference systems across cloud, Kubernetes, GPU, networking, and model-serving environments.
Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources

Similar Jobs

Explore other opportunities that match your interests

Senior Full Stack Software Engineer - Cyber Engineering

Programming
•
59m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Deloitte

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

Deloitte

United State

Manager, Technology Risk & Compliance - Global Audit & Assurance Digital Products

Programming
•
1h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Deloitte

United State

Subscribe our newsletter

New Things Will Always Update Regularly