Talenthop
United States
ML Platform Engineer
Machine Learning Full-time Mid-Senior level 10h ago
- AI
- Artificial Intelligence
- C++
- Cloud
AI Summary
Designs and operates high-performance ML inference platforms for production environments, focusing on request routing, batching, caching, autoscaling, GPU utilization, and observability. Requires 6+ years in distributed systems, infrastructure, or ML platform engineering with expertise in Python, Go/Rust/C++, and large model inference frameworks like vLLM/TensorRT-LLM. Must handle incident response and performance optimization.
Key Responsibilities
Design and operate high-throughput, low-latency ML inference platforms
Manage request routing, batching, caching, and autoscaling mechanisms
Optimize GPU utilization and memory hierarchies
Implement observability through metrics, tracing, and logging
Balance trade-offs between latency, throughput, cost, and quality in ML serving
Respond to incidents and communicate effectively during operational events
Interested in remote work opportunities in Machine Learning & AI? Discover Machine Learning & AI Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
Technical Skills Required
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
Job Description
This is a Fully Remote Job
About Our Client:
The organization operates in technology consulting and software development, providing cloud, AI, data, and enterprise solutions across the United States. It addresses the need for advanced technology services by delivering scalable and innovative solutions to clients nationwide.
About the Opportunity:
Want the full job description?
Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn
This is a short excerpt. All rights to the full description belong to its original publisher.
Keep exploring
Similar Jobs
Explore other opportunities that match your interests
Utilidata
United States
AI Infrastructure Engineer
Machine Learning 11h ago
- AI
- Cloud
- Mlops
- Technical Expertise
Striveworks, Inc
United States
Senior Machine Learning Engineer, Agentic Systems
Machine Learning Full-time Mid-Senior level 13h ago
- AI
- Angular
- Artificial Intelligence
- C++
Remote Work Guides
Practical guides for finding and thriving in remote roles.
How to Get a Remote Job with No Experience
Getting a remote job with no experience is possible if the job seeker knows where to look and how to present their skills. Entry‑l...
Read Article
Do Remote Jobs Provide Equipment?
You might be wondering if your new employer will pay for your home office setup or if you’ll have to cover the costs yourself. The...
Read Article
What Are the Highest-Paying Remote Jobs?
If you’re looking for a career that offers a great income and the ability to work from anywhere, you’re not the only one. The job...
Read Article
Which Companies Offer Remote Jobs?
Advances in technology have made remote jobs more popular than before. Many companies now allow employees to work from home either...
Read ArticleSubscribe to our newsletter
New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.