T

ML Platform Engineer

talenthop • United States
Remote
Apply Now
AI Summary

Design, build, and operate high-performance inference platforms for large machine learning models in production. Design and operate model serving platforms, optimize inference performance, and manage observability, reliability, and deployment workflows for AI services. Requires a Bachelor’s or Master’s degree, over 10 years of distributed systems, infrastructure, or ML platform experience, and proficiency in Python plus Go, Rust, or C++.

Key Highlights
Fully remote role
Designs and operates ML inference platforms
Optimizes latency, throughput, cost, and quality
Requires 10+ years of relevant experience
Salary range $100,000 to $160,000 annually

Interested in remote work opportunities in Machine Learning & AI? Discover Machine Learning & AI Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

Key Responsibilities
Design and operate model serving platforms for various workloads including language models, vision models, and recommendation systems.
Optimize inference performance through techniques such as batching, speculative decoding, and request multiplexing.
Implement multi-tenant routing, rate limiting, and quality-of-service policies.
Develop autoscaling and capacity management systems balancing latency, throughput, and cost.
Tune GPU utilization, memory management, and caching strategies for large model serving.
Integrate model serving with API gateways, identity systems, and observability tools.
Implement caching, prompt deduplication, and response reuse strategies.
Manage end-to-end observability covering latency, queue dynamics, GPU utilization, and error tracking.
Develop deployment workflows including canary releases and automated rollback.
Lead incident response and reliability improvements for AI services.
Collaborate with ML and product teams on new model releases and features.
Implement security controls like request signing, content filtering, and abuse detection.
Document operational procedures, performance metrics, and tuning guidance.
Stay current with AI serving research and apply advancements to production.

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Technical Skills Required
Python Kubernetes Cloud platforms

Job Description

About Our Client

The organization operates in the technology consulting and software development industry, specializing in delivering cloud, artificial intelligence, data, and enterprise solutions across the United States. It addresses the challenge of integrating advanced AI and software technologies into business environments, supporting clients with scalable and reliable solutions.

About the Opportunity

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

Ready to apply?

Apply Now
See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Nov 03, 2026
Employment Full-time
Experience Mid-Senior level
Location United States
Category Machine Learning
Company talenthop
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Remote Work Guides

Practical guides for finding and thriving in remote roles.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.