C

Senior Machine Learning Engineer (Distributed Systems & Model Optimization)

Relocation
Apply Now

Lead the productization and optimization of ML models into scalable, high-performance services with clear SLOs. Own distributed training (DDP/FSDP/ZeRO) and inference optimization (quantization, pruning, Flash Attention) while collaborating across Research, Platform, and Data teams. Build and maintain model-serving systems with cost and latency efficiency in production environments.

Key Highlights
Own end-to-end ML lifecycle from research to production, ensuring reliability, scalability, and cost-efficiency
Deep expertise in distributed training (DDP, FSDP, ZeRO) and model optimization techniques (quantization, pruning, Flash Attention)
Build and maintain high-throughput, low-latency model-serving systems with batching, streaming, and caching
Key Responsibilities
Productize and optimize ML models into reliable, performant, and cost-efficient production services with defined SLOs (latency, availability, cost)
Scale distributed training across nodes/GPUs using DDP, FSDP, ZeRO, and pipeline/tensor parallelism while optimizing throughput and time-to-train
Implement model-efficiency techniques (quantization, distillation, pruning, KV-cache, Flash Attention) without degrading quality
Design and maintain model-serving systems (vLLM/Triton/TGI/ONNX/TensorRT) with batching, streaming, caching, and memory management
Integrate with vector/feature stores (FAISS/Milvus/Pinecone/pgvector) and data pipelines (Parquet/Delta) for production use
Define and track performance/cost KPIs, run continuous improvement loops, and collaborate on capacity planning
Partner with ML Ops on CI/CD, observability, and model registries; collaborate with Scientists on reproducible handoffs and evaluations
Technical Skills Required
PyTorch Distributed Systems (DDP, FSDP, ZeRO) Model Optimization (Quantization, Pruning, Flash Attention)
Benefits & Perks
Annual salary range of $240,000–$250,000
Relocation assistance offered
Hybrid work model (3x onsite weeks in San Jose, CA)
Nice to Have
TensorFlow
FAISS/Milvus/Pinecone/pgvector
Parquet/Delta Lake
Autoscaling and load-balancing systems
Experience with ONNX/TensorRT/AITemplate

Job Description

Title: Machine Learning Engineer
Location : Remote or Location: San Jose, CA (hybrid onsite 3x per week – Tues, Wed, Thurs)
Target Start Date : ASAP
Type: (C, CTH, D) Direct Hire
Pay Rate / Salary (Ranges OK) : 240,000 -250,000
See Remarks

Title: Machine Learning Engineer

Job Description

Responsibilities:

· Productize and optimize models from Research into reliable, performant, and cost-efficient services with clear SLOs (latency, availability, cost).

· Scale training across nodes/GPUs (DDP/FSDP/ZeRO, pipeline/tensor parallelism) and own throughput/time-to-train using profiling and optimization.

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources

Similar Jobs

Explore other opportunities that match your interests

Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

wayve

United State

Junior AI/ML Engineer

Machine Learning
•
14h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Entry level

Tech Consulting

United State

AI/ML Engineer

Machine Learning
•
14h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Entry level

Tech Consulting

United State

Subscribe our newsletter

New Things Will Always Update Regularly