P

Staff/Principal ML Ops Engineer

Pragmatike • United States
Relocation
Apply Now

Lead the design, implementation, and scaling of the company's ML infrastructure and production AI systems. Architect and operate end-to-end ML Ops pipelines across training, evaluation, deployment, observability, and optimization. Requires Staff/Principal-level experience with production ML systems, distributed systems, cloud infrastructure, Python, and Kubernetes.

Key Highlights
Lead end-to-end ML Ops pipeline architecture and scaling
Production ML systems across cloud and on-prem GPU clusters
Observability, automation, and CI/CD for ML models
Staff/Principal-level technical leadership and mentoring
Key Responsibilities
Architect, build, and scale the end-to-end ML Ops pipeline, including training, fine-tuning, evaluation, rollout, and monitoring.
Design reliable infrastructure for model deployment, versioning, reproducibility, and orchestration across cloud and on-prem GPU clusters.
Optimize compute usage across distributed systems (Kubernetes, autoscaling, caching, GPU allocation, checkpointing workflows).
Lead the implementation of observability for ML systems (monitor drift, performance, throughput, reliability, cost).
Build automated workflows for dataset curation, labeling, feature pipelines, evaluation, and CI/CD for ML models.
Collaborate with researchers to productionize models and accelerate training/inference pipelines.
Establish ML Ops best practices, internal standards, and cross-team tooling.
Mentor engineers and influence architectural direction across the entire AI platform.
Technical Skills Required
Python Kubernetes PyTorch
Benefits & Perks
Competitive salary & equity options
Sign-on bonus
Health, Dental, and Vision
401k
Nice to Have
Experience deploying and operating LLMs and generative models in production at enterprise scale.
Familiarity with DevOps, CI/CD, automated deployment pipelines, and infrastructure-as-code.
Experience optimizing GPU clusters, scheduling, and distributed training frameworks.
Prior startup experience or comfort operating with ambiguity and high ownership.
Experience working with data engineering, feature pipelines, or real-time ML systems.

Job Description

Location

Cambridge, MA (Eastern Time / UTC -4)

Relocation package available or Remote option for Out-Of-State applicants

Start Date

ASAP

Languages

English (required)

About The Role

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Hidden company

Log in to see location

Premium

Principal or Senior Principal Software Engineer - Cloud and Applications

Log in free to see the details

Hidden company

Log in to see location

Premium

Infrastructure Engineer (Hosting)

Log in free to see the details

Hidden company

Log in to see location

Premium

Infrastructure Engineer (Hosting)

Log in free to see the details

Relocation Guides

Step-by-step relocation guides, from moving logistics to settling abroad.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.