T

Senior Machine Learning Infrastructure Engineer (Research Tooling)

thinking machines lab • United State
Visa Sponsorship Relocation
Apply
AI Summary

Build and maintain core research infrastructure, including evaluation frameworks, training systems, and experiment-tracking platforms for a small, cross-functional team. Collaborate closely with researchers to identify bottlenecks and design intuitive, high-impact tools. Own end-to-end systems with a focus on reliability, reproducibility, and developer productivity.

Key Highlights
Own and improve critical research infrastructure like evaluation libraries, training systems, and experiment-tracking platforms
Work closely with researchers to identify and solve tooling bottlenecks with product-driven development
Build end-to-end systems with strong emphasis on reliability, reproducibility, and observability
Key Responsibilities
Design, build, and maintain research infrastructure including evaluation frameworks, training systems, and experiment-tracking platforms
Collaborate with researchers to identify bottlenecks and develop scalable, generalizable solutions
Develop end-to-end systems from problem discovery to deployment and operation, ensuring reliability and reproducibility
Build user-facing applications with strong product intuition and UI/UX focus
Implement robust quality control, monitoring, and observability for research experiments and model training
Technical Skills Required
Python Backend Systems Databases
Benefits & Perks
Generous health, dental, and vision benefits
Unlimited paid time off (PTO)
Paid parental leave
Nice to Have
Experience building tools for researchers or improving developer productivity
Polished, intuitive user-facing applications with strong product judgment
Experience in ML research infrastructure (training frameworks, evaluation libraries, experiment tracking)
Startup or small-team experience building technically complex products

Job Description


About the Role

We are a team of full stack generalists with strong product instincts who work closely with researchers. We build systems that compound research and engineering velocity over time. We own the internal platform researchers use every day to manage and monitor training runs and evaluations, inspect and debug model trajectories, and compare results on shared leaderboards.


You’ll own key parts of this platform, including evaluation and training libraries, experiment-tracking systems, and visualization tools. You’ll identify researchers’ most important bottlenecks and turn them into reliable, generalizable systems. Our team is still small—expect to participate in research meetings, build close relationships with researchers, and gather feedback frequently to develop conviction about where we should invest next.


This role requires technical judgment, close cross-functional collaboration, and product intuition. Success means researchers trust your systems to work, rely on them every day, and find them genuinely delightful to use.


What You’ll Do

  • Design, build, and maintain research infra, including evaluation frameworks, training systems, experiment tracking platforms, and visualization tools.
  • Work across backend systems, data pipelines, and user-facing applications to deliver tools end to end.
  • Partner directly with researchers to identify bottlenecks and unlock new capabilities. Treat research tooling as a product: proactively gather feedback, set priorities, and measure adoption.
  • Build systems for reproducibility, traceability, and robust quality control across research experiments and model training runs, with monitoring and observability built in.


Skills and Qualifications


Minimum qualifications

  • A bachelor’s degree, or equivalent practical experience, in computer science, engineering, machine learning, or a related field.
  • Two years of post-grad work experience as a software engineer or ML engineer, exclusive of internships.
  • Strong software engineering fundamentals and experience building reliable, maintainable systems.
  • Proficiency in at least one backend programming language; we primarily use Python and Rust. We use React and Typescript on the frontend.
  • Experience working with databases, data warehouses (Clickhouse), caching systems such as Redis, and other data infra.
  • Comfort working across the stack and owning projects from initial problem discovery through deployment and operation.
  • Experience collaborating with cross-functional partners and subject-matter experts.


Preferred qualifications

We encourage you to apply even if you meet only some of these:

  • A track record of building tools for researchers, improving developer productivity, or creating technical products for technical users.
  • Experience building polished, intuitive user-facing applications that demonstrate strong product judgment and attention to detail on UI/UX.
  • Experience at a startup or on a small team, building technically complex products end to end.
  • Experience building or maintaining ML research infrastructure, such as training frameworks, evaluation libraries, or experiment-tracking systems.
  • Experience working closely with researchers to understand and solve their tooling needs.


Logistics

  • Location: This role is based in San Francisco, California.
  • Compensation: Depending on background, skills and experience, the expected annual salary range for this position is $300,000 - $475,000 USD.
  • Visa sponsorship: We sponsor visas. While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.
  • Benefits: Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.

Similar Jobs

Explore other opportunities that match your interests

Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

thinking machines lab

United State

Lead AI Engineer (AI Systems & Large Language Models)

Programming
•
45m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Capital One

United State

Senior DataBricks Engineer (Remote)

Programming
•
48m ago
Visa Sponsorship Relocation Remote
Job Type Contract
Experience Level Mid-Senior level

silicon tech solutions, inc

United State

Subscribe our newsletter

New Things Will Always Update Regularly