T

Machine Learning Research Engineer - Post-Training & Fine-Tuning

thinking machines lab San Francisco Bay Area
Visa Sponsorship Relocation
Apply
AI Summary

Advance frontier fine-tuning and post-training techniques for customizing large language models at Thinking Machines. Ship research into Tinker's training engine, improve stability and efficiency of large-scale RL and fine-tuning runs, and contribute to open-source recipes and publications. Requires strong Python, deep learning frameworks, and distributed training expertise with a background in ML, CS, Physics, or Mathematics.

Key Highlights
Work on frontier customization techniques and build the best post-training engine (Tinker) in the industry
Contribute to areas like LoRA, parameter-efficient fine-tuning, and their interaction with RL and post-training
Ship research into product by informing Tinker's training defaults, API design, and the open-source Tinker Cookbook
Share findings through papers, technical blog posts, and community contributions
Based in San Francisco with visa sponsorship available
Key Responsibilities
Advance the science of fine-tuning and frontier post-training techniques
Contribute to areas like LoRA, parameter-efficient fine-tuning, and how they interact with RL and post-training
Ship research into product by informing Tinker's training defaults and primitives
Codify best-practice methods as recipes in the Tinker Cookbook
Improve the stability, efficiency, and reliability of large-scale fine-tuning and RL runs on Tinker
Share learnings through papers, technical blog posts, and community contributions
Work with internal research teams and contribute to open science for external partners
Technical Skills Required
Python Deep Learning Frameworks Distributed Training
Benefits & Perks
Health, dental, and vision benefits
Unlimited PTO
Paid parental leave
Relocation support
Nice to Have
Strong grasp of probability, statistics, and ML fundamentals
Prior experience with RLHF, RLAIF, preference modeling, or reward learning for large models
Experience managing or analyzing human data collection campaigns or large-scale annotation workflows
Research or engineering contributions in alignment, data-centric AI, or human-AI collaboration
Experience with RL training stability techniques for large runs
PhD in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline

Job Description


About Thinking Machines

The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.


About the Role

At Thinking Machines we build tools that enable people to make AI their own, customizing models to serve their unique needs. This includes the ability to train model weights.

In this role, you'll work on frontier customization techniques and help build the best post-training engine in the industry – Tinker – drawing on a whole-stack understanding of RL science. Findings directly shape Tinker's training defaults, API design, and the open-source Tinker Cookbook. You'll work with our internal research teams as well as contributing to open science for external partners.


What You’ll Do


In this role, you'll advance the science of fine-tuning and frontier post-training techniques. You’ll:

  • Contribute to areas like LoRA and parameter efficient fine-tuning and how to push customization quality, efficiency, and reliability to the frontier.
  • Ship research into product: inform Tinker's training defaults and primitives, and codify best-practice methods as recipes in the Tinker Cookbook.
  • Improve the stability, efficiency, and reliability of large-scale fine-tuning and RL runs on Tinker.
  • Share what you learn through papers, technical blog posts, and community contributions.


You’ll contribute to areas like LoRA, parameter-efficient fine-tuning, how things interact with RL and post-training, and how to push customization quality, efficiency, and reliability to the frontier.


Skills and Qualifications

Required qualifications:

  • Bachelor’s degree or equivalent experience in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline with strong theoretical and empirical grounding.
  • Proficiency in Python and familiarity with deep learning frameworks (e.g., PyTorch, TensorFlow, or JAX). Comfort debugging distributed training and writing code that scales.
  • Clarity in communication, an ability to explain complex technical concepts in writing.
  • Strong interest in our mission to enable custom models.


Preferred qualifications — we encourage you to apply if you meet some but not all of these:

  • A strong grasp of probability, statistics, and ML fundamentals. You can look at experimental data and distinguish between real effects, noise, and bugs.
  • Prior experience with RLHF, RLAIF, preference modeling, or reward learning for large models.
  • Experience managing or analyzing human data collection campaigns or large-scale annotation workflows.
  • Research or engineering contributions in alignment, data-centric AI, or human-AI collaboration.
  • Experience with RL training stability techniques for large runs.
  • PhD in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline with strong theoretical and empirical grounding; or, equivalent industry research experience.


Logistics

  • Location: This role is based in San Francisco, California.
  • Compensation: Depending on background, skills and experience, the expected annual salary range for this position is $350,000 - $475,000 USD.
  • Visa sponsorship: We sponsor visas. While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.
  • Benefits: Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.


As set forth in Thinking Machines' Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.


Similar Jobs

Explore other opportunities that match your interests

Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

Protech Talent

San Francisco Bay Area

Founding Machine Learning Engineer

Machine Learning
4d ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

Stealth Startup

San Francisco Bay Area
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

Goliath Partners

San Francisco Bay Area

Subscribe our newsletter

New Things Will Always Update Regularly