T

Software Engineer, Frameworks & Libraries

thinking machines • United States
Visa Sponsorship Relocation
Apply Now

We're hiring a Software Engineer to turn internally built functionality into open-source core libraries for model launches, Tinker Cookbook, and community use. You will own the full stack from internal prototype to public library, designing composable typed APIs, buildng renderer/tokenizer/parser layers, and shipping release tooling. The ideal candidate has 4+ years of software engineering experience, strong Python skills including typing and CI, experience building/maintaining libraries or SDKs, and a working understanding of LLM tokenization, sampling, and post-training.

Key Highlights
Package internal functionality into open-source core libraries with clear versioning, changelogs, and release automation
Design and build typed APIs between libraries covering renderers, tokenizers, rollouts, and graders
4+ years of professional software engineering experience with strong Python and API design skills
Working understanding of LLM tokenization, sampling, and post-training
Sponsor visas; $300,000 - $400,000 USD annual salary; SF or NYC-based
Key Responsibilities
Package internal functionality into external, open-source core libraries and maintain them with clear versioning, changelogs, deprecation policies, and release automation
Support model launches by ensuring renderers, tokenizers, parsers, and tool-call handling for new models ship correctly and are ready for sampling and post-training
Design and build the layers of the stack including context compaction, session management, the rollout loop and runtime, a rollout viewer, and graders
Contribute to the Tinker Cookbook by creating reference recipes and examples for supervised and reinforcement learning
Define clean, composable, typed APIs between libraries and ensure compatibility across the Cookbook, Tinker SDK, and internal systems
Build testing, benchmarking, and correctness tooling so downstream users can trust training and sampling results
Partner with research, infrastructure, and product teams to identify internal code ready for open-sourcing and prioritize generalization
Engage with the open-source community by triaging issues, reviewing contributions, and incorporating user feedback
Technical Skills Required
Python API Design Open Source Development
Benefits & Perks
Generous health, dental, and vision benefits
Unlimited PTO
Paid parental leave
Relocation support
Nice to Have
Experience maintaining open-source libraries in the machine learning ecosystem (e.g., PyTorch, Hugging Face)
Hands-on experience with LLM post-training including supervised fine-tuning and reinforcement learning
Experience building agent or rollout infrastructure such as sandboxed runtimes, long-context management, or evaluation harnesses
Experience building developer tools for inspecting model behavior such as trace or transcript viewers
Familiarity with building graders, reward functions, or evaluation frameworks for language models
Experience with performance-sensitive code such as streaming parsers or Rust/C++ extensions exposed to Python
Record of public code, tutorials, or writing demonstrating strong opinions about developer experience and documentation

Job Description

We're hiring a Software Engineer, Frameworks & Libraries

We're hiring a Software Engineer, Frameworks & Libraries to turn the functionality we build internally into the open-source core libraries that the community builds on. You will package the code that powers our model launches and the Tinker Cookbook into well-designed, well-documented libraries, so that when we release a new model, researchers and developers can sample from it, post-train it, and evaluate it from day one.

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

BeaconFire Inc.

United States

Java Software Engineer

  • Javascript
  • Python
  • Data Structures
  • Java
Visa

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Relocation Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.