T

Software Engineer, Inference

thinking machines lab • United State
Visa Sponsorship Relocation
Apply Now

The Software Engineer, Inference will ensure the reliability, scale, and efficiency of production systems serving AI models. This role involves operating and scaling inference systems, managing model rollouts, and leading incident response. Candidates should have experience with large-scale production systems and proficiency in Python and Go.

Key Highlights
Focus on production-facing systems for AI model serving.
Responsible for incident response and production issue resolution.
Collaboration with research teams to enhance serving techniques.
Key Responsibilities
Operate and scale the production inference systems that serve live traffic.
Own the rollout process for new models, model versions, and inference optimizations.
Build and improve observability, alerting, and capacity planning.
Partner with inference and research teams to productionize new serving techniques.
Lead incident response for production inference issues.
Design for graceful degradation, failover, and redundancy.
Manage capacity and cost tradeoffs for serving infrastructure.
Technical Skills Required
Python Go Distributed Systems
Benefits & Perks
Generous health, dental, and vision benefits
Unlimited PTO
Paid parental leave
Nice to Have
Experience running production inference for large language models
Experience with deployment and rollout systems
Familiarity with inference-specific techniques

Job Description

About Thinking Machines

The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.

About the Role

Want the full job description? Read the complete details on LinkedIn, the original posting.
Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources

Similar Jobs

Explore other opportunities that match your interests

Principal Software Engineer

Programming
•
21m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Collins Aerospace

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

Veho

United State

Senior Software Engineer, Billing Platform Infrastructure

Programming
•
1h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

anthropic

United State

Subscribe our newsletter

New Things Will Always Update Regularly