L

Staff Engineer - Unified API

litellm • United States
Visa Sponsorship Relocation
Apply Now

Staff Engineer to lead the unified API team at LiteLLM, ensuring every new LLM model and provider works on day one. Own end-to-end provider rollouts, triage open source issues, review PRs, and set the technical bar for the team. Requires 3+ years experience, deep LLM API expertise, strong Python fundamentals, and readiness to lead from day one.

Key Highlights
Lead the unified API team owning end-to-end model and provider rollouts
Triage open source issues, review PRs, and maintain high code quality standards
Report to the CEO; in-person role in San Francisco with relocation and H-1B support
$250K-$350K salary with equity, health, dental, and vision benefits
Key Responsibilities
Lead the unified API team and own new model, endpoint, and provider rollouts end to end
Design provider-agnostic features at the gateway level
Triage open source issues and outside PRs and get them merged, reviewed, or replaced
Review the AI team's PRs and hold a high bar for code quality
Find power users and use their needs to decide what to build next
Take on new unification bets with a customer who will use them and give feedback
Own the developer experience for everyone who uses LiteLLM's Python SDK and proxy
Technical Skills Required
Python Machine Learning LLM APIs
Benefits & Perks
Relocation assistance
Dental insurance
Vision insurance
Health insurance
Equity
Nice to Have
Experience at a company built on a unified API
Built your own unified API or written about what a good one should do
Built evals for LLMs
Used LiteLLM in production
Open source contributions, especially to LLM tooling

Job Description

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We've grown ARR 6x in the last year to nearly $30M with a team of 20, and developers use LiteLLM to call 100+ LLM providers through one API.

We're looking for a Staff Engineer to lead our unified API team and make sure every new model and provider works with LiteLLM on day one.

About the role

This is a hands-on technical lead role. You'll own how LiteLLM unifies LLM APIs across the OpenAI and Anthropic specs, lead the engineers who build it, and set the bar for what good looks like.

Want the full job description? Read the complete details on simplyhired.com, the original posting.
Continue on simplyhired.com

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Hidden company

Log in to see location

Premium

Staff Embedded Software Engineer / IPT Lead

Log in free to see the details

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Relocation Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.