L

Staff Engineer

litellm • United States
Visa Sponsorship Relocation
Apply Now

Hands-on Staff Engineer role owning the stability and reliability of LiteLLM's AI Gateway, fixing regressions and security issues through refactors and code quality improvements. Responsible for leading migrations, building trustworthy test suites, keeping CI fast, and raising quality across the team through direct code contributions and reviews. Requires 3+ years of experience owning mission-critical production systems, strong software engineering fundamentals in Python, and ability to find root causes in unfamiliar codebases.

Key Highlights
Own stability and reliability of LiteLLM's AI Gateway for thousands of production companies
Lead refactors, rebuild test suites, and improve CI/trusted releases
Work hands-on with Python and Rust on mission-critical infrastructure
Report to CEO then Head of Engineering; in-person in San Francisco
Relocation assistance and H-1B transfer support provided
Key Responsibilities
Find root causes of regressions and security issues and fix the patterns that create them
Lead refactors, rewrites, and migrations of core product code on mission-critical systems
Build and maintain a trustworthy test suite
Keep CI and releases fast and trustworthy with a large open source contributor base
Review critical code paths and raise quality through code contributions and reviews
Raise quality across the team without becoming the bottleneck
Technical Skills Required
Python PostgreSQL Redis
Benefits & Perks
Health insurance
Dental insurance
Vision insurance
Equity
Relocation assistance
Nice to Have
Rust experience
Experience keeping CI healthy on an open source project with heavy outside contribution
Experience at an early-stage startup

Job Description

Job Details

Full-time

$250,000 - $350,000 a year

Benefits: Relocation assistance, Dental insurance, Vision insurance

Qualifications

  • Regression testing implementation
  • Software engineering
  • Rust (programming language)
  • Security analysis
  • Defect resolution root cause analysis
  • Startup experience
  • Software coding
  • Defect analysis
  • Improving system uptime or availability
  • Mid-level
  • 3 years
  • IT infrastructure
  • Production systems
  • PostgreSQL
  • SRE
  • Redis
  • Open source contribution
  • Root cause analysis
  • Continuous improvement for developers
  • Python
  • Providing code feedback

Full Job Description

Want the full job description? Read the complete details on simplyhired.com, the original posting.
Continue on simplyhired.com

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Hidden company

Log in to see location

Premium

Senior MLOps Engineer

Log in free to see the details

Deloitte

United States

Azure Cloud Engineer

  • Bicep
  • Cloud
  • Devops
  • Infrastructure As Code
Visa

Hidden company

Log in to see location

Premium

Applied Researcher 4 - AI Foundations

Log in free to see the details

Career Resources & Guides

Latest guides related to this job: Visas, Work Permits & Legal Insights, Relocation Guides.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.