Senior Software Engineer, AI Search Infrastructure

Build the infrastructure that makes AI search instant. Our search API handles millions of queries across 100+ languages, our models run on everything from phones to GPUs, and our stores need to be faster than thought.

About The Role

We're looking for a Senior Software Engineer to join our core engineering team. You'll be working on the foundational infrastructure that powers our AI search and embedding services, handling millions of requests daily. This role combines systems programming, distributed computing, and machine learning engineering to build products that redefine how developers interact with AI.

What you'll do

• Design and implement scalable backend services that handle millions of embedding and search requests
• Optimize our vector database for sub-millisecond query performance at scale
• Build and maintain our model serving infrastructure across multiple deployment targets
• Collaborate with ML engineers to productionize new models and algorithms
• Improve observability and reliability of our distributed systems
• Mentor junior engineers and contribute to technical architecture decisions
• Write clean, maintainable code with comprehensive test coverage
  
  

What we're looking for

• Strong experience with Python, Go, or Rust in production environments

Looking to advance your Development & Programming career with relocation support? Explore Development & Programming Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.

• Deep understanding of distributed systems and database internals
• Experience with vector databases, search engines, or ML infrastructure
• Track record of building and scaling high-performance systems
• Excellent communication skills and ability to work in a remote-first environment
• Bachelor's degree in Computer Science or equivalent practical experience
  
  

Nice to have

• Experience with ONNX, TensorRT, or other model optimization frameworks
• Contributions to open-source projects in ML or infrastructure
• Knowledge of transformer architectures and embedding models
• Experience with Kubernetes, Ray, or similar orchestration systems
• Background in information retrieval or natural language processing
  
  

What We Offer

• Competitive compensation + equity
• Comprehensive health, dental, and vision coverage
• Visa sponsorship + relocation support
• Professional development budget
• Access to the best AI tools and subscriptions
• Team off-sites + conference attendance
• Transportation support
• Wellness support, including gym membership and sports club subscriptions
• Food support
  
  

Mixedbread is an equal opportunity employer committed to building a diverse and inclusive team. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Apply for this position

Join us in building the future of search.

Autofill from resume

Upload your resume here to autofill fields.

Name *

Email *

Resume *

Click to upload or drag and drop

PDF, Word, Excel, or image file (max 10MB)

LinkedIn profile

Please provide a link to your LinkedIn profile.

GitHub profile

Please provide a link to your GitHub profile.

X profile

Please provide a link to your X profile.

What's one project or achievement you're proud of? *

What excites you about joining Mixedbread? *