Senior Product Manager, Evaluation Systems (Search AI)

exa • United State

Visa Sponsorship

Apply Now

AI Summary

Lead the Evals team at Exa to define and measure 'perfect search' by overseeing high-quality evaluation datasets, vendor partnerships, and cross-functional collaboration with research, product, and engineering. Shape metrics, success criteria, and data acquisition strategies to refine search models for global impact. Requires strong negotiation, technical acumen, and ownership mindset.

Key Highlights

Oversee evaluation datasets for search models across diverse domains, ensuring quality and completeness

Negotiate and manage relationships with external vendors for data acquisition

Define metrics, success criteria, and a manifesto for 'perfect search' in collaboration with ML researchers and engineers

Searching for Product Management roles that provide visa sponsorship? Connect with international employers through Product Management Jobs with Visa Sponsorship opportunities actively seeking talented professionals.

Key Responsibilities

Partner with research, product, GTM, and engineering to ensure evaluation data quality and completeness for search models

Oversee vendor relationships and strategic decisions on data acquisition for evaluation datasets

Define metrics, success criteria, and a manifesto for what constitutes 'perfect search'

Collaborate with ML researchers, data engineers, and product teams to shape data loops improving search models

Build localized evaluation feedback and signals for comprehensive search model assessment

Technical Skills Required

Product Management Data Strategy Vendor Negotiation

Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.

Benefits & Perks

Premium healthcare benefits (medical, dental, vision)

16 weeks of fully paid parental leave for all new parents

Monthly wellness stipend

Job Description

Exa is an applied AI lab building a search engine unlike the world has ever seen. We build massive-scale infra to crawl the entire web, train state-of-the-art embedding models to process it, and design super high performant vector databases to retrieve over it. We now power search for Cursor, Cognition, HubSpot, and over 400,000 developers and have raised $350m from Lightspeed, Benchmark, and a16z.Our ultimate goal is to build perfect search over all the world's information, far beyond Google. If you want to build massive-scale ML systems that will define the way the new AI world consumes information, this is the place for you.

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.