T

Senior Data Scientist for AI Model Evaluation and Data Collection

true-talent-solutions-partners • United States
Visa Sponsorship
Apply Now
AI Summary

Build datasets, evaluation rubrics, and reward signals to improve large language models. Design data slices to identify model failure modes across domains like finance, software, and enterprise workflows. Requires 1-4 years of experience in ML data collection and evaluation strategies.

Key Highlights
Design data slices to identify model failure modes in finance, software, and enterprise workflows
Develop evaluation rubrics and reward signals for RLHF and RLVR pipelines
1-4 years of experience in ML data collection and evaluation strategies required

Searching for Data Science roles that provide visa sponsorship? Connect with international employers through Data Science Jobs with Visa Sponsorship opportunities actively seeking talented professionals.

Key Responsibilities
Design data slices to reveal model failure modes across domains
Build and refine evaluation rubrics and reward signals for RLHF and RLVR pipelines
Develop quantitative methods to measure dataset quality, diversity, and downstream impact
Create and manage real-world and synthetic data pipelines
Work with research teams to translate training objectives into data and evaluation specifications

Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.

Technical Skills Required
Machine Learning Data Collection Strategies Evaluation Rubrics

Interested in opportunities specifically in United States? Discover our dedicated Visa Sponsorship Jobs in United States page featuring roles from top employers in this location.

Benefits & Perks
Base salary of $260,000 to $290,000 annually
Visa sponsorship available

Job Description

About the Role

Build datasets, evaluation rubrics, and reward signals that help improve large language models. You will work with AI research teams to test data-collection approaches, investigate model failure modes, and develop measurements that inform training runs.

What You'll Do

Design data slices that reveal meaningful model failure modes across areas such as finance, software, and enterprise workflows.

Build and refine evaluation rubrics and reward signals for RLHF and RLVR pipelines.

Model annotator behavior and run experiments to improve model capabilities.

Develop quantitative methods to measure dataset quality, diversity, and downstream impact.

Want the full job description? Read the complete details on Ashby, the original posting.
Continue on Ashby

This is a short excerpt. All rights to the full description belong to its original publisher.

Ready to apply?

Apply Now
See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Nov 04, 2026
Employment Full-time
Experience Mid-Senior level
Location United States
Category Data Science
Company true-talent-solutions-partners
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Hidden company

Log in to see location

Premium

Founding Data Scientist, Finance Forecasting

Data Science Full-time 13h ago

Log in free to see the details

Visas, Work Permits & Legal Insights

Stay informed about visa types, work permits, and immigration updates for international professionals.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.