T

Senior Data Scientist / Research Engineer (AI Model Evaluation & Data Pipelines)

true-talent-solutions-partners • United States
Visa Sponsorship
Apply Now
AI Summary

Join a Series A AI company building datasets and evaluation systems for frontier models. Design experiments, identify model failure modes, and create data/evaluation frameworks for RLHF/RLVR pipelines. Requires 1-4 years of software engineering experience in data pipelines, LLM evaluations, and ML infrastructure.

Key Highlights
1-4 years of software engineering experience in data pipelines, ML infrastructure, or evaluation systems
Strong Python skills and hands-on experience with LLM evaluations, RLHF, RLVR, and reward modeling
Focus on designing experiments, measuring dataset quality, and improving model capabilities

Searching for Machine Learning & AI roles that provide visa sponsorship? Connect with international employers through Machine Learning & AI Jobs with Visa Sponsorship opportunities actively seeking talented professionals.

Key Responsibilities
Design data slices and identify model failure modes across finance, software development, and enterprise workflows
Build and refine evaluation rubrics and reward signals for RLHF and RLVR pipelines
Develop quantitative frameworks to measure dataset quality, diversity, and downstream effects on model alignment and capability
Create and manage real-world and synthetic data pipelines
Partner with research teams to translate training objectives into data and evaluation specifications
Technical Skills Required
Python Machine Learning Data Pipelines

Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.

Benefits & Perks
Base salary: $260,000 to $290,000 annually
Visa sponsorship available

Interested in opportunities specifically in United States? Discover our dedicated Visa Sponsorship Jobs in United States page featuring roles from top employers in this location.

Nice to Have
Experience in AI safety, benchmarking, or research engineering
Experience with model post-training and reward modeling

Job Description

About the Role

Join a Series A AI training data company building datasets and evaluation systems for frontier models. You will work with research teams to design experiments, identify model failure modes, and create data and metrics that inform model training.

What You'll Do

Design data slices across finance, software development, and enterprise workflows to reveal meaningful model failure modes.

Build and refine evaluation rubrics and reward signals for RLHF and RLVR pipelines.

Model annotator behavior and run experiments to improve model capabilities.

Develop quantitative frameworks to measure dataset quality, diversity, and downstream effects on model alignment and capability.

Want the full job description? Read the complete details on Ashby, the original posting.
Continue on Ashby

This is a short excerpt. All rights to the full description belong to its original publisher.

Ready to apply?

Apply Now
See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Nov 15, 2026
Employment Full-time
Experience Mid-Senior level
Location United States
Category Machine Learning
Company true-talent-solutions-partners
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Visas, Work Permits & Legal Insights

Stay informed about visa types, work permits, and immigration updates for international professionals.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.