T

AI/ML Research Engineer, Model Evaluation and Benchmarks

true-talent-solutions-partners • United States
Visa Sponsorship
Apply Now
AI Summary

Develop benchmarks and evaluation methods for advanced language models to help AI labs and enterprises assess model capabilities before production deployment. Evaluate newly released AI models, build benchmarks from the ground up, and implement scalable automated evaluation methods in production systems. Requires at least 3 years of AI/ML research experience, published research, strong Python skills, and experience with PyTorch or TensorFlow.

Key Highlights
On-site role in San Francisco, California, United States
Base salary: $150,000 to $200,000 annually
Visa sponsorship is available
Requires at least 3 years of full-time AI/ML research experience
Published research and Python, PyTorch, or TensorFlow experience are expected

Searching for Machine Learning & AI roles that provide visa sponsorship? Connect with international employers through Machine Learning & AI Jobs with Visa Sponsorship opportunities actively seeking talented professionals.

Key Responsibilities
Evaluate newly released AI models across a range of capabilities and use cases
Build benchmarks from the ground up, including dataset development, labeler coordination, and research publication
Develop scalable and accurate methods for automatically evaluating generated text
Work with engineering teams to implement evaluation methods in production systems
Collaborate with AI labs and enterprise customers to translate evaluation needs into research initiatives
Technical Skills Required
Python PyTorch TensorFlow

Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.

Benefits & Perks
Visa sponsorship

Interested in opportunities specifically in United States? Discover our dedicated Visa Sponsorship Jobs in United States page featuring roles from top employers in this location.

Nice to Have
Master's or PhD preferred
Familiarity with Django, Flask, or similar Python HTTP frameworks

Job Description

About the Role

Join a research and engineering team developing benchmarks and evaluation methods for advanced language models. Your work will help AI labs and enterprise teams understand model capabilities and make informed decisions before deploying models in production.

What You'll Do

Want the full job description? Read the complete details on Ashby, the original posting.
Continue on Ashby

This is a short excerpt. All rights to the full description belong to its original publisher.

Ready to apply?

Apply Now
See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Nov 08, 2026
Experience Mid-Senior level
Location United States
Category Machine Learning
Company true-talent-solutions-partners
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

Visas, Work Permits & Legal Insights

Stay informed about visa types, work permits, and immigration updates for international professionals.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.