T

AI Model Evaluation and Benchmarking Researcher

true-talent-solutions-partners • United States
Visa Sponsorship
Apply Now
AI Summary

Develop benchmarks and evaluation methods for assessing advanced language models. Evaluate models, build datasets and benchmarks, and scale evaluation approaches in production. Requires 3+ years of AI/ML research experience, strong Python skills, and PyTorch or TensorFlow experience.

Key Highlights
Develop benchmarks and evaluation methods for advanced language models
Evaluate newly released AI models across capabilities and use cases
Build benchmarks including dataset creation and labeler coordination
Improve automated evaluation of generated text
Scale evaluation approaches in production with engineering teams

Searching for Machine Learning & AI roles that provide visa sponsorship? Connect with international employers through Machine Learning & AI Jobs with Visa Sponsorship opportunities actively seeking talented professionals.

Key Responsibilities
Evaluate newly released AI models across a range of capabilities and use cases
Build benchmarks from the ground up, including dataset creation and coordination with labelers
Develop research findings and contribute to publications on evaluation methods
Improve automated methods for evaluating generated text
Work with engineering teams to implement and scale evaluation approaches in production systems
Collaborate with AI labs and enterprise customers to understand evaluation needs and define research initiatives
Technical Skills Required
Python PyTorch/TensorFlow Django/Flask

Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.

Benefits & Perks
Visa sponsorship

Interested in opportunities specifically in United States? Discover our dedicated Visa Sponsorship Jobs in United States page featuring roles from top employers in this location.

Nice to Have
A track record of published research, ideally in NLP or benchmarking
A master's or PhD is preferred
Experience in an AI startup, research lab, or early-stage company is helpful

Job Description

About the Role

Develop benchmarks and evaluation methods for assessing advanced language models. This research and engineering role combines hands-on AI research with building practical evaluation systems, helping shape how models are tested before deployment.

What You'll Do

Want the full job description? Read the complete details on Ashby, the original posting.
Continue on Ashby

This is a short excerpt. All rights to the full description belong to its original publisher.

Ready to apply?

Apply Now
See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources
Job Overview
Posted Nov 03, 2026
Experience Mid-Senior level
Location United States
Category Machine Learning
Company true-talent-solutions-partners
Keep exploring

Similar Jobs

Explore other opportunities that match your interests

True-Talent-Solutions-Partners

United States

AI/ML Infrastructure Engineer

Machine Learning Entry level 3h ago

  • AI
  • Machine Learning
  • Node.js
  • Oauth
Visa

Ki People

United States

AI Research Engineer

Machine Learning Full-time Entry level 8h ago

  • AI
  • Cybersecurity
  • Payroll
  • Python
Visa

Visas, Work Permits & Legal Insights

Stay informed about visa types, work permits, and immigration updates for international professionals.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.