Research Scientist

Jobgether • Brazil

Remote

This Job is No Longer Active This position is no longer accepting applications

AI Summary

Join a cutting-edge AI research environment to help define how frontier language models are evaluated and benchmarked. Design and develop original evaluation methodologies, develop high-quality benchmarks, and collaborate with subject matter experts. Ideal for a researcher who enjoys solving complex methodological challenges and contributing to the advancement of trustworthy AI evaluation.

Key Highlights

Design and develop original evaluation methodologies

Develop high-quality benchmarks and collaborate with subject matter experts

Contribute to the advancement of trustworthy AI evaluation

Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

Key Responsibilities

Design and develop original evaluation methodologies that accurately measure the capabilities of frontier AI models

Create comprehensive benchmark packages supported by expert-verified ground truth, rigorous quality control processes, deterministic verification methods, and well-calibrated scoring rubrics

Recruit, assess, and coordinate subject matter experts to develop, validate, and review high-quality evaluation datasets and benchmark content

Technical Skills Required

Machine learning evaluation Benchmarking AI assessment methodologies

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Benefits & Perks

Fully remote contract position

Opportunity to work on frontier AI research and evaluation projects with global impact

High level of ownership and influence over research methodology and benchmark design

Job Description

Join a cutting-edge AI research environment where you will help define how frontier language models are evaluated and benchmarked. In this highly technical role, you will design rigorous evaluation methodologies, develop high-quality benchmarks, and collaborate with subject matter experts to assess advanced capabilities across reasoning, coding, multimodal systems, and agentic AI. You will play a key role in ensuring evaluation frameworks are scientifically robust, reproducible, and aligned with the evolving needs of leading AI research organizations. This opportunity is ideal for a researcher who enjoys solving complex methodological challenges and contributing to the advancement of trustworthy AI evaluation.

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.