C

ML Engineer – AI Benchmark Evaluation

clera • Singapore
Visa Sponsorship
Apply Now

Design and implement benchmarks to evaluate frontier AI agents on domain-specific workflows. Build evaluation infrastructure, develop metrics, and validate benchmark results against real-world performance. Require 2+ years experience in research/ML engineering, Python, Docker, and Linux.

Key Highlights
Design and maintain benchmarks for evaluating frontier AI agents on domain-specific tasks
Build reliable infrastructure for running models and agents against benchmark tasks at scale
Requires 2+ years in research or ML engineering with Python, Docker, and Linux
Visa sponsorship available; on-site in Singapore
Key Responsibilities
Design, implement, and maintain benchmarks for evaluating frontier agents on domain-specific tasks
Work with subject-matter experts to translate real workflows into realistic tasks and evaluation criteria
Build reliable infrastructure for running models and agents against benchmark tasks at scale
Develop metrics and analyses to assess benchmark difficulty, reliability, and failure modes
Validate whether benchmark results correlate with real-world evaluations and user needs
Write clear documentation and reports for technical audiences
Technical Skills Required
Python Docker Linux
Benefits & Perks
Visa sponsorship
Nice to Have
Experience with reinforcement learning pipelines
Data generation experience
Agent evaluation experience

Job Description

About the Role

Join a small, technical team building benchmarks to evaluate frontier AI agents on realistic, domain-specific workflows. You will own evaluation design and implementation, helping ensure benchmark results are rigorous, credible, and relevant to real-world performance.

What You'll Do

Want the full job description? Read the complete details on Ashby, the original posting.
Continue on Ashby

This is a short excerpt. All rights to the full description belong to its original publisher.

See Jaabz jobs first on Google 1 tap · free · in AI Overviews Jaabz is on your Google Manage Preferred Sources

Visas, Work Permits & Legal Insights

Stay informed about visa types, work permits, and immigration updates for international professionals.

Browse all articles

Subscribe to our newsletter

New visa sponsorship, relocation and remote tech jobs, delivered to your inbox.