T

Research Engineer (RE) Curator

TransPerfect • United State
Remote
Apply
AI Summary

Build next-generation AI evaluation benchmarks and perform red teaming for cutting-edge LLMs. Design, curate, and implement complex evaluation frameworks using Python and Jupyter/Colab environments. Requires MSc/PhD in STEM, proven research engineering experience, and strong analytical problem-solving skills.

Key Highlights
Create and execute AI evaluation benchmarks for LLMs and generative AI systems
Perform red teaming and systematic testing to identify model failure modes
Requires MSc or PhD in STEM with Python proficiency and Git experience
Collaborate with AI research teams to translate concepts into actionable benchmarks
Key Responsibilities
Design, curate, and implement complex AI evaluation benchmarks and dataset frameworks to test advanced LLM capabilities and limitations
Conduct experimental research, red teaming, and systematic testing to identify model failure modes, edge cases, and reasoning gaps
Utilize Python, Jupyter/Colab environments, and modern IDEs to write scalable code, process datasets, and automate evaluation pipelines
Collaborate with AI research and engineering teams to translate complex subject-matter concepts into actionable model benchmarks
Document research findings, track codebase and dataset changes via Git, and deliver precise sourcing and evaluation reports
Technical Skills Required
Python Git Jupyter/Colab Machine Learning
Benefits & Perks
Remote work
Flexible hours

Job Description


Work Location: US, remote

Engagement Model: Freelancer / Independent Contractor

Work Schedule: Flexible hours, based on the applicant's availability

Language skills required: English

Qualification Requirements: Successful completion of a role-specific coding/research assessment and background check.

Remote, United States · Fully Remote Research Engineer (RE) Curator DataForce by TransPerfect seeks a STEM Research Engineer to build next-generation AI evaluation benchmarks, perform red teaming, and advance LLM experimentation. Apply for this job


DataForce by TransPerfect is seeking exceptional Research Engineers and AI Specialists for the role of Research Engineer (RE) Curator to drive the creation, execution, and refinement of next-generation AI evaluation benchmarks. In this high-priority role, you will leverage your deep analytical mindset, Python proficiency, and experimental research background to curate, evaluate, red team, and benchmark cutting-edge Large Language Models (LLMs) and generative AI systems, ensuring top-tier accuracy, safety, and reasoning capabilities.


Main Responsibilities

  • Design, curate, and implement complex AI evaluation benchmarks and dataset frameworks to test advanced LLM capabilities and limitations.
  • Conduct experimental research, red teaming, and systematic testing to identify model failure modes, edge cases, and reasoning gaps.
  • Utilize Python, Jupyter/Colab environments, and modern IDEs to write scalable code, process datasets, and automate evaluation pipelines.
  • Collaborate with AI research and engineering teams to translate complex subject-matter concepts into actionable model benchmarks.
  • Document research findings, track codebase and dataset changes via Git, and deliver precise sourcing and evaluation reports.


Role Requirements

  • Education: MSc or PhD in a STEM discipline (Computer Science, AI/ML, Statistics, Mathematics, Physics, Computational Sciences, or related field).
  • Experience: Proven background as a Research Engineer, Applied Scientist, ML Engineer, Research Scientist, or AI Researcher.
  • Programming & Tools: Strong hands-on Python programming skills, with daily fluency in Git, modern IDEs, and Jupyter/Colab environments.
  • AI/ML Technical Expertise: Core experience in Machine Learning, LLMs, data analysis, and structured experimental research.
  • Specialized Background (Preferred): Direct experience in AI evaluation, benchmark curation/development, red teaming, or model testing frameworks.
  • Mindset: Strong research mindset paired with exceptional analytical and problem-solving capabilities.


DataForce by TransPerfect is part of the TransPerfect family of companies, the world’s largest provider of language and technology solutions for global business, with offices in more than 100 cities worldwide. We offer high-quality data for Human-Machine Interaction to some of the most prestigious technology companies in the world. Our department focuses on gathering, enriching, and processing data for Machine Learning in different AI domains. To learn more about DataForce please visit us at https://www.transperfect.com/dataforce


For more information on the TransPerfect Family of Companies, please visit our website at www.transperfect.com


Similar Jobs

Explore other opportunities that match your interests

Regional Development Manager

Programming
•
4h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

charity search group

United State
Visa Sponsorship Relocation Remote
Job Type Internship
Experience Level Internship

marketeq talent

United State

Threat Intelligence Analyst

Programming
•
4h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Huntress

United State

Subscribe our newsletter

New Things Will Always Update Regularly