Research Engineer - RL Training Data & Evaluation Infrastructure

hud • United States

Visa Sponsorship Relocation

This Job is No Longer Active This position is no longer accepting applications

AI Summary

Build technical infrastructure for creating, evaluating, and improving RL training environments for frontier AI agents. Design experiments, develop tools, and partner with vendors to enhance data quality and task design. Requires Python proficiency, strong attention to detail, and experience in benchmarks/evals.

Key Highlights

Build systems for creating, running, evaluating, and improving agent training environments

Develop tools to improve data quality and translate real-world workflows into RL tasks

Work across full lifecycle of agent training data from task design to validation

Looking to advance your Development & Programming career with relocation support? Explore Development & Programming Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.

Key Responsibilities

Build systems for creating, running, evaluating, and improving agent training environments

Design experiments to understand model behavior, agent failure modes, and data quality issues

Develop tools that help researchers, engineers, and data vendors create higher-quality tasks, trajectories, and feedback loops

Partner with external vendors to identify bottlenecks and improve the quality and throughput of HUD's data engine

Build metrics and analyses that help us understand whether our tasks, environments, and evals are actually useful for training frontier agents

Technical Skills Required

Python Docker Linux

Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.

Benefits & Perks

Competitive compensation based on experience and location

100% covered top-of-the-line medical, dental, and vision from Blue Shield of CA

Unlimited access to tokens for ChatGPT, Claude Code, Cursor, etc.

Interested in relocating to United State? Check out our comprehensive Relocation Jobs in United State page with detailed relocation packages and benefits.

Nice to Have

Experience building internal tools, research infrastructure, or data pipelines

Experience designing metrics and validation workflows

Background in competitive programming, Olympiad medaling, research, or unusually strong independent project experience

Strong communication skills for remote collaboration across time zones

Job Description

HUD is building infrastructure to create RL training data and evals for frontier AI agents, as well as a marketplace to sell these to frontier labs through the HUD marketplace. Our platform is used by frontier labs, Fortune 500 companies, and startups. We’ve raised $16M from top VCs and were YC W25.We're looking for Research Engineers to build the technical foundation for training and evaluating frontier AI agents. You’ll build the systems for creating new environments, improve data quality, and translate real-world workflows into tasks and benchmarks.

Want the full job description? Read the complete details on LinkedIn, the original posting.

Continue on LinkedIn

This is a short excerpt. All rights to the full description belong to its original publisher.