HUD is seeking a Software Engineer, Data Quality to build full-stack tools that help its Quality and Intelligence team assess and improve RL training data and evals for frontier AI agents. You will design dashboards, backend services, APIs, and data workflows to surface quality issues, and migrate proven internal tools into the production platform. Strong software engineering fundamentals across frontend, backend, and data systems, with proficiency in Python and a modern web stack such as TypeScript and React, are required.
Key Highlights
Build full-stack internal tools for task review, agent trajectory inspection, grader checks, and data quality investigation
Work closely with QNI and research engineers to turn evolving review methods into scalable workflows
YC W25 company with $16M raised, ~25-person team, offices in San Francisco and Singapore with remote options
Key Responsibilities
Build full-stack tools for reviewing tasks, inspecting agent trajectories, checking graders, and investigating data quality issues
Create dashboards and metrics that show quality trends, failure modes, and the health of review and validation workflows
Design backend services, APIs, and data workflows that connect quality checks with task creation, evaluation, and feedback to data creators
Work with QNI and research engineers to turn evolving review methods into clear, efficient workflows that scale beyond manual analysis
Move proven internal tools into production, improving their reliability, usability, and observability as adoption grows
Investigate issues in live workflows and use what you learn to improve the platform and prevent repeat failures
Benefits & Perks
Competitive compensation
100% covered top-of-the-line medical, dental, and vision insurance from Blue Shield of CA (US employees)
Lunch and dinner when in the office (in-office employees)
Company-wide holiday break (Christmas Eve to New Year's Day) on top of PTO and paid holidays
Equinox membership, 401k, and commuter benefits (US employees)
Unlimited access to tokens for ChatGPT, Claude Code, Cursor, etc.
Visa sponsorship and relocation support to the US or Singapore
Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.
Nice to Have
Built tooling for data review, annotation, evals, benchmarks, or ML workflows
Worked with agent traces, graders, reward signals, or RL training data
Designed dashboards, observability tools, or review workflows for complex datasets and pipelines
Improved a prototype or internal tool until it was ready for wider production use