AI Summary
Evaluate AI model outputs using JSON and grading rubrics. Work independently with a 12-24 hour turnaround. Remote, contract role starting July 25.
Key Highlights
Evaluate model outputs against grading rubrics
Parse and understand JSON-based outputs
Maintain grading standards and attention to detail
Work independently with quick turnaround times
Key Responsibilities
Evaluate model outputs against defined grading rubrics
Parse, read, and understand JSON-based outputs for grading purposes
Review task descriptions and rubrics to maintain grading standards
Work independently and complete tasks within 12–24 hours
Ensure attention to detail and consistency in applying rubric criteria
Technical Skills Required
Benefits & Perks
$50–$175/hour
Remote work
Job Description
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: JSON-fluent & Rubrics Expert
Type: Contract
Compensation: $50–$175/hour
Location: Remote
Role Responsibilities
- Evaluate model outputs against defined grading rubrics to ensure accuracy and consistency.
- Parse, read, and understand JSON-based outputs for grading purposes.
- Review task descriptions and rubrics to maintain grading standards.
- Work independently and complete tasks within 12–24 hours.
- Ensure attention to detail and consistency in applying rubric criteria.
Interested in remote work opportunities in Human Resource? Discover Human Resource Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
Must-Have
- Available to start this weekend (Sat, July 25).
- Comfortable reading and interpreting JSON files.
- Based in the US.
- Prior experience with Mercor and applying detailed rubrics.
- Saturday, July 25; applications reviewed on a rolling basis.
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
- Upload resume
- AI interview based on your resume
- Submit form
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
- For any help or support, reach out to: [email protected]
,
Similar Jobs
Explore other opportunities that match your interests
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Not Applicable
Jobgether
United State
Visa Sponsorship
Relocation
Remote
Job Type
Contract
Experience Level
Executive
Integrated Resources, Inc ( IR...
United State
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Associate
Harbor
United State