Architecture Expert - AI Model Evaluator

Mercor • United State
Remote
Apply
AI Summary

Mercor is seeking an Architecture Expert to evaluate AI models on visual document understanding. The role involves authoring complex tasks, reviewing AI-generated content, and collaborating with subject matter experts. The ideal candidate has expertise in the Architecture domain and experience in authoring complex tasks with objective rubrics.

Key Highlights
Evaluate AI models on visual document understanding
Author complex tasks with clear ground-truth outputs
Collaborate with subject matter experts
Key Responsibilities
Evaluate AI models on visual document understanding in the Architecture domain
Author complex, grounded tasks with clear ground-truth outputs and objective rubrics
Review and improve the accuracy of AI-generated content to ensure alignment with domain principles
Collaborate with subject matter experts to enhance dataset consistency and coverage
Work independently and asynchronously to meet deadlines and improve AI model performance
Technical Skills Required
Architecture AI model evaluation Task authoring
Benefits & Perks
Remote work
Flexible schedule
Competitive hourly rate

Job Description


About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Architecture Expert

Type: Contract

Compensation: $50/hour

Location: Remote

Commitment: 15–20 hours/week

Role Responsibilities

  • Evaluate AI models on visual document understanding in the Architecture domain.
  • Author complex, grounded tasks with clear ground-truth outputs and objective rubrics.
  • Review and improve the accuracy of AI-generated content to ensure alignment with domain principles.
  • Collaborate with subject matter experts to enhance dataset consistency and coverage.
  • Work independently and asynchronously to meet deadlines and improve AI model performance.


Qualifications

Must-Have

  • Expertise in the Architecture domain.
  • Experience in authoring complex tasks with objective rubrics.


Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form


Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: [email protected]


PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Similar Jobs

Explore other opportunities that match your interests

Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

ondo finance

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

Jobgether

United State

Director of People

Hr
•
5h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

gridunity

United State

Subscribe our newsletter

New Things Will Always Update Regularly