Clicky

See all jobs
Mercor
Rubric Grading Expert
Posted 12 months ago

This description is a summary of our understanding of the job description. Click on ‘Apply’ button to find out more.

Role Description

Mercor is seeking highly analytical generalists to contribute as rubric graders for a leading AI research initiative. This project supports the evaluation of AI-generated content across multiple domains, ensuring accuracy, coherence, and alignment with task-specific criteria. Contractors will apply structured rubrics to assess outputs in fields such as humanities, STEM, business, and general knowledge. This is a flexible, short-term engagement ideal for intellectually curious professionals with a strong academic background.

  • Apply detailed evaluation rubrics to assess AI-generated responses
  • Analyze outputs for factual correctness, clarity, and domain relevance
  • Work across diverse subject areas and adapt to evolving task requirements
  • Maintain high accuracy while completing a high volume of evaluations
  • Follow written instructions precisely and provide concise feedback when needed

Qualifications

  • Strong analytical and critical thinking skills
  • Exceptional attention to detail and reading comprehension
  • Proven ability to follow structured guidelines without deviation
  • Comfortable working independently and across unfamiliar subject areas
  • Master’s degree or higher, or undergraduate degree from a top global university

Requirements

  • Remote and asynchronous — set your own schedule
  • Expected commitment: ~40 hours/week
  • Short-term project with potential for extension or future engagements
  • Contractors must have access to a reliable internet connection

Benefits

  • , depending on experience and location
  • Independent contractor status
  • Weekly payments via Stripe Connect

Application Process

  • Submit your resume to get started
  • Complete an AI interview and complete a Google Form
  • Mercor will follow up with next steps within the next 24 hours
About The Company

Mercor

Status

Accepting Applications

Apply

Similar jobs

New
TELUS Digital is at the forefront of creating and enhancing the world's data to enable better AI via human intelligence. By providing enriched data through a skilled team of AI specialists and a managed AI Community of over one million crowd contributors, we empower generative AI (GenAI), computer vision, and natural language processing models. Utilizing proprietary AI-assisted, quality-optimized technology, we ensure efficient data collection, accurate labeling, and precise fine-tuning. Our solutions improve AI systems in multiple applications, such as advanced smart products, improved search results, expanded speech recognition, more human-like bot interactions, and more.
Online Data Analyst (United States/Spanish speakers)
TELUS Digital is at the forefront of creating and enhancing the world's data to enable better AI via human intelligence. By providing enriched data through a skilled team of AI specialists and a managed AI Community of over one million crowd contributors, we empower generative AI (GenAI), computer vision, and natural language processing models. Utilizing proprietary AI-assisted, quality-optimized technology, we ensure efficient data collection, accurate labeling, and precise fine-tuning. Our solutions improve AI systems in multiple applications, such as advanced smart products, improved search results, expanded speech recognition, more human-like bot interactions, and more.
Remote Latam's
New
Nacre Capital
Performance Marketing Manager
Nacre Capital
Remote Latam's
New
Ethos Life
Staff Product Designer
Ethos Life
Remote Latam's