Role Description

Mercor is looking for experienced evaluators to support a critical evaluation workflow in partnership with a leading AI research lab. This project focuses on improving model performance in the

Enterprise IT & Cloud

domain by evaluating agent-generated research reports that delve into the latest trends, technologies, and strategies in IT infrastructure, cloud computing, and enterprise solutions.

Qualifications

• Strong backgrounds in
  
  Enterprise IT
  
  ,
  
  Cloud Computing
  
  , or
  
  IT infrastructure
  
• Experience or knowledge in cloud technologies, IT services, or enterprise software solutions
• Understanding of current trends in IT and cloud computing, including emerging technologies like artificial intelligence and machine learning
• Ability to critically assess the quality and accuracy of technical research
• Comfort providing feedback on complex technical subjects

Requirements

• Evaluate the quality and relevance of agent-generated research reports on
  
  Enterprise IT & Cloud
  
  topics
• Provide structured feedback using a provided rubric and explain your evaluation through written justifications
• Work asynchronously and independently, ensuring evaluations are completed within the designated timeframe
• Maintain a high level of accuracy and consistency throughout the evaluation process

Benefits

• Part-time (20–40 hours/week) with flexible scheduling
• 100% remote and asynchronous — work from anywhere
• Contractor position via Mercor, paid hourly
• Competitive rates: $20–$30/hour depending on expertise
• Weekly payments processed securely through Stripe Connect