This description is a summary of our understanding of the job description. Click on ‘Apply’ button to find out more.
Role Description
Mercor is looking for experienced evaluators to support a critical evaluation workflow in partnership with a leading AI research lab. This project focuses on improving model performance in the
Enterprise IT & Cloud
domain by evaluating agent-generated research reports that delve into the latest trends, technologies, and strategies in IT infrastructure, cloud computing, and enterprise solutions.
Qualifications
-
Strong backgrounds in
Enterprise IT
,
Cloud Computing
, or
IT infrastructure
-
Experience or knowledge in cloud technologies, IT services, or enterprise software solutions
-
Understanding of current trends in IT and cloud computing, including emerging technologies like artificial intelligence and machine learning
-
Ability to critically assess the quality and accuracy of technical research
-
Comfort providing feedback on complex technical subjects
Requirements
-
Evaluate the quality and relevance of agent-generated research reports on
Enterprise IT & Cloud
topics
-
Provide structured feedback using a provided rubric and explain your evaluation through written justifications
-
Work asynchronously and independently, ensuring evaluations are completed within the designated timeframe
-
Maintain a high level of accuracy and consistency throughout the evaluation process
Benefits
-
Part-time (20–40 hours/week) with flexible scheduling
-
100% remote and asynchronous — work from anywhere
-
Contractor position via Mercor, paid hourly
-
Competitive rates: $20–$30/hour depending on expertise
-
Weekly payments processed securely through Stripe Connect