Data Evaluator - Fully Remote | Upto 20/hr
Other
WFA Digital Insight
The demand for experts who can evaluate and improve AI-generated content is skyrocketing, with the global AI market expected to reach
90 billion by 2027. As remote work continues to gain momentum, roles like Data Evaluator at mercor offer a unique blend of flexibility and challenge. With the rise of AI research labs, candidates with deep subject-matter expertise and proficiency in digital tools are in high demand. Before applying, candidates should be aware of the importance of independent work, structured feedback, and the ability to meet deadlines in a fully remote setup.
Job Description
About the Role
The Data Evaluator position at mercor is a critical role that involves evaluating AI-generated artifacts against specific quality rubrics. This role is part of mercor's effort to connect elite creative and technical talent with leading AI research labs, ensuring that the outputs from these labs meet the highest standards of quality and accuracy. As a Data Evaluator, you will be working independently in a remote setup, utilizing your expertise to identify errors in AI-generated documents, spreadsheets, and slide decks, and providing clear, structured feedback to improve these outputs.Day-to-day, you will be assessing the factual, aesthetic, and presentation aspects of various AI-generated artifacts, applying your deep subject-matter expertise to grade these outputs for accuracy and rigor. Your work will directly contribute to the refinement of AI models, making them more reliable and efficient. Given the nature of the role, the ability to work asynchronously and meet deadlines is crucial.
What You Will Do
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines.
- Utilize Microsoft Office and Google Workspace, especially Slides, for evaluating and creating feedback on AI-generated content.
- Collaborate with the mercor team to refine the evaluation process and contribute to the improvement of AI models.
- Develop and maintain expertise in specific domains to accurately evaluate AI-generated content.
- Participate in regular feedback sessions to ensure consistency and quality in evaluations.
What We Are Looking For
- 5+ years of relevant professional experience in Software / AI / IT / data.
- Native or professional fluency in English.
- Highly proficient in Microsoft Office and Google Workspace, especially Slides.
- Ability to work independently in a remote setting and meet deadlines.
- Strong analytical and problem-solving skills to identify and report errors accurately.
- Excellent written communication skills to provide structured feedback.
- Deep subject-matter expertise in specific domains relevant to AI-generated content.
Nice to Have
- Advanced degree (Master's or higher) from a reputable institution.
- Experience with AI-generated content evaluation or similar roles.
- Familiarity with AI research labs and their operations.
- Certification in data analysis or a related field.
Benefits and Perks
- Competitive compensation ranging from $80 to 20 per hour.
- The opportunity to work with leading AI research labs and contribute to the development of AI technology.
- Flexible, fully remote work arrangement.
- Access to a collaborative and elite community of professionals in the AI and tech industry.
- Opportunities for professional growth and development in the field of AI and data evaluation.
- Support for continuous learning and skill development relevant to the role.
How to Stand Out
- Ensure you have a strong understanding of AI-generated content and the challenges associated with its evaluation.
- Highlight your experience with remote work and asynchronous collaboration in your application.
- Showcase examples of your structured feedback and error identification skills in your portfolio or application.
- Prepare to discuss your subject-matter expertise and how it applies to evaluating AI-generated artifacts.
- Be ready to demonstrate your proficiency in Microsoft Office and Google Workspace, especially Slides, during the application process.
- Consider reaching out to the mercor support team for any questions or clarifications about the role or application process.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.
Other
WFA Digital Insight
The demand for experts who can evaluate and improve AI-generated content is skyrocketing, with the global AI market expected to reach
90 billion by 2027. As remote work continues to gain momentum, roles like Data Evaluator at mercor offer a unique blend of flexibility and challenge. With the rise of AI research labs, candidates with deep subject-matter expertise and proficiency in digital tools are in high demand. Before applying, candidates should be aware of the importance of independent work, structured feedback, and the ability to meet deadlines in a fully remote setup.
Job Description
About the Role
The Data Evaluator position at mercor is a critical role that involves evaluating AI-generated artifacts against specific quality rubrics. This role is part of mercor's effort to connect elite creative and technical talent with leading AI research labs, ensuring that the outputs from these labs meet the highest standards of quality and accuracy. As a Data Evaluator, you will be working independently in a remote setup, utilizing your expertise to identify errors in AI-generated documents, spreadsheets, and slide decks, and providing clear, structured feedback to improve these outputs.Day-to-day, you will be assessing the factual, aesthetic, and presentation aspects of various AI-generated artifacts, applying your deep subject-matter expertise to grade these outputs for accuracy and rigor. Your work will directly contribute to the refinement of AI models, making them more reliable and efficient. Given the nature of the role, the ability to work asynchronously and meet deadlines is crucial.
What You Will Do
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines.
- Utilize Microsoft Office and Google Workspace, especially Slides, for evaluating and creating feedback on AI-generated content.
- Collaborate with the mercor team to refine the evaluation process and contribute to the improvement of AI models.
- Develop and maintain expertise in specific domains to accurately evaluate AI-generated content.
- Participate in regular feedback sessions to ensure consistency and quality in evaluations.
What We Are Looking For
- 5+ years of relevant professional experience in Software / AI / IT / data.
- Native or professional fluency in English.
- Highly proficient in Microsoft Office and Google Workspace, especially Slides.
- Ability to work independently in a remote setting and meet deadlines.
- Strong analytical and problem-solving skills to identify and report errors accurately.
- Excellent written communication skills to provide structured feedback.
- Deep subject-matter expertise in specific domains relevant to AI-generated content.
Nice to Have
- Advanced degree (Master's or higher) from a reputable institution.
- Experience with AI-generated content evaluation or similar roles.
- Familiarity with AI research labs and their operations.
- Certification in data analysis or a related field.
Benefits and Perks
- Competitive compensation ranging from $80 to 20 per hour.
- The opportunity to work with leading AI research labs and contribute to the development of AI technology.
- Flexible, fully remote work arrangement.
- Access to a collaborative and elite community of professionals in the AI and tech industry.
- Opportunities for professional growth and development in the field of AI and data evaluation.
- Support for continuous learning and skill development relevant to the role.
How to Stand Out
- Ensure you have a strong understanding of AI-generated content and the challenges associated with its evaluation.
- Highlight your experience with remote work and asynchronous collaboration in your application.
- Showcase examples of your structured feedback and error identification skills in your portfolio or application.
- Prepare to discuss your subject-matter expertise and how it applies to evaluating AI-generated artifacts.
- Be ready to demonstrate your proficiency in Microsoft Office and Google Workspace, especially Slides, during the application process.
- Consider reaching out to the mercor support team for any questions or clarifications about the role or application process.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.