Education Evaluator - Domain Expert
WFA Digital Insight
The demand for skilled evaluators in the education sector has seen a significant surge, with a focus on AI-generated content. As remote work continues to dominate the job market, professionals with expertise in Education and digital skills are in high demand. mercor, a company that connects top talent with leading AI research labs, is now hiring an Education Evaluator. This role stands out for its unique blend of education expertise and digital skills, with the potential to shape the future of AI-generated educational content. Candidates should be prepared to demonstrate their subject-matter expertise and ability to work independently.
Job Description
About the Role
The Education Evaluator role at mercor involves assessing AI-generated artifacts against domain-specific quality rubrics. This position requires a deep understanding of educational concepts and the ability to identify factual, aesthetic, and presentation errors in various documents. As an Education Evaluator, you will play a critical role in improving the accuracy and rigor of AI model outputs.Day-to-day responsibilities will include evaluating documents, spreadsheets, and slide decks for quality and providing clear, structured written feedback. Your expertise will be crucial in ensuring that the AI-generated content meets the highest standards of educational quality.
Mercor is headquartered in San Francisco and has a strong investor base, including Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. As a contract worker, you will have the flexibility to work remotely and asynchronously to meet deadlines.
What You Will Do
- Evaluate AI-generated artifacts against domain-specific quality rubrics
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks
- Provide clear, structured written feedback to improve AI model outputs
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor
- Work independently and asynchronously to meet deadlines while ensuring high domain quality
- Develop a deep understanding of AI-generated content and its applications in education
- Collaborate with the mercor team to improve the overall quality of AI-generated artifacts
- Stay up-to-date with the latest developments in AI and education
- Provide input on the development of quality rubrics and evaluation criteria
What We Are Looking For
- 5+ years of relevant professional experience in Education
- Native or professional fluency in English
- Highly proficient in Microsoft Office and Google Workspace, especially Slides
- Ability to work independently and asynchronously
- Strong analytical and problem-solving skills
- Excellent written and verbal communication skills
- Ability to provide clear, structured feedback
- Strong attention to detail and ability to identify errors
Nice to Have
- Advanced degree (Master's or higher) from a reputable institution
- Experience working with AI-generated content
- Familiarity with digital education platforms
- Experience in curriculum development or educational research
Benefits and Perks
- Competitive hourly compensation
- Opportunity to work with a leading AI research lab
- Flexible, remote work arrangements
- Collaborative and dynamic work environment
- Access to cutting-edge technology and tools
- Professional development opportunities
- Recognition and reward for outstanding performance
How to Stand Out
- Make sure to highlight your experience in education and digital skills in your resume and cover letter.
- Be prepared to provide examples of your evaluation and feedback skills during the interview process.
- Familiarize yourself with AI-generated content and its applications in education to stand out as a candidate.
- Develop a portfolio that showcases your ability to provide clear, structured feedback and evaluate complex educational content.
- Research mercor and its mission to demonstrate your passion for the company and the role.
- Prepare to discuss your experience working independently and asynchronously, and how you stay motivated and organized in a remote work environment.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.