School Evaluator - Fully Remote | Upto 20/hr
Other
WFA Digital Insight
The demand for skilled evaluators in the education sector has seen significant growth, with a 25% increase in remote opportunities over the past year. As AI technology advances, the need for experts who can assess and refine AI-generated content is on the rise. mercor, with its innovative approach to connecting talent with leading AI research labs, offers a unique opportunity for professionals to make a meaningful impact. With the remote work landscape evolving, candidates should be prepared to demonstrate their ability to work independently and effectively in a digital environment. Before applying, it's essential to understand the company's emphasis on domain-specific quality rubrics and the importance of clear, structured feedback.
Job Description
About the Role
The School Evaluator position at mercor represents a critical component in the development and refinement of AI-generated educational content. As a key member of the team, the evaluator will be responsible for assessing the quality and accuracy of AI-produced materials, ensuring they meet the highest standards of educational rigor and relevance. This role is pivotal in enhancing the capabilities of AI systems to generate high-quality educational artifacts that can be used across various learning environments.The day-to-day activities of a School Evaluator involve a deep dive into the world of education, where one must apply their expertise to evaluate the factual, aesthetic, and presentation aspects of documents, spreadsheets, and slide decks generated by AI. This role requires a high level of subject-matter expertise, not just in education but also in understanding the nuances of AI-generated content. The evaluator must be adept at identifying errors, whether factual, stylistic, or related to presentation, and must provide clear, actionable feedback that AI model developers can use to improve the quality and relevance of the generated content.
Given the nature of the work, which is fully remote, the evaluator must be highly self-motivated, disciplined, and able to work independently. The ability to meet deadlines without compromising the quality of feedback is crucial. mercor, with its vision to bridge the gap between human expertise and AI capabilities, offers a dynamic and supportive environment where evaluators can grow professionally while contributing to the evolution of AI in education.
What You Will Do
- Evaluate AI-generated educational artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines while ensuring high domain quality.
- Collaborate with the development team to refine AI models based on feedback.
- Stay updated with the latest developments in AI and education to continuously improve evaluation skills.
- Develop and maintain a thorough understanding of the quality standards and educational objectives that AI-generated content must meet.
- Participate in training and professional development opportunities to enhance expertise in education and AI evaluation.
What We Are Looking For
- 5+ years of relevant professional experience in Education or a related field.
- Native or professional fluency in English.
- Highly proficient in Microsoft Office and Google Workspace, especially Slides.
- Strong understanding of educational content development and assessment.
- Ability to work in a fast-paced, dynamic environment.
- Excellent analytical and problem-solving skills.
- Strong communication and interpersonal skills.
- Ability to provide clear, concise, and actionable feedback.
- Experience with AI-generated content or similar technologies is a plus.
Nice to Have
- Advanced degree (Master's or higher) from a reputable institution.
- Experience in curriculum development or educational research.
- Familiarity with AI technologies and their applications in education.
- Certification in teaching, educational assessment, or a related field.
Benefits and Perks
- Competitive compensation of $80–20/hour.
- Opportunity to work with cutting-edge AI technologies in education.
- Collaborative and dynamic remote work environment.
- Professional development opportunities to enhance skills in AI and education.
- Flexible working hours to accommodate different time zones and schedules.
- Access to the latest tools and technologies in educational content evaluation.
- Recognition and reward for outstanding performance and contributions to the team.
How to Stand Out
- Ensure your resume is tailored to highlight your experience in education and any experience you have with AI or digital content evaluation.
- Prepare examples of how you have provided structured feedback in the past, especially in educational contexts.
- Familiarize yourself with AI-generated content and the challenges of evaluating such materials to stand out in the application process.
- Be ready to demonstrate your proficiency in Microsoft Office and Google Workspace during the application or interview process.
- Consider creating a portfolio that showcases your expertise in educational content development or evaluation.
- Be prepared to discuss your understanding of domain-specific quality rubrics and how you apply them in evaluating educational content.
- Research mercor and its approach to connecting talent with AI research labs to show your interest and motivation for the role.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.
WFA Digital Insight
The demand for skilled evaluators in the education sector has seen significant growth, with a 25% increase in remote opportunities over the past year. As AI technology advances, the need for experts who can assess and refine AI-generated content is on the rise. mercor, with its innovative approach to connecting talent with leading AI research labs, offers a unique opportunity for professionals to make a meaningful impact. With the remote work landscape evolving, candidates should be prepared to demonstrate their ability to work independently and effectively in a digital environment. Before applying, it's essential to understand the company's emphasis on domain-specific quality rubrics and the importance of clear, structured feedback.
Job Description
About the Role
The School Evaluator position at mercor represents a critical component in the development and refinement of AI-generated educational content. As a key member of the team, the evaluator will be responsible for assessing the quality and accuracy of AI-produced materials, ensuring they meet the highest standards of educational rigor and relevance. This role is pivotal in enhancing the capabilities of AI systems to generate high-quality educational artifacts that can be used across various learning environments.The day-to-day activities of a School Evaluator involve a deep dive into the world of education, where one must apply their expertise to evaluate the factual, aesthetic, and presentation aspects of documents, spreadsheets, and slide decks generated by AI. This role requires a high level of subject-matter expertise, not just in education but also in understanding the nuances of AI-generated content. The evaluator must be adept at identifying errors, whether factual, stylistic, or related to presentation, and must provide clear, actionable feedback that AI model developers can use to improve the quality and relevance of the generated content.
Given the nature of the work, which is fully remote, the evaluator must be highly self-motivated, disciplined, and able to work independently. The ability to meet deadlines without compromising the quality of feedback is crucial. mercor, with its vision to bridge the gap between human expertise and AI capabilities, offers a dynamic and supportive environment where evaluators can grow professionally while contributing to the evolution of AI in education.
What You Will Do
- Evaluate AI-generated educational artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines while ensuring high domain quality.
- Collaborate with the development team to refine AI models based on feedback.
- Stay updated with the latest developments in AI and education to continuously improve evaluation skills.
- Develop and maintain a thorough understanding of the quality standards and educational objectives that AI-generated content must meet.
- Participate in training and professional development opportunities to enhance expertise in education and AI evaluation.
What We Are Looking For
- 5+ years of relevant professional experience in Education or a related field.
- Native or professional fluency in English.
- Highly proficient in Microsoft Office and Google Workspace, especially Slides.
- Strong understanding of educational content development and assessment.
- Ability to work in a fast-paced, dynamic environment.
- Excellent analytical and problem-solving skills.
- Strong communication and interpersonal skills.
- Ability to provide clear, concise, and actionable feedback.
- Experience with AI-generated content or similar technologies is a plus.
Nice to Have
- Advanced degree (Master's or higher) from a reputable institution.
- Experience in curriculum development or educational research.
- Familiarity with AI technologies and their applications in education.
- Certification in teaching, educational assessment, or a related field.
Benefits and Perks
- Competitive compensation of $80–20/hour.
- Opportunity to work with cutting-edge AI technologies in education.
- Collaborative and dynamic remote work environment.
- Professional development opportunities to enhance skills in AI and education.
- Flexible working hours to accommodate different time zones and schedules.
- Access to the latest tools and technologies in educational content evaluation.
- Recognition and reward for outstanding performance and contributions to the team.
How to Stand Out
- Ensure your resume is tailored to highlight your experience in education and any experience you have with AI or digital content evaluation.
- Prepare examples of how you have provided structured feedback in the past, especially in educational contexts.
- Familiarize yourself with AI-generated content and the challenges of evaluating such materials to stand out in the application process.
- Be ready to demonstrate your proficiency in Microsoft Office and Google Workspace during the application or interview process.
- Consider creating a portfolio that showcases your expertise in educational content development or evaluation.
- Be prepared to discuss your understanding of domain-specific quality rubrics and how you apply them in evaluating educational content.
- Research mercor and its approach to connecting talent with AI research labs to show your interest and motivation for the role.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.