Manufacturing Specialist - Fully Remote

About the Role

The day-to-day activities of a Manufacturing Specialist at mercor will involve crafting realistic prompts that reflect professional and consumer domain-specific guidance, aimed at evaluating AI-generated responses. The role requires a deep understanding of industry standards, regulations, and the ability to critically assess the outputs of AI models. Your evaluations will form the basis of structured feedback, helping to refine AI models and ensure they meet the high standards of mercor and its clients.

Working in a contract capacity, you will be part of a dynamic team that values expertise and innovative thinking. Your professional experience and domain-specific knowledge will be invaluable in guiding the development of AI models that are both effective and ethical. Given the contract nature of the role, there is a specific commitment of 20 hours per week, which allows for a flexible yet dedicated approach to your work.

What You Will Do

• Develop and write realistic prompts to test AI-generated responses for manufacturing processes
• Evaluate AI outputs for factual accuracy, practical usefulness, and adherence to industry standards
• Identify and flag any fabricated claims, misleading reasoning, or unethical suggestions in AI-generated responses
• Score and rank AI model responses based on structured rubrics and provide detailed justifications for your evaluations
• Collaborate with the mercor team to improve AI model performance and relevance to real-world manufacturing scenarios
• Participate in discussions on the ethical implications of AI in manufacturing and contribute to the development of guidelines and standards
• Stay updated on the latest developments in AI research and manufacturing technologies to continuously improve model evaluations
• Provide feedback on the effectiveness of current evaluation processes and suggest improvements
• Engage with the broader community of AI and manufacturing professionals to share insights and learn from others

What We Are Looking For

• Professional experience in a manufacturing or closely related field, with a proven track record of applying domain expertise
• Strong understanding of industry-specific standards, regulations, and guidelines relevant to manufacturing
• Excellent written communication and critical reasoning skills, with the ability to provide detailed, evidence-based evaluations
• Experience working with AI or machine learning models, or a strong willingness to learn and adapt to new technologies
• Ability to work independently in a remote setting and collaboratively as part of a global team
• Strong analytical skills, with attention to detail and the ability to identify nuances in AI-generated responses
• Familiarity with digital tools and platforms used in remote work and collaboration
• A bachelor’s degree in a relevant field, such as manufacturing engineering, industrial engineering, or a related field

Nice to Have

• Experience in AI model evaluation or a related field, such as data science or machine learning engineering
• Certification in a relevant area, such as manufacturing management or quality control
• Knowledge of programming languages, such as Python, and experience with data analysis tools
• Participation in professional organizations or communities related to AI, manufacturing, or a related field
• A master’s degree in a relevant field, which could be advantageous for advanced roles or leadership positions

Benefits and Perks

• The opportunity to work with a cutting-edge company at the forefront of AI research and its application in manufacturing
• Flexible, fully remote work arrangement with a commitment of 20 hours per week
• Collaborative and dynamic work environment with a team of professionals who are passionate about innovation
• Professional development opportunities, including training and support for career growth
• Access to the latest tools and technologies in AI and manufacturing
• A competitive compensation package, reflective of your skills and experience
• The satisfaction of contributing to projects that have the potential to significantly impact the future of manufacturing and AI

• Ensure your resume highlights both your technical skills in manufacturing and any experience you have with digital tools or AI technologies.
• During the application process, be prepared to provide specific examples of times when you had to critically evaluate complex information and communicate your findings effectively.
• Practice your prompt-writing skills before the Model Response Evaluation assessment to feel more comfortable with the format and to improve your performance.
• In your evaluations, focus on providing detailed, evidence-based justifications for your scores and rankings, as this demonstrates your critical thinking and analytical skills.
• Consider reaching out to professionals in your network who have experience in AI or manufacturing to gain insights into the role and the industry, which can help you prepare for the application and interview process.
• Be prepared to discuss your understanding of industry standards, regulations, and the ethical implications of AI in manufacturing during the interview, as these are key areas of focus for mercor.