Research Scientist, Learning & Cognitive Outcomes

About the Role

Day-to-day, the Research Scientist will be involved in designing rigorous studies, developing scalable evaluation methods, and interpreting findings to inform AI model and product improvements. The initial focus will be on young users and education settings, contributing to a broader research agenda on AI's impact on cognition and capability development across various populations.

The role requires a deep understanding of how people acquire, retain, transfer, and apply knowledge and skills, as well as experience in designing and executing empirical research studies. The ability to work collaboratively in ambiguous environments, making scientific tradeoffs while maintaining high standards, is crucial.

What You Will Do

• Design and manage rigorous empirical research studies, including RCTs and field experiments, to measure the impact of AI systems on learning and cognitive outcomes.
• Develop and validate evaluation systems for learning and cognitive outcomes, including classifiers, graders, benchmarks, and behavioral metrics.
• Collaborate with data scientists and engineers to prototype analyses, inspect model outputs, and reason about classifier and grader performance.
• Guide external research partners on study design, protocol quality, measurement strategy, and interpretation of results.
• Develop methods for detecting both positive and negative effects of AI use, including improved reasoning, metacognition, and durable learning.
• Translate research findings into actionable recommendations for AI model and product development.
• Work closely with internal teams to integrate research findings into product development cycles.
• Build and maintain relationships with external partners, including schools, universities, and research organizations.
• Stay updated on the latest research and developments in learning science, cognitive science, and AI evaluation methods.

What We Are Looking For

• Strong grounding in learning science, cognitive science, educational psychology, behavioral science, or a related empirical field.
• Experience in designing and executing rigorous empirical research, including RCTs, field experiments, or large-scale behavioral studies.
• Ability to design studies that measure meaningful cognitive and learning outcomes, beyond engagement or short-term performance metrics.
• Technical fluency to work directly with data, prototype analyses, and collaborate with data scientists and engineers.
• Understanding of LLM-based evaluation methods, including model-as-judge systems, rubric design, and validation.
• Experience in guiding external research partners and collaborating with cross-functional teams.
• Ability to operate independently in ambiguous environments, turning broad research goals into concrete study designs.
• Strong analytical, communication, and project management skills.

Nice to Have

• Experience working with schools, universities, or other educational institutions.
• Familiarity with AI systems, particularly LLMs, and their applications in education.
• Knowledge of statistical analysis software and programming languages such as Python or R.
• Experience with data visualization tools and techniques.
• Certification in research ethics or a related field.

Benefits and Perks

• Opportunity to work on groundbreaking AI research that impacts learning and cognition.
• Collaborative and dynamic work environment with a team of experts in AI, learning science, and cognitive science.
• Professional development opportunities, including access to conferences, workshops, and training programs.
• Flexible working hours and remote work options.
• Competitive compensation package, including benefits and equity.
• Access to cutting-edge technologies and tools.
• Recognition and reward for outstanding performance and contributions to the field.

• Ensure your resume and cover letter highlight specific experiences in empirical research, especially in areas related to learning science, cognitive science, or educational psychology.
• Familiarize yourself with Openai's work and research focus to demonstrate your enthusiasm and understanding of the company's mission.
• Prepare to discuss your approach to study design, data analysis, and collaboration with cross-functional teams during the interview process.
• Be ready to provide examples of how you've handled ambiguous or complex research questions in the past.
• Consider creating a portfolio or website showcasing your research projects, papers, or presentations to demonstrate your expertise and capabilities.
• When negotiating salary or benefits, emphasize your unique skill set and the value you can bring to the role and the company, considering the current market demand for AI and education specialists.