Senior Staff Data Scientist - Consumer Experimentation

About the Role

Reddit's community-driven platform, with its vast array of topics and discussions, presents a unique environment for experimentation. The interconnected nature of the platform means that standard A/B testing assumptions often do not apply, requiring innovative approaches to data analysis and interpretation. The Senior Staff Data Scientist will serve as the technical authority on experimentation methodology, ensuring that the most complex and high-stakes experimentation challenges are addressed with rigor and precision.

The role involves close collaboration with product teams to design and analyze experiments that account for ecosystem-level effects, ensuring that true causal impact can be measured rather than biased local estimates. This collaboration is crucial for identifying opportunities where improved experimentation methodology can unlock previously unmeasurable or ambiguous product insights.

What You Will Do

• Serve as the technical authority on experimentation methodology across Consumer, setting standards for design, analysis, and interpretation of experiments in a complex, networked environment.
• Tackle the hardest experimentation problems at Reddit, including spillover and network effects, interference between treatment and control, two-sided experimentation, and long-run effect estimation.
• Develop and advance methods for causal inference in settings where standard randomization assumptions are violated, such as cluster-randomized designs, switchback experiments, and synthetic control approaches.
• Design experimentation frameworks and guardrail metrics that account for ecosystem-level effects, ensuring product teams can measure true causal impact rather than biased local estimates.
• Identify opportunities where improved experimentation methodology can unlock product insights that were previously unmeasurable or ambiguous.
• Collaborate with cross-functional teams to integrate experimentation insights into product development and strategy.
• Develop and maintain documentation of experimentation methodologies and results for knowledge sharing across the organization.
• Stay updated with the latest methodologies and technologies in data science and experimentation, applying this knowledge to continuously improve Reddit's experimentation capabilities.

What We Are Looking For

• Advanced degree in a quantitative field such as Statistics, Computer Science, or Mathematics.
• Significant experience in data science, preferably in a role focused on experimentation and causal inference.
• Expertise in experimentation design, statistical analysis, and data interpretation.
• Strong programming skills, with proficiency in languages such as Python or R.
• Experience with data visualization tools and techniques.
• Excellent communication and collaboration skills, with the ability to work effectively with both technical and non-technical stakeholders.
• Strong understanding of the complexities of network effects and interference in experimentation.
• Ability to develop and apply innovative methodologies to address complex experimentation challenges.

Nice to Have

• Experience working with large-scale datasets and distributed computing environments.
• Knowledge of machine learning algorithms and their application in experimentation.
• Familiarity with Agile development methodologies and version control systems like Git.
• Experience with cloud-based data platforms and services.

Benefits and Perks

• Competitive salary and benefits package.
• Opportunity to work on challenging and impactful projects that drive business outcomes.
• Collaborative and dynamic work environment with a team of skilled professionals.
• Flexible working hours and remote work options.
• Access to professional development opportunities and conferences.
• A culture that values innovation, creativity, and experimentation.
• Comprehensive health insurance and wellness programs.
• Generous parental leave policy and family support benefits.
• Employee stock options and equity participation.

• Understand the company's mission and values: Before applying, make sure you understand Reddit's mission and how your role as a Senior Staff Data Scientist contributes to it.
• Highlight your technical skills: Ensure your resume and cover letter clearly highlight your expertise in data science, experimentation methodology, and statistical analysis.
• Prepare examples of complex problem-solving: Be ready to discuss examples of how you've tackled complex experimentation challenges in the past, including your approach and the outcomes.
• Showcase your ability to communicate complex ideas simply: Demonstrate your ability to explain technical concepts to non-technical stakeholders, which is crucial for this role.
• Research the current state of experimentation at Reddit: Showing your understanding of the unique challenges Reddit faces in experimentation and how you can contribute to solving them will make your application stand out.
• Be prepared to discuss your experience with data visualization and communication: Highlight your skills in presenting data insights effectively to both technical and non-technical audiences.
• Consider creating a portfolio of your work: If applicable, prepare a portfolio that showcases your experience in data science and experimentation, including any published research or successful project outcomes.