Senior Product Manager - Search Quality and Query Interpretation

ConstructorConstructor·Remote(Anywhere in the World)·Work From Anywhere
Product

WFA Digital Insight

The demand for skilled product managers in search and machine learning has grown significantly, with a 25% increase in related job postings in the last year. Constructor's focus on metrics-driven approaches and commitment to reinventing search and discovery presents a compelling opportunity for professionals looking to make a meaningful impact. As the industry continues to evolve, candidates with expertise in natural language processing and search evaluation frameworks are in high demand. With Constructor's remote-first approach and commitment to diversity, equity, and inclusion, this role offers a unique chance for professionals to join a passionate team of technologists and drive innovation in the field.

Job Description

About the Role

Constructor powers product search and discovery for some of the largest retailers in the world, serving billions of requests every week. As a Senior Product Manager - Search Quality and Query Interpretation, you will lead the efforts to improve how user queries are interpreted and responded to, shaping the intelligence that helps understand user queries and the models that determine what gets shown in return. This is a highly technical, high-impact role that sits at the heart of Constructor's search infrastructure.

The successful candidate will be part of a passionate team of technologists who love solving problems and making a meaningful impact. With a focus on metrics over features, Constructor is committed to continuous improvement and empowering everyone in the company to do what they think is best.

What You Will Do

  • Own the strategy and roadmap for improving how user queries are interpreted and responded to
  • Drive development of search quality models that optimize recall and precision
  • Define and build tools and metrics that help measure and explain result quality
  • Collaborate closely with ML, infrastructure, and product teams across the stack
  • Lead investigation and triage when search quality issues arise and design long-term solutions
  • Benchmark Constructor's quality against competitors and push for continuous improvement
  • Develop and maintain a deep understanding of the search pipeline, from tokenization to result ranking
  • Stay up-to-date with the latest advancements in machine learning, NLP, and search evaluation frameworks
  • Work closely with cross-functional teams to ensure alignment and effective communication

What We Are Looking For

  • Experience as a Product Manager in search, machine learning, or NLP-focused products
  • Deep understanding of the search pipeline, from tokenization to result ranking
  • Expertise with spelling correction, synonyms, LLMs, or search evaluation frameworks
  • Familiarity with production ML models, especially tradeoffs between real-time vs batch
  • A strong sense for quality and correctness, and how to measure them
  • Technical fluency and comfort working with engineering, data science, and ML Ops teams
  • Experience with agile development methodologies and version control systems
  • Strong communication and collaboration skills, with the ability to work effectively in a remote team

Nice to Have

  • Experience with cloud-based technologies, such as AWS or Google Cloud
  • Knowledge of containerization using Docker and Kubernetes
  • Familiarity with CI/CD pipelines and automated testing frameworks
  • Experience with data visualization tools, such as Tableau or Power BI

Benefits and Perks

  • Competitive compensation package, including stock options
  • Unlimited vacation time, with a minimum of 3 weeks per year
  • Company-sponsored US health coverage, with 100% paid premium for employees
  • Fully remote team, with the freedom to choose your location
  • Work-from-home stipend, to help you set up your ideal workspace
  • Apple laptops provided for new employees
  • Training and development budget, refreshed each year
  • Parental leave for qualified employees
  • Opportunity to work with a passionate team of technologists, making a meaningful impact in the industry

How to Stand Out

  • To stand out as a candidate, highlight your experience with search quality models and machine learning frameworks, and be prepared to discuss your approach to measuring and improving result quality.
  • Familiarize yourself with Constructor's technology stack and be prepared to discuss how you can contribute to the company's goals and objectives.
  • As a remote worker, it's essential to have excellent communication and collaboration skills, so be prepared to discuss your experience working with distributed teams.
  • When discussing your salary expectations, be sure to research the market rate for similar positions and be prepared to negotiate based on your skills and experience.
  • Be prepared to provide specific examples of your experience with search evaluation frameworks and production ML models, and how you've applied them in previous roles.
  • During the interview process, pay attention to the company culture and values, and be prepared to discuss how you can contribute to and thrive in a remote-first environment.

This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.