AI Product Engineer - ClickStack
WFA Digital Insight
As demand for AI-powered observability solutions grows, companies like ClickHouse are at the forefront of innovation. With a 250% year-over-year growth in ARR, ClickHouse is an attractive destination for professionals seeking challenging roles. The AI Product Engineer position requires a unique blend of AI expertise, developer acumen, and production-level understanding. Candidates should be prepared to showcase their experience with agent development, skill design, and MCP servers, as well as their ability to work in an open-source environment. Before applying, consider the rapidly evolving landscape of AI-driven observability and how your skills align with ClickHouse's ambitious goals.
Job Description
About the Role
The AI Product Engineer role at ClickHouse represents a unique opportunity to build and shape the future of AI-driven observability. As a key member of the ClickStack team, you will focus on developing agentic capabilities that enable real-time incident investigation, root cause analysis, and proactive issue resolution. Your primary objective will be to design, build, and deploy AI-powered agents that can efficiently navigate complex systems, identify anomalies, and provide actionable insights to engineers.The ClickStack platform is an open-source observability solution that unifies logs, metrics, traces, and session replays to facilitate rapid incident resolution. As an AI Product Engineer, you will work closely with cross-functional teams to ensure seamless integration of AI-powered agents with the ClickStack platform. Your expertise in AI, software development, and production-level engineering will be essential in driving the success of this initiative.
What You Will Do
- Build and deploy AI-powered agents that can investigate incidents, identify root causes, and provide concise summaries to engineers.
- Design and develop reusable skills that capture the team's debugging expertise, allowing agents to pick up the right playbook instead of starting from scratch.
- Own the agent stack end-to-end, including context engineering, tool design, evaluations, tracing, and cost optimization.
- Collaborate with the ClickStack team to build MCP servers, SDKs, and integrations that enable customers' agents to read telemetry, take action, and remain observable.
- Work in the open, collaborating with OSS contributors and customers to debug problems, feed learnings back into the product, and drive continuous improvement.
- Tackle the hard parts of AI-driven observability, including latency, cost, context window limits, eval coverage, and hallucinations on real telemetry.
- Develop a deep understanding of customer needs and pain points, using this insight to inform the development of AI-powered solutions.
- Participate in the design and implementation of new features, ensuring that they align with the company's strategic objectives and customer requirements.
What We Are Looking For
- 5+ years of software engineering experience, including 1-2 years of experience with LLM-powered systems or agents in production.
- Strong backend skills in TypeScript/Node.js and/or Python, with the ability to work comfortably in both languages.
- Hands-on experience building agents, including multi-step tool use, planning, memory, and error recovery, with a proven track record of shipping and maintaining agents in production.
- Experience designing skills, such as Markdown-based workflow encodings, and a clear understanding of their application in AI-driven observability.
- Strong understanding of production-level engineering, including p99 latency, cost per task, and system reliability.
- Ability to move quickly, ship often, and learn from what breaks, with a strong focus on continuous improvement and iteration.
- Passion for developer tools and a clear sense of what good DX looks like, with the ability to advocate for and drive DX initiatives.
Nice to Have
- Experience with observability platforms, such as ClickStack, and a deep understanding of the challenges and opportunities in this space.
- Familiarity with AI-powered tools and technologies, such as natural language processing, computer vision, or machine learning.
- Participation in open-source projects, with a proven track record of collaboration and community engagement.
- Experience working in a remote environment, with a strong ability to self-manage, prioritize tasks, and maintain productivity.
Benefits and Perks
- Competitive salary and benefits package, with a focus on recognizing and rewarding outstanding performance.
- Opportunity to work with a rapidly growing, innovative company that is driving the future of AI-driven observability.
- Collaborative, dynamic work environment that fosters open communication, continuous learning, and teamwork.
- Flexible working hours, with the ability to work remotely and manage your own schedule.
- Access to cutting-edge tools and technologies, with a focus on staying at the forefront of industry trends and advancements.
- Professional development opportunities, including training, mentorship, and conference attendance.
- Recognition and rewards for outstanding performance, including bonuses, stock options, and other incentives.
How to Stand Out
- Develop a deep understanding of the ClickStack platform and its capabilities, as well as the challenges and opportunities in AI-driven observability.
- Showcase your experience with agent development, skill design, and MCP servers, highlighting your ability to work in an open-source environment.
- Be prepared to discuss your approach to production-level engineering, including p99 latency, cost per task, and system reliability.
- Demonstrate your passion for developer tools and your understanding of what good DX looks like, with specific examples from your experience.
- Highlight your ability to collaborate with cross-functional teams, work in the open, and drive continuous improvement and iteration.
- Prepare to discuss your experience with AI-powered tools and technologies, as well as your understanding of the challenges and opportunities in this space.
- Be ready to provide specific examples of your experience with observability platforms, agent development, and skill design, and explain how these skills align with the requirements of the role.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.