Senior Software Engineer - Python and Data Ecosystem

About the Role

The role requires a deep understanding of the data practitioner's world, which is rapidly shifting towards databases becoming active participants in AI-powered workflows. You will need to bring product-level insight into what tools and integrations should be built and why, based on your firsthand experience as a data engineer or data scientist.

What You Will Do

• Own and evolve ClickHouse's Python connector and SDK ecosystem, focusing on performance, reliability, and API design.
• Build and maintain integrations with orchestration platforms such as Apache Airflow, Dagster, and Prefect.
• Develop connectors for transformation tools like dbt and SQLMesh.
• Collaborate on integrations with AI and LLM ecosystems, including tools like LangChain, LlamaIndex, and n8n.
• Drive the architecture, performance, and feature direction of key Python integrations across various platforms.
• Ensure that ClickHouse's columnar architecture and query performance are leveraged to their full potential in the integrations you develop.
• Work closely with the open-source community, internal teams, and enterprise users to ensure that ClickHouse integrations meet the highest standards.
• Participate in the design and implementation of new features and tools that enable data engineers and data scientists to harness ClickHouse's capabilities.
• Contribute to the development of best practices and documentation for using ClickHouse with various data ecosystems.
• Collaborate with cross-functional teams to identify and prioritize integration needs.
• Stay up-to-date with the latest developments in the data ecosystem and AI workloads, applying this knowledge to improve ClickHouse's offerings.

What We Are Looking For

• Proven experience as a software engineer with a focus on Python and data ecosystems.
• Deep understanding of data engineering and data science workflows, including experience with real-time analytics, observability, and AI-powered data applications.
• Experience with orchestration platforms, transformation tools, and AI/LLM ecosystems.
• Strong skills in Python development, with the ability to craft high-quality, production-ready code.
• Experience with building and maintaining large-scale data integrations.
• Strong understanding of database architectures, including columnar databases like ClickHouse.
• Experience with collaborative development, including working with open-source communities and internal teams.
• Strong problem-solving skills, with the ability to debug complex issues in distributed systems.
• Excellent communication skills, with the ability to work closely with cross-functional teams and external stakeholders.

Nice to Have

• Experience with cloud-based data platforms and technologies.
• Knowledge of containerization technologies like Docker.
• Familiarity with agile development methodologies.
• Experience with CI/CD pipelines and automated testing frameworks.
• Certification in data engineering, data science, or a related field.

Benefits and Perks

• Competitive compensation package.
• Opportunity to work with a cutting-edge, fast-growing company in the data analytics space.
• Collaborative, dynamic work environment with a team of experienced professionals.
• Flexible, remote work arrangement with opportunities for professional growth and development.
• Access to the latest technologies and tools in the data ecosystem.
• Comprehensive health insurance and retirement plans.
• Generous paid time off and holiday package.
• Professional development stipend for continuing education and certifications.
• Annual budget for attending industry conferences and workshops.

• Tip: Showcase your experience with Python and data ecosystems by providing specific examples of projects you've led or contributed to, highlighting your problem-solving skills and ability to work with complex data systems.
• When applying, make sure to tailor your resume and cover letter to the role, emphasizing your experience with real-time analytics, observability, and AI-powered data applications.
• Be prepared to discuss your understanding of the rapidly evolving landscape of AI and data analytics, and how you see ClickHouse contributing to this space.
• Consider creating a portfolio that demonstrates your ability to build and maintain large-scale data integrations, including any open-source projects you've contributed to.
• During the interview process, ask about the company culture, opportunities for professional growth, and the team's approach to collaborative development.
• Be transparent about your salary expectations and be prepared to negotiate based on your research of the market rate for similar positions.