Senior Software Engineer - Python and Data Ecosystem

## About the Role As a Senior Software Engineer specializing in Python and the Data Ecosystem at ClickHouse, you will be a core contributor to the company's mission to transform how companies use data. Your primary focus will be on owning and evolving critical parts of ClickHouse's data engineering ecosystem, sitting at the intersection of high-performance database engineering and developer experience. You will craft tools that enable Data Engineers and Data Scientists to harness ClickHouse's speed and scale in the frameworks they already use.

The role requires a deep understanding of the data practitioner's world, which is rapidly shifting towards databases being active participants in AI-powered workflows. You should have firsthand experience in operating within these workflows, not just building integrations, but bringing product-level insight into what to build and why.

As part of the Connectors team, you will work closely with the open-source community, internal teams, and enterprise users to ensure ClickHouse integrations set the standard for performance, reliability, and developer experience.

## What You Will Do - Own and evolve ClickHouse's Python connector and SDK ecosystem, focusing on performance, reliability, and API design.

• Build and maintain integrations with orchestration platforms such as Apache Airflow, Dagster, and Prefect.
• Develop and enhance connectors for data frameworks like Apache Spark, Flink, Kafka Connect, and Fivetran.
• Collaborate with the open-source community and internal teams to drive the direction of ClickHouse integrations.
• Work on building tools that enable Data Engineers and Data Scientists to leverage ClickHouse's capabilities within their existing workflows.
• Participate in the design and implementation of new features and architectures for ClickHouse's data ecosystem.
• Ensure the highest standards of code quality, testing, and documentation for all developed software.
• Engage with customers and the broader data community to understand their needs and provide feedback to the development team.
• Stay up-to-date with the latest trends and technologies in data engineering and AI-powered workflows to continuously improve ClickHouse's offerings.

## What We Are Looking For - Strong proficiency in Python and experience with data engineering ecosystems.

• Deep understanding of database systems, particularly columnar databases and their applications in real-time analytics and data warehousing.
• Experience with data frameworks such as Apache Spark, Flink, and Kafka.
• Knowledge of orchestration platforms like Apache Airflow, Dagster, and Prefect.
• Familiarity with AI and LLM ecosystems, including tools like LangChain, LlamaIndex, and n8n.
• Strong software development skills, with a focus on performance, reliability, and API design.
• Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment.
• Strong communication and collaboration skills, with the ability to work effectively with both technical and non-technical stakeholders.

## Nice to Have - Experience with cloud platforms and their integration with on-premises data systems.

• Knowledge of machine learning and its applications in data engineering workflows.
• Familiarity with DevOps practices and tools such as Docker, Kubernetes, and Terraform.
• Experience with agile development methodologies and version control systems like Git.

## Benefits and Perks - Competitive salary and benefits package.

• Opportunity to work with a cutting-edge technology stack and contribute to the development of innovative data engineering solutions.
• Collaborative and dynamic work environment with a team of experienced professionals.
• Flexible working hours and remote work options.
• Access to professional development opportunities, including training and conference attendance.
• Recognition and reward for outstanding performance and contributions to the company's mission.

- Make sure to highlight your experience with Python and data engineering ecosystems in your resume and cover letter.

• Prepare to discuss specific examples of integrations you've built or worked with in the past.
• Showcase your understanding of the data practitioner's world and how databases are becoming integral to AI-powered workflows.
• Be ready to provide insights into how you stay updated with the latest trends and technologies in data engineering.
• Consider creating a personal project or contributing to open-source projects to demonstrate your skills and passion for data engineering and Python development.
• Research ClickHouse's products and mission to understand how your skills and experience align with the company's goals.