Senior Software Engineer - Python and Data Ecosystem

ClickhouseClickhouse·Remote(Israel (remote))
Software Development
Adjust

WFA Digital Insight

The demand for skilled software engineers with expertise in Python and data ecosystems has surged, with over 250% growth in cloud companies like ClickHouse. As a leader in real-time analytics, data warehousing, and AI workloads, ClickHouse offers a unique opportunity for professionals to make a significant impact. With the rise of remote work, companies are looking for experts who can drive innovation and collaboration. Candidates should be prepared to showcase their skills in building high-performance connectors and integrations, as well as their ability to work with cross-functional teams.

Job Description

About the Role

The Senior Software Engineer position at ClickHouse is a critical role that bridges the gap between the company's cutting-edge database technology and the broader data ecosystem. As a key member of the Connectors team, you will be responsible for building and maintaining high-performance Python connectors that enable seamless integration with various data frameworks, orchestration platforms, and AI tooling. Your work will directly impact how companies process massive datasets, from real-time analytics to AI-powered data applications.

The Connectors team is at the forefront of ClickHouse's mission to transform how companies use data. By building and maintaining integrations with popular data visualization tools, data frameworks, and orchestration platforms, you will enable millions of developers, data practitioners, and AI agents to harness the power of ClickHouse. Your expertise in Python and data ecosystems will be crucial in shaping the future of data engineering and science.

What You Will Do

  • Own and evolve ClickHouse's Python connector and SDK ecosystem, focusing on performance, reliability, and API design
  • Build and maintain integrations with orchestration platforms such as Apache Airflow, Dagster, and Prefect
  • Develop connectors for data frameworks like Apache Spark, Flink, Kafka Connect, and Fivetran
  • Collaborate with internal teams, enterprise users, and the open-source community to ensure ClickHouse integrations set the standard for performance and reliability
  • Craft tools that enable Data Engineers and Data Scientists to harness ClickHouse's speed and scale in their preferred frameworks
  • Drive architecture, performance, and feature direction across key Python integrations
  • Work closely with the data engineering and science communities to identify and prioritize new integrations and features
  • Participate in code reviews and contribute to the improvement of the overall codebase
  • Stay up-to-date with industry trends and emerging technologies in the data ecosystem

What We Are Looking For

  • 5+ years of experience in software engineering, preferably in the data engineering or data science space
  • Strong expertise in Python and its ecosystem, including popular data frameworks and libraries
  • Experience with building and maintaining high-performance connectors and integrations
  • Deep understanding of data engineering and science workflows, including data processing, storage, and analysis
  • Familiarity with cloud-based data platforms and technologies
  • Excellent problem-solving skills, with the ability to debug complex issues
  • Strong communication and collaboration skills, with experience working with cross-functional teams
  • Passion for open-source software and community-driven development

Nice to Have

  • Experience with AI and machine learning frameworks, such as TensorFlow or PyTorch
  • Familiarity with containerization technologies like Docker and Kubernetes
  • Knowledge of data visualization tools and libraries, such as Tableau or Matplotlib
  • Experience with agile development methodologies and version control systems like Git

Benefits and Perks

  • Competitive salary and benefits package
  • Opportunity to work with a cutting-edge database technology and contribute to its growth and development
  • Collaborative and dynamic work environment with a team of experienced professionals
  • Flexible working hours and remote work options
  • Professional development opportunities, including training and conference sponsorships
  • Access to the latest technologies and tools in the data ecosystem
  • Recognition and reward for outstanding performance and contributions

How to Stand Out

  • Tip: Showcase your expertise in Python and data ecosystems by sharing examples of your previous work, such as open-source projects or contributions to popular data frameworks.
  • Develop a deep understanding of ClickHouse's technology and mission, and be prepared to discuss how your skills and experience align with the company's goals.
  • Highlight your experience with building and maintaining high-performance connectors and integrations, and be prepared to provide specific examples of your work.
  • Demonstrate your passion for open-source software and community-driven development, and share your thoughts on the future of data engineering and science.
  • Be prepared to discuss your experience with agile development methodologies and version control systems, and how you handle debugging complex issues.
  • Research the company culture and values, and be prepared to discuss how you can contribute to and thrive in a remote work environment.
  • Prepare to back up your claims with data and metrics, and be specific about your achievements and the impact you've made in your previous roles.

This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.