Senior Software Engineer - Data Integration & JVM Ecosystem

ClickhouseClickhouse·Remote(United Kingdom (Remote))
Software Development
Adjust

WFA Digital Insight

As demand for real-time data analytics continues to grow, with the global market expected to reach $30 billion by 2027, companies like ClickHouse are at the forefront. With a 250% year-over-year growth in ARR, ClickHouse is an exciting place to be, especially for software engineers skilled in data integration and the JVM ecosystem. This role stands out for its focus on high-performance database engineering and developer experience, requiring a unique blend of technical skills and understanding of data ecosystems. Before applying, candidates should be aware that they'll need to demonstrate a strong proficiency in Java, experience with data-intensive solutions, and the ability to collaborate closely with both the open-source community and internal teams.

Job Description

About the Role

The Senior Software Engineer position at ClickHouse is a critical role that intersects high-performance database engineering and developer experience. As a member of the Connectors team, you will be responsible for building and maintaining the bridges between ClickHouse and the entire data ecosystem, ensuring seamless integrations with tools that millions of developers and data practitioners worldwide use. This is a unique opportunity to craft tools that enable Data Engineers to harness ClickHouse's incredible speed and scale, directly impacting how companies process massive datasets.

The role entails a deep dive into the JVM ecosystem, focusing on building scalable data integration systems beyond simple ETL jobs. You will own the full lifecycle of data framework integrations, from core database drivers to SDKs and connectors, making ClickHouse feel native in JVM-based applications. Collaboration with the open-source community, internal teams, and enterprise users is crucial to set the standard for performance, reliability, and developer experience.

As part of the Connectors team, you will be working on official data connectors for Kafka, dbt, Spark, Flink, Beam, and Fivetran, as well as integrations with leading visualization platforms like Grafana, Tableau, Power BI, and Metabase. Your work will be instrumental in expanding ClickHouse's reach and capabilities, supporting the company's mission to transform how companies use data.

What You Will Do

  • Own and maintain critical parts of ClickHouse's Data engineering ecosystem, focusing on JVM-based frameworks.
  • Develop and extend connectors, sinks, or sources for big data processing frameworks like Apache Spark, Flink, Beam, or Kafka Connect.
  • Collaborate with the open-source community to improve ClickHouse's integrations and ecosystem.
  • Craft tools that enable Data Engineers to fully utilize ClickHouse's capabilities.
  • Work on the core database driver that handles billions of records per second.
  • Develop SDKs and connectors to make ClickHouse feel native in JVM-based applications.
  • Ensure seamless integrations with leading visualization platforms.
  • Collaborate closely with internal teams and enterprise users to understand requirements and deliver solutions.
  • Participate in the planning and execution of the technical roadmap for ClickHouse's data integration capabilities.
  • Mentor junior engineers and contribute to the growth of the engineering team.

What We Are Looking For

  • 6+ years of software development experience focusing on building and delivering high-quality, data-intensive solutions.
  • Proven experience with the internals of at least one of the following technologies: Apache Spark, Apache Flink, Kafka Connect, or Apache Beam.
  • Experience developing or extending connectors, sinks, or sources for at least one big data processing framework.
  • Strong understanding of database fundamentals: SQL, data modeling, query optimization, and familiarity with OLAP/analytical databases.
  • A track record of building scalable data integration systems beyond simple ETL jobs.
  • Strong proficiency in Java and the JVM ecosystem, including deep knowledge of memory management, garbage collection tuning, and performance profiling.
  • Solid experience with concurrent programming in Java, including threads, executors, and reactive or asynchronous patterns.
  • Outstanding written and verbal communication skills to collaborate effectively within the team and across engineering.

Nice to Have

  • Experience with cloud technologies and distributed systems.
  • Familiarity with DevOps practices and tools such as Docker, Kubernetes, and CI/CD pipelines.
  • Knowledge of data security and compliance practices.

Benefits and Perks

  • The opportunity to work on a product that is leading the market in real-time analytics, data warehousing, observability, and AI workloads.
  • Collaboration with a talented team of engineers who are passionate about building high-performance data solutions.
  • Flexible, remote work arrangements that allow you to work from anywhere.
  • Access to the latest technologies and tools in the industry.
  • Ongoing learning and professional development opportunities.
  • Competitive compensation package.

How to Stand Out

  • Highlight your Java and JVM ecosystem skills: Ensure your resume and cover letter clearly demonstrate your experience and proficiency in Java and the JVM ecosystem, including any relevant certifications.
  • Emphasize data integration experience: If you have experience with data integration tools or frameworks like Apache Spark, Flink, or Kafka, be sure to highlight these in your application.
  • Prepare examples of scalable data systems: Be ready to discuss your experience with building scalable data integration systems and how you've handled complexity and performance in previous roles.
  • Showcase your understanding of database fundamentals: Demonstrate a strong grasp of SQL, data modeling, and query optimization, and be prepared to discuss how these fundamentals apply to real-world data challenges.
  • Research ClickHouse and its ecosystem: Before your interview, make sure you have a good understanding of ClickHouse's products, mission, and the current state of the data analytics market.
  • Practice discussing collaboration and communication: Given the remote nature of the role and the importance of collaboration with both internal teams and the open-source community, be prepared to talk about your experience with remote work, collaboration tools, and effective communication strategies.
  • Be ready to negotiate: Given that the salary is not disclosed, prepare your negotiation strategy based on your research of the market standards for similar positions.

This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.