Senior Software Engineer - Data Integration & JVM Ecosystem

About the Role

The Connectors team at ClickHouse is the bridge between ClickHouse and the entire data ecosystem, building and maintaining official data connectors and integrations with leading visualization platforms. This team's work spans from low-level database integrations to high-level data visualization plugins, ensuring that ClickHouse seamlessly integrates with the tools that users already know and love.

As a Senior Software Engineer on this team, the candidate will have the opportunity to work on a wide range of projects, from crafting tools that enable data engineers to harness ClickHouse's incredible speed and scale to building the foundation that thousands of data engineers rely on for their most critical data workloads.

What You Will Do

• Own the full lifecycle of data framework integrations, from core database drivers to SDKs and connectors that make ClickHouse feel native in JVM-based applications
• Develop and maintain critical parts of ClickHouse's data integration systems, including connectors, sinks, and sources for big data processing frameworks like Apache Spark, Flink, and Kafka
• Collaborate with the open-source community, internal teams, and enterprise users to ensure that ClickHouse's JVM integrations meet the highest standards for performance, reliability, and developer experience
• Craft tools that enable data engineers to harness ClickHouse's incredible speed and scale, including building database drivers, SDKs, and connectors
• Work closely with the product team to identify and prioritize new features and improvements to the data integration systems
• Participate in code reviews and contribute to the improvement of the overall code quality
• Troubleshoot complex issues with data integration systems, including debugging and optimizing code
• Develop and maintain technical documentation for data integration systems
• Collaborate with the DevOps team to ensure that data integration systems are properly deployed and monitored
• Participate in the planning and execution of technical projects, including setting goals and milestones

What We Are Looking For

• 6+ years of software development experience, focusing on building and delivering high-quality, data-intensive solutions
• Proven experience with the internals of at least one of the following technologies: Apache Spark, Apache Flink, Kafka Connect, or Apache Beam
• Experience developing or extending connectors, sinks, or sources for at least one big data processing framework
• Strong understanding of database fundamentals, including SQL, data modeling, query optimization, and familiarity with OLAP/analytical databases
• Strong proficiency in Java and the JVM ecosystem, including deep knowledge of memory management, garbage collection tuning, and performance profiling
• Solid experience with concurrent programming in Java, including threads, executors, and reactive or asynchronous patterns
• Outstanding written and verbal communication skills to collaborate effectively within the team and across engineering
• Track record of building scalable data integration systems, beyond simple ETL jobs
• Experience working with distributed systems, including cloud-based infrastructure and containerization

Nice to Have

• Experience with other big data processing frameworks, such as Hadoop or Storm
• Familiarity with data visualization tools, such as Grafana, Tableau, or Power BI
• Experience with containerization, such as Docker, and orchestration tools, such as Kubernetes
• Knowledge of machine learning or artificial intelligence technologies, such as TensorFlow orPyTorch
• Experience working with agile development methodologies, such as Scrum or Kanban

Benefits and Perks

• Competitive salary and benefits package
• Opportunity to work on cutting-edge technology and contribute to the development of a market-leading product
• Collaborative and dynamic work environment with a team of experienced professionals
• Flexible working hours and remote work options
• Professional development opportunities, including training and conference attendance
• Access to the latest tools and technologies, including cloud-based infrastructure and containerization
• Recognition and reward for outstanding performance, including bonuses and stock options
• Comprehensive health insurance and retirement plan
• Generous paid time off and holidays
• Remote work stipend and home office setup support

• Develop a strong understanding of Java and the JVM ecosystem, including memory management, garbage collection tuning, and performance profiling, to stand out as a candidate.
• Showcase your experience working with big data processing frameworks, such as Apache Spark, Flink, or Kafka, and highlight your ability to build scalable data integration systems.
• Prepare to discuss your experience with concurrent programming in Java, including threads, executors, and reactive or asynchronous patterns, and be ready to provide examples of your work.
• Highlight your understanding of database fundamentals, including SQL, data modeling, query optimization, and familiarity with OLAP/analytical databases, to demonstrate your expertise.
• Be prepared to discuss your experience working with distributed systems, including cloud-based infrastructure and containerization, and highlight your ability to troubleshoot complex issues.
• Keep your resume and online profiles up-to-date, and make sure to tailor your application materials to the specific job description and requirements.
• Research the company and the role, and be prepared to ask informed questions during the interview process.