Software Engineer, Streaming Systems
WFA Digital Insight
The demand for skilled software engineers in streaming systems has surged, with the global streaming market projected to reach
Job Description
About the Role
As a Software Engineer on the Streaming Systems team at Hightouch, you will play a critical role in developing and maintaining the high-throughput systems that drive the company's AI marketing solutions. Your primary focus will be on building and scaling the infrastructure that ingests, processes, and analyzes vast amounts of data from various sources. This includes clickstream, product interaction, and transactional data that fuels Hightouch's 'Cursor for Marketers' AI agent product.
The Streaming Systems team is at the forefront of Hightouch's technological advancements, and as a member of this team, you will have the opportunity to work on complex technical challenges, collaborate with cross-functional teams, and drive the company's growth through innovative solutions. With the company's streaming products experiencing a 10x revenue growth over the past year, the need for talented engineers who can scale and optimize these systems has never been more pressing.
What You Will Do
- Design, develop, and deploy high-throughput streaming systems capable of handling millions of messages per second with single-second latency.
- Work on the ingestion, processing, and storage of large datasets from various sources, ensuring data quality and integrity.
- Collaborate with the product team to develop and implement new features and functionalities that enhance the company's AI marketing capabilities.
- Participate in the development of the company's technical roadmap, providing input on system architecture and scalability.
- Troubleshoot and resolve technical issues, ensuring high system uptime and performance.
- Work closely with customers to solve their hardest scaling problems, providing technical support and guidance.
- Own and deliver projects from start to finish, with significant autonomy and ownership.
- Stay up-to-date with the latest technologies and trends in streaming systems and high-scale data processing, applying this knowledge to improve existing systems and develop new ones.
- Contribute to the development of best practices and standards for software development within the company.
- Participate in code reviews, ensuring high-quality code and adhering to the company's coding standards.
What We Are Looking For
- Experience and comfort with distributed systems and high-scale systems, or the ability and desire to build this experience quickly.
- Strong programming skills in languages relevant to the role, such as Java, Scala, or Python.
- Experience with streaming systems like Kafka, Kinesis, Pulsar, or Warpstream is highly desirable.
- Understanding of high RPS, low p99 latency systems and how to design and optimize them.
- Ability to work independently in a fast-paced, startup environment, with high levels of ownership and autonomy.
- Strong problem-solving skills, with the ability to analyze complex technical issues and develop effective solutions.
- Excellent communication skills, with the ability to work effectively with cross-functional teams and communicate technical concepts to non-technical stakeholders.
- Passion for technical innovation and a desire to stay at the forefront of advancements in streaming systems and AI marketing.
Nice to Have
- Experience with computation engines and real-time data processing.
- Knowledge of cloud data warehouses like Snowflake and Databricks.
- Familiarity with agentic AI and its applications in marketing and growth.
- Experience with machine learning models and their integration into streaming systems.
- Participation in open-source projects or personal projects related to streaming systems and high-scale data processing.
Benefits and Perks
- Competitive salary range, with a significant portion of the compensation in the form of equity via ISO options.
- Early exercise and a 10-year post-termination exercise window for equity options.
- Opportunity to work with a fast-growing company at the forefront of AI marketing innovation.
- Collaborative and dynamic work environment with a team of talented professionals.
- Flexible remote work arrangements, with the company embracing a remote-first policy.
- Access to cutting-edge technologies and tools, with a budget for professional development and training.
- Comprehensive health insurance and retirement plans.
- Generous paid time off and holidays, with a focus on work-life balance.
How to Stand Out
- When applying, make sure to highlight your experience with distributed systems and high-scale data processing, as these are key areas of focus for the role.
- Be prepared to discuss your approach to solving complex technical problems and how you stay current with the latest technologies in the field.
- Emphasize your ability to work independently and autonomously, as this is highly valued in the company's culture.
- Show a genuine interest in AI marketing and its applications, and be prepared to discuss how your skills and experience can contribute to the company's mission.
- During the interview process, ask questions about the company's technical roadmap, the team's dynamics, and opportunities for growth and professional development.
- Ensure your portfolio or GitHub profile is up-to-date and showcases your best work in streaming systems and high-scale data processing.
- Be prepared to negotiate your salary based on your experience and the company's compensation standards, and don't hesitate to ask about the equity component of your compensation package.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.