Senior Data Engineer

About the Role

As a Senior Data Engineer, you will be working on the latest big data tools, frameworks, and offerings, such as data mesh. Your expertise will enable credible and collaborative problem-solving to execute on a strategy. You will be part of a dynamic team that values innovation, creativity, and continuous learning.

The role of a Senior Data Engineer at Thoughtworks is multifaceted and challenging. It requires a deep understanding of data engineering principles, a strong technical background, and excellent collaboration and communication skills. If you are passionate about working with data and driving business outcomes through innovative data solutions, this role could be an exciting opportunity for you.

What You Will Do

• Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions.
• Design and implement intricate data processing pipelines to address clients' most challenging problems.
• Collaborate with data scientists to design scalable implementations of their models.
• Write clean, iterative code using Test-Driven Development (TDD) and leverage various continuous delivery practices to deploy, support, and operate data pipelines.
• Utilize different distributed storage and computing technologies from a plethora of options available.
• Develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack.
• Collaborate with the team on areas of data governance, data security, and data privacy.
• Incorporate data quality into your day-to-day work, ensuring high standards of data integrity and reliability.
• Stay updated with the latest trends and advancements in data engineering and contribute to the knowledge sharing within the team.

What We Are Looking For

• Hands-on experience in building and operating data pipelines and maintaining data storage within distributed systems.
• Proficiency in data modeling and experience with modern data engineering tools and platforms.
• Ability to write clean, high-quality code using preferred programming languages.
• Experience in building and deploying large-scale data pipelines and data-centric applications using distributed storage and processing platforms in a production setting.
• Strong understanding of data governance, security, and privacy principles.
• Excellent collaboration and communication skills, with the ability to work effectively in a remote team environment.
• Passion for working with data and driving business outcomes through data-driven solutions.
• Experience with agile development methodologies and version control systems.

Nice to Have

• Experience with cloud-based data platforms and services.
• Knowledge of machine learning and artificial intelligence principles.
• Certification in data engineering or a related field.
• Participation in open-source data engineering projects or personal data engineering projects.

Benefits and Perks

• Competitive compensation package.
• Opportunity to work with a global team of experts in digital transformation and data engineering.
• Flexible remote work arrangements.
• Professional development opportunities, including training and conference participation.
• Access to the latest tools and technologies in data engineering.
• Health insurance and retirement benefits.
• Generous paid time off policy.
• Remote work stipend to support your home office setup.

• Ensure your portfolio includes examples of data pipelines and architectures you've designed and implemented, highlighting your problem-solving skills and technical expertise.
• Prepare to talk about your experience with distributed systems, big data tools, and frameworks, and be ready to provide specific examples of how you've applied these technologies in previous roles.
• Develop a deep understanding of data governance, security, and privacy principles, as these are critical aspects of the Senior Data Engineer role at Thoughtworks.
• Practice explaining complex technical concepts in simple terms, as effective communication is key to success in this position.
• Be prepared to discuss your approach to collaborative problem-solving and how you contribute to a positive, dynamic team environment.
• Research Thoughtworks' approach to digital transformation and how data engineering fits into their overall strategy, to show your genuine interest in the company and the role.
• When negotiating salary, consider highlighting your unique blend of technical skills and experience, and be prepared to discuss your expectations regarding remote work arrangements and professional development opportunities.