Lead Data Engineer

About the Role

The role entails working closely with cross-functional teams to understand data requirements, designing scalable data models and architectures, and optimizing data storage, processing, and retrieval for maximum performance and cost-efficiency. You will also collaborate with data scientists and analysts to enable seamless access to high-quality data for analytical purposes.

Lumiq's commitment to innovation and employee empowerment creates a unique work environment that fosters creativity and growth. The company's 'Tech Poetry' approach combines technology and creativity to create solutions that revolutionize the industry.

What You Will Do

• Lead, mentor, and manage a team of data engineers to deliver high-quality data solutions
• Design, develop, and implement cloud-based data pipelines, ETL processes, and data integration solutions using platforms like AWS
• Collaborate with cross-functional teams to understand data requirements and design scalable data models and architectures
• Optimize data storage, processing, and retrieval for maximum performance and cost-efficiency in cloud environments
• Implement data security and compliance measures to ensure the protection and integrity of sensitive BFSI data
• Troubleshoot and resolve data-related issues, ensuring data availability and reliability for BFSI customers
• Stay updated on industry best practices, emerging cloud technologies, and trends in the BFSI sector to drive continuous improvement and innovation
• Manage project timelines, delegate tasks, and ensure the successful delivery of data engineering projects
• Work closely with data scientists and analysts to enable seamless access to high-quality data for analytical purposes

What We Are Looking For

• Minimum 6 years of experience in data engineering with hands-on experience in Pyspark, Airflow, and AWS
• Advanced SQL and PySpark expertise, with a strong understanding of data engineering concepts
• API development experience, preferably in Python
• Familiarity with Docker and Kubernetes
• Experience with Airflow and exposure to Hudi, Iceberg, or Delta Lake
• Strong AWS project experience, with adaptability to other cloud platforms if required
• Proven experience in leading and managing a team of data engineers in previous roles
• Bachelor's degree in computer science, engineering, or a related field, with a master's degree preferred
• Proficiency in programming languages like Python, Java, or Spark for data processing and ETL operations
• Experience with big data technologies and data processing frameworks

Nice to Have

• Experience with BFSI industry data standards and compliance requirements
• Familiarity with cloud-based data platforms and data integration tools
• Knowledge of data security and compliance measures, with experience in implementing data protection policies
• Certification in data engineering or a related field
• Experience with data visualization tools and data storytelling techniques

Benefits and Perks

• Competitive salary and benefits package
• Opportunity to work with a leading data and analytics company in the FSI industry
• Collaborative and dynamic work environment with a team of experienced professionals
• Professional development opportunities, with access to training and certification programs
• Flexible work arrangements, with remote work options and a stipend for remote workers
• Health insurance and wellness programs, with a focus on employee well-being
• Paid time off and vacation days, with a generous leave policy
• Access to cutting-edge technologies and tools, with a focus on innovation and experimentation

• Develop a strong portfolio showcasing your data engineering experience, with a focus on cloud-based solutions and data integration projects.
• Highlight your expertise in Pyspark, Airflow, and AWS, and be prepared to discuss your experience with data engineering concepts and technologies.
• Emphasize your ability to lead and manage a team of data engineers, with a focus on collaboration, communication, and problem-solving skills.
• Familiarize yourself with Lumiq's 'Tech Poetry' approach and be prepared to discuss how you can contribute to the company's mission and values.
• Be prepared to discuss your experience with data security and compliance measures, and highlight your knowledge of industry best practices and trends.
• Research the company culture and values, and be prepared to discuss how you can thrive in a dynamic and collaborative work environment.
• Practice your skills in data engineering and data integration, and be prepared to complete technical challenges or assessments as part of the interview process.