Azure Data Engineer - Remote, Latin America

namename·Remote(Argentina)
Software Development
Excel

WFA Digital Insight

As the demand for skilled data engineers continues to rise, with a 28% increase in job postings over the past year, Bluelight's commitment to innovation and customer satisfaction sets them apart in the industry. With a strong focus on Azure technologies and data engineering, this role is ideal for professionals looking to expand their skill set in a dynamic and collaborative environment. Candidates should be prepared to showcase their expertise in ETL data engineering, data warehousing, and Azure Synapse Analytics, as well as their ability to work in a fast-paced, remote setting. With the right skills and experience, this role can be a launchpad for a successful career in data engineering.

Job Description

About the Role

The Azure Data Engineer role at Bluelight is a unique opportunity for a skilled professional to join a rapidly growing team and contribute to challenging and meaningful projects. As a key member of the data engineering team, you will be responsible for developing and maintaining ETL data engineering processes, designing and building effective data storage structures, and collaborating with cross-functional teams to understand data requirements and provide support for data-related initiatives. The ideal candidate will thrive in a fast-paced, dynamic environment where everyone's opinions and efforts are valued and appreciated.

In this role, you will work closely with data architects to create data models and schemas that align with business requirements, implement data quality checks and validation processes, and optimize ETL data notebooks and pipelines for scalability and performance. You will also have the opportunity to contribute to the implementation and understanding of other Data Fabric concepts, such as data lakes, lakehouses, delta lakes, and data cataloging, to enhance data management capabilities.

What You Will Do

  • Develop and maintain ETL data engineering processes using Python (PySpark) within Azure Synapse Analytics Notebooks and/or Azure Synapse Analytics Pipelines
  • Design and build effective data storage structures in a Massively Parallel Processing (MPP) SWL Pool
  • Extract data from various sources, including REST APIs, SQL database tables, and CSV files
  • Utilize deep knowledge of Azure Synapse Analytics to design and optimize data notebooks and pipelines for scalability and performance
  • Implement data quality checks and validation processes to maintain data accuracy and consistency
  • Optimize ETL data notebooks and pipelines to meet SLAs
  • Monitor ETL jobs, diagnose issues, and implement solutions to ensure data pipeline reliability
  • Maintain comprehensive documentation of ETL data engineering processes, data flows, and data transformations
  • Collaborate with cross-functional teams to understand data requirements and provide support for data-related initiatives
  • Ensure data security and compliance with data governance and privacy standards

What We Are Looking For

  • Bachelor's degree in Computer Science, Information Technology, or a related field
  • Proven experience in ETL data engineering with significant expertise in using Python (PySpark) to perform data extraction, transformation, and loading from REST APIs, SQL database tables, and CSV files
  • Proficiency in using Azure Synapse Analytics resources, including Notebooks, Pipelines, Linked Services, and Azure Key Vault
  • Demonstrated ability to write complex SQL queries, optimize query performance, and work with both SparkSQL and MS SQL to effectively extract, transform, and load data
  • Knowledge of data integration best practices and tools
  • Experience with data modeling and schema design
  • Strong understanding of data governance and data quality principles

Nice to Have

  • Certifications related to data engineering or data science (e.g., Azure Data Engineer)
  • Experience with data lakes, lakehouses, delta lakes, and data cataloging
  • Knowledge of cloud-based data platforms and technologies
  • Experience with Agile development methodologies and version control systems

Benefits and Perks

  • Competitive salary and benefits package
  • Opportunities for professional growth and development in a dynamic and collaborative environment
  • Remote work setup with flexible working hours
  • Access to cutting-edge technologies and tools
  • Collaborative and supportive team culture
  • Recognition and reward for outstanding performance

How to Stand Out

  • When applying for this role, make sure to highlight your experience with ETL data engineering, Azure Synapse Analytics, and data warehousing in your resume and cover letter.
  • Be prepared to showcase your ability to work in a fast-paced, dynamic environment and your expertise in data quality checks and validation processes.
  • Familiarize yourself with the company's technology stack and be prepared to discuss how you can contribute to the implementation and understanding of Data Fabric concepts.
  • Emphasize your ability to collaborate with cross-functional teams and provide support for data-related initiatives.
  • Be prepared to discuss your experience with data security and compliance with data governance and privacy standards.
  • Consider creating a portfolio that showcases your experience with data engineering and Azure technologies to stand out from other candidates.
  • Don't hesitate to ask about the company culture, team dynamics, and opportunities for professional growth during the interview process.

This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.