Data Engineer (Azure) - Remote, Latin America

Software Development

Excel

WFA Digital Insight

As the demand for cloud-based data solutions surges, companies like Bluelight Consulting are seeking skilled data engineers to drive their growth. With expertise in Azure and Python, these professionals are in high demand, especially in the Latin American market where Bluelight operates. According to market trends, the need for data engineers with cloud skills has grown significantly, making this a prime opportunity for those looking to leverage their skills in a dynamic, remote environment. Before applying, candidates should be aware of the importance of staying updated with the latest in data engineering technologies and the value of collaborative teamwork in such roles.

Job Description

About the Role

The role of a Data Engineer at Bluelight Consulting involves designing, developing, and maintaining data integration processes primarily using Python (PySpark) and Azure Synapse Analytics. This critical position ensures the accuracy and availability of analytical data, working closely with data scientists, analysts, and other stakeholders. As part of a growing software consultancy, the successful candidate will contribute to challenging projects within a collaborative community that values hard work, continuous learning, personal growth, and professional development.

Day-to-day, the Data Engineer will be immersed in a fast-paced, dynamic environment where everyone's opinions and efforts are valued. This position is ideal for a passionate software development professional who thrives in such settings and is committed to delivering high-quality data for insights and decision-making.

The Data Engineer will be part of a team that is dedicated to quality and customer satisfaction, reflecting Bluelight Consulting's mission to not only create cutting-edge applications but also to foster an enriching work environment where each team member can grow and thrive.

What You Will Do

Develop and maintain ETL data engineering processes using Python (PySpark) within Azure Synapse Analytics Notebooks and/or Azure Synapse Analytics Pipelines.
Apply expertise in data warehousing to design and build effective data storage structures in a Massively Parallel Processing (MPP) SWL Pool.
Extract data from various sources, including REST APIs, SQL database tables, and CSV files.
Utilize deep knowledge of Azure Synapse Analytics to design and optimize data notebooks/pipelines for scalability and performance.
Contribute to the implementation and understanding of Data Fabric concepts, such as data lakes, lakehouses, delta lakes, and data cataloging.
Collaborate with data architects to create data models and schemas that align with business requirements.
Implement data quality checks and validation processes to maintain data accuracy and consistency.
Identify and resolve performance bottlenecks and optimize ETL data notebooks/pipelines to meet SLAs.
Monitor ETL jobs, diagnose issues, and implement solutions to ensure data pipeline reliability.
Maintain comprehensive documentation of ETL data engineering processes, data flows, and data transformations.

What We Are Looking For

Bachelor’s degree in Computer Science, Information Technology, or a related field; or equivalent work experience.
Proven experience in ETL data engineering with significant expertise in using Python (PySpark) for data extraction, transformation, and loading from REST APIs, SQL database tables, and CSV files.
Proficiency in using Azure Synapse Analytics resources, including Notebooks, Pipelines, Linked Services, and Azure Key Vault.
Demonstrated ability to write complex SQL queries, optimize query performance, and work with data governance and privacy standards.
Certifications related to data engineering or data science (e.g., Azure Data Engineer) are a plus.
Experience with data modeling, data warehousing, and data quality processes.
Strong understanding of data security and compliance principles.

Nice to Have

Experience with Excel and its applications in data analysis and reporting.
Knowledge of agile development methodologies and version control systems like Git.
Familiarity with cloud-based data platforms and their integration with Azure services.
Participation in open-source projects or personal projects that demonstrate data engineering skills.

Benefits and Perks

Opportunity to work with a dynamic and diverse community of professionals.
Collaborative and enriching work environment that supports personal growth and professional development.
Chance to contribute to challenging, market-standing projects within a growing software consultancy.
Flexible, remote work arrangements.
Access to continuous learning and training opportunities.
Competitive compensation package.
Health and wellness programs.
Generous PTO policy.

How to Stand Out

Tip: Ensure your proficiency in Python (PySpark) and Azure Synapse Analytics is highlighted in your resume and cover letter, as these are key skills for the role.
When applying, include examples of previous data engineering projects, especially those involving Azure and Python, to demonstrate your practical experience.
It's crucial to have a basic understanding of data governance and compliance standards, so be prepared to discuss how you've handled data security in previous roles.
During interviews, be ready to explain complex data concepts simply, showcasing your ability to communicate technical ideas to both technical and non-technical stakeholders.
Consider creating a portfolio that showcases your data engineering skills, including any personal projects or contributions to open-source data engineering projects.
When negotiating salary, research the market average for data engineers in Latin America to make an informed discussion about your compensation.

This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.