Data Engineer: Integration Migration
WFA Digital Insight
As remote work continues to rise, the demand for skilled data engineers has grown significantly, with a notable 25% increase in postings over the past year. In this current market, professionals with expertise in cloud-based data migration and ETL processes are highly sought after. Enroute, a company known for its innovative approach and excellent work environment, is seeking a Data Engineer to lead the integration migration to Azure Data Factory. With a strong focus on work-life balance and employee satisfaction, Enroute stands out as an attractive employer. Before applying, candidates should be prepared to demonstrate their hands-on experience with Azure Data Factory and their ability to collaborate with various teams.
Job Description
About the Role
The Data Engineer: Integration Migration role at Enroute is a key position focused on migrating existing data pipelines to Azure Data Factory. This involves analyzing current processes, redesigning and rebuilding data pipelines, and ensuring seamless data movement, transformations, and error handling on the Azure platform. As a Data Engineer at Enroute, you will be part of a dynamic team that values innovation, social awareness, and continuous learning.Day-to-day, you will collaborate closely with database engineers, QA teams, architecture, and business stakeholders to ensure that data pipelines are not only migrated successfully but also optimized for performance and reliability. Your expertise in ETL/ELT pipelines, enterprise integration platforms, and data movement processes will be crucial in this role.
Given Enroute's emphasis on community and employee happiness, you will find a supportive environment that encourages professional growth and work-life balance.
What You Will Do
- Analyze existing integrations, workflows, mappings, transformations, schedules, and dependencies to identify areas for improvement in the migration process.
- Design and develop data pipelines in Azure Data Factory, ensuring they meet the requirements for data movement, transformations, and error handling.
- Connect ADF pipelines to source and target systems, including Oracle, Azure SQL, files, APIs, and other relevant systems.
- Implement pipeline scheduling, parameterization, monitoring, alerting, retry logic, and error handling to ensure reliable data pipeline operations.
- Collaborate with database migration engineers to align pipelines with migrated Snowflake SQL data structures.
- Support source-to-target mapping, data transformation logic, and technical documentation for clarity and future reference.
- Perform pipeline testing, data validation, and defect resolution to ensure high-quality data pipeline execution.
- Optimize ADF pipelines for reliability, performance, and maintainability, adopting best practices and staying updated with the latest Azure Data Factory features.
- Support deployment, production cutover, and stabilization activities to ensure smooth transition to the new platform.
What We Are Looking For
- Strong hands-on experience with Azure Data Factory, including designing, developing, and supporting ETL/ELT pipelines.
- Experience integrating with databases, flat files, APIs, cloud storage, and enterprise applications.
- Proficiency in SQL and experience working with relational databases.
- Understanding of pipeline orchestration, dependencies, scheduling, monitoring, retry logic, and error handling.
- Experience with data mapping, transformation logic, data validation, and migration testing.
- Ability to analyze existing integration processes and rebuild them in a new platform.
- Strong troubleshooting, documentation, and communication skills.
- Ability to collaborate with database engineers, QA, architecture, and business teams.
- Experience with CI/CD processes.
Nice to Have
- Experience with Azure DevOps for pipeline automation and deployment.
- Knowledge of data governance and data quality principles.
- Familiarity with cloud-based data warehousing solutions like Snowflake.
Benefits and Perks
- Competitive monetary compensation.
- Year-end bonus.
- IMSS, AFORE, INFONAVIT benefits.
- Major Medical Expenses Insurance.
- Life Insurance and Funeral Expenses Coverage.
- TDU Membership and MediAccess Health Check-Up Subsidy.
- Preferential rates for car insurance.
- Vacations and Official Mexican Holidays.
- Life Happens Days and Bereavement Leave.
- Civil Marriage Leave.
- English Classes and Certifications through Educational Agreements.
- Corporate Agreements and Discounts.
- Taquitos Rewards and Birthday Bonus.
- Work-from-home Bonus and Laptop Policy.
How to Stand Out
- Ensure your resume and cover letter highlight specific examples of Azure Data Factory migration projects you've led or been part of, emphasizing your problem-solving skills and experience with ETL/ELT pipelines.
- Prepare to discuss your understanding of data pipeline optimization, error handling, and retry logic in Azure Data Factory during the interview.
- Develop a portfolio or be ready to share examples of your work in data integration and migration, especially if you're transitioning from a related field.
- Research Enroute's culture and values to demonstrate your alignment with the company's mission and approach to innovation and employee satisfaction.
- Don't hesitate to ask about the team's workflow, collaboration tools, and how the company supports professional development and work-life balance during the interview.
- Consider learning more about the latest trends in cloud data migration and Azure Data Factory best practices to stand out as a candidate.
- Be prepared to negotiate your salary based on your experience and the market standard, and don't forget to inquire about benefits and perks that are important to you.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.