Big Data Engineer

Oowlish TechnologyOowlish Technology·Remote·Work From Anywhere
Data & Analytics

WFA Digital Insight

In the evolving landscape of digital transformation, the demand for Big Data Engineers is on the rise, especially with a 27% growth noted in remote tech roles this past year. Companies like Oowlish Technology stand out not only for their commitment to a positive work culture but also for their impact on international clients. Candidates with expertise in AWS and proficiency in Python are highly sought after, reflecting the skills crucial for paving the way in data innovation. Prospective applicants should be prepared to demonstrate not only technical skills but also adaptability and collaboration in remote settings, as these are essential in today's competitive job market.

Job Description

About the Role

Join Oowlish Technology as a Big Data Engineer, focusing on optimizing and maintaining AWS-based data infrastructure in a remote setting.

Responsibilities

  • Develop and maintain data processing logic using Python.
  • Build, optimize, and support data pipelines with AWS Glue and Lambda.
  • Write and optimize complex SQL queries for analytics.
  • Ensure platform reliability and monitor data pipelines.
  • Contribute to CI/CD processes using GitHub and GitHub Actions.
  • Collaborate on infrastructure improvements applying Infrastructure-as-Code principles.
  • Troubleshoot and resolve any pipeline failures or performance issues.

Requirements

  • 4+ years of experience in a Data Engineer / Big Data Engineer role.
  • Strong hands-on experience with Python for data processing.
  • Advanced SQL skills for query optimization and performance tuning.
  • Production experience with AWS Lambda and AWS Glue.
  • Familiarity with CI/CD tools, particularly GitHub and GitHub Actions.

Nice to Have

  • Experience with Snowflake and/or Aurora.

Benefits

Enjoy the flexibility of a fully remote position with opportunities for professional growth and development.

How to Stand Out

  • Showcase your experience with Python and AWS in your resume with specific projects.
  • Prepare to discuss challenges faced in data pipeline implementations during interviews.
  • Familiarize yourself with CI/CD best practices, as they'll likely be a focus during technical assessments.
  • Highlight any experience with modern data warehousing solutions like Snowflake to stand out.
  • Consider building a small portfolio of data processing projects to demonstrate your skills.

This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.