Tech Lead Databricks Data Engineer
WFA Digital Insight
As the digital landscape continues to evolve, tech leads in data engineering are seeing an increased demand, especially in AI-driven sectors like FinTech. With companies like Mitre Media leveraging advanced technologies for financial insights, candidates skilled in Databricks and cloud platforms are positioned well for success. Given the role's focus on mentoring and collaboration, it's essential to highlight your leadership abilities in addition to technical expertise. Candidates should be prepared to showcase their hands-on experience with ETL pipelines, as well as their aptitude for implementing data solutions in a fast-paced environment.
Job Description
About the Role
As Tech Lead Data Engineer at Mitre Media, you will be pivotal in architecting and maintaining our data systems. Reporting directly to the CTO, your expertise will translate into high-quality datasets supporting both user-facing features and internal analytics workloads.Responsibilities
- Design, implement and optimize large-scale ETL workflows using Databricks.
- Develop algorithms to turn raw market data into actionable insights.
- Ensure data quality and lineage through rigorous testing and monitoring.
- Enhance our cloud data platform on AWS and GCP to improve scaling and performance.
- Mentor fellow engineers, advocating for best practices in documentation and DevOps.
Requirements
- Technical Skills: Expert in Python, working knowledge of Scala or Java.
- Databricks & Spark: Hands-on experience with cluster tuning and job orchestration.
- SQL & DBT: Strong skills in analytical SQL, modular design, and CI/CD for transformations.
- Cloud Platforms: Production experience with AWS or GCP data services.
- Data Modeling: Familiarity with dimensional designs for analytics.
Nice to Have
- Experience with Apache Airflow or similar orchestration tools.
- Exposure to analytics tools like Looker is a plus.
Benefits
- Competitive salary ranging from 60k to80k.
- Engage in a remote-first culture with flexible collaboration opportunities.
How to Stand Out
- Highlight your experience with Databricks in your resume to catch the recruiter's attention.
- Be prepared to discuss specific projects where you implemented ETL workflows effectively.
- Demonstrate your leadership approach when mentoring less experienced engineers.
- Research Mitre Media's current products and prepare to discuss how your skills can enhance their offerings.
- Consider showcasing a portfolio of projects that utilized cloud platforms and data engineering tools.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.