Lead Data Engineer (Poland)
WFA Digital Insight
The remote job market has seen a significant surge in demand for skilled data engineers, with companies increasingly relying on AI and machine learning to drive business decisions. Ex Parte is at the forefront of this trend, providing data-driven insights to inform legal decisions. With the global litigation market exceeding $250B annually, the need for talented data engineers who can navigate complex data platforms and drive innovation is more pressing than ever. As a leader in this field, Ex Parte is looking for a skilled Lead Data Engineer to join their team, bringing expertise in Spark, Python, and Scala to the table. Before applying, candidates should be prepared to demonstrate their technical prowess and entrepreneurial spirit, as well as their ability to thrive in a fast-paced environment.
Job Description
About the Role
As a Lead Data Engineer at Ex Parte, you will be responsible for leading a team that owns the AI self-service portal and related microservices. You will work closely with cross-functional teams of engineers to contribute to the development of the company's data platform. This role offers the opportunity to grow into more back-end or ML/AI work, depending on your interests and experience.The successful candidate will have a strong technical background, with expertise in languages such as Spark, Python, and Scala. You will be working with a distributed team, spanning North America and Europe, to build products that solve complex client problems. Your day-to-day responsibilities will include working directly with product owners and data experts to design and develop data pipelines, as well as evaluating software and implementation options.
What You Will Do
- Work directly with product owners and data experts to build products that solve complex client problems
- Build and support a distributed platform supporting all Ex Parte data
- Work across the product, primarily on the data pipelines
- Interface directly with internal teams to ensure seamless integration
- Evaluate software and implementation options and document them for technical teams
- Work with data analysts to collect insights on possible data collection efficiencies and identify automation potential for manual workflows
- Integrate best qualitative practices in program design and development
- Be a part of a distributed team, working with Azure cloud and Databricks
- Develop technical architectures and specific implementations to meet business needs
- Guide the team's software engineering best practices by documenting standards and completing code reviews
- Troubleshoot new and existing code and provide feedback and solutions to structural issues in the codebase as they arise
What We Are Looking For
- 3+ years of knowledge of Spark, Python, or Scala
- 3+ years of experience with RDBMS and T-SQL
- 3+ years of experience with NoSQL and DataLakes
- Strong familiarity with map/reduce programming models
- Proficiency in writing production-quality code
- Deep expertise in database schema design, optimization, and scalability
- Experience with Azure or AWS cloud-based service-oriented architecture
- Solid understanding of testing pyramid (unit, integration, black box, service)
- Experience working in an Agile/Scrum environment
- Strong analytical and problem-solving skills
- Good time management and organizational skills
- Ability to work on challenging issues independently or in a team environment
- Ability to learn and adapt quickly to new technologies and environments
- Strong communication skills
Nice to Have
- Experience with Databricks or Azure ML
- Experience applying machine learning algorithms to solve complex data mining problems
- Experience with JavaScript/Typescript, HTML5, and CSS3
- Experience with .NET core and entity framework core
- Experience with Power BI Embedded
- Understanding of cloud platforms and providers, specifically Microsoft Azure
- Knowledge of CI/CD tools in Azure DevOps
Benefits and Perks
- Competitive salary
- Opportunity to work on challenging and innovative projects
- Collaborative and dynamic work environment
- Professional development opportunities
- Flexible working hours and remote work options
- Access to cutting-edge technologies and tools
- Comprehensive health and wellness package
- Generous paid time off and holiday policy
- Pension and retirement savings plan
- Employee recognition and reward programs
How to Stand Out
- Ensure you have a strong understanding of Spark, Python, and Scala, as well as experience with RDBMS and NoSQL databases.
- Be prepared to demonstrate your expertise in database schema design, optimization, and scalability, as well as your ability to work with cloud-based service-oriented architectures.
- Highlight your experience working in Agile/Scrum environments and your ability to learn and adapt quickly to new technologies and environments.
- Showcase your strong analytical and problem-solving skills, as well as your ability to communicate complex technical concepts to non-technical stakeholders.
- Make sure to research the company and the role, and be prepared to ask informed questions during the interview process.
- Consider creating a portfolio of your work, including examples of your coding skills and experience with data engineering tools and technologies.
- Don't be afraid to negotiate your salary and benefits package - Ex Parte is looking for top talent and is willing to offer competitive compensation to attract the best candidates.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.