Senior Data Engineer
WFA Digital Insight
As the demand for data-driven healthcare solutions grows, so does the need for skilled data engineers. With a 25% increase in data engineering roles in the past year, professionals with expertise in cloud technologies and AI are in high demand. Sarah Cannon Research Institute, a leader in oncology research, is seeking a Senior Data Engineer to drive innovation in cancer treatment. With a strong focus on data modernization and AI initiatives, this role offers a unique opportunity to make a significant impact in the fight against cancer. Candidates should be prepared to showcase their technical expertise and passion for delivering high-quality data solutions.
Job Description
About the Role
The Senior Data Engineer role at Sarah Cannon Research Institute is a critical position that will drive the development of efficient data pipelines and support data modernization initiatives. As a key member of the Data Solutions team, the successful candidate will work closely with cross-functional teams to design and implement scalable data engineering processes. With a focus on delivering high-quality data solutions, this role will play a vital part in advancing cancer research and improving patient outcomes.The day-to-day responsibilities of this role will involve collaborating with stakeholders to understand data requirements, designing and maintaining data pipelines, and ensuring seamless data integration across systems. The Senior Data Engineer will also contribute to the development of data architectures, implement best practices for data engineering, and provide technical leadership in enabling AI/ML initiatives.
As a mission-driven organization, Sarah Cannon Research Institute is committed to advancing the fight against cancer. The successful candidate will be passionate about delivering innovative data solutions that drive meaningful outcomes for patients and will be committed to staying abreast of emerging data engineering technologies.
What You Will Do
- Design and implement scalable and efficient data pipelines to support various data-driven initiatives
- Develop and maintain Databricks Lakehouse pipelines across Bronze/Silver/Gold (Delta) layers
- Collaborate with cross-functional teams to understand data requirements and contribute to the development of data architectures
- Work on data integration projects, ensuring seamless and optimized data flow between systems
- Implement best practices for data engineering, ensuring data quality, reliability, and performance
- Contribute to data modernization efforts by leveraging cloud solutions and optimizing data processing workflows
- Provide technical leadership in enabling AI/ML initiatives by designing scalable, reliable, and well-governed data engineering solutions
- Effectively communicate technical concepts to both technical and non-technical stakeholders
- Participate in the evaluation and identification of new technologies
- Promote a culture of innovation, experimentation, and continuous learning
What We Are Looking For
- Deep technical expertise in building and optimizing data pipelines and large-scale processing systems
- Experience working with cloud solutions, particularly Azure Cloud and Databricks
- Strong programming skills (e.g., SQL, Python, PySpark, or Scala) for data manipulation and transformation
- Excellent understanding of data engineering principles, data architecture, and database management
- Excellent understanding of data modeling concepts and data structures
- Strong experience building AI/ML data pipelines in Databricks
- Proficient in leveraging GenAI and agentic frameworks to develop data engineering solutions
- Strong problem-solving skills and attention to detail
- Excellent communication skills, with the ability to convey technical concepts to both technical and non-technical stakeholders
Nice to Have
- Knowledge of healthcare or clinical research industries
- Experience working with a wide variety of technologies
- Strong technical aptitude and ability to rapidly learn and evaluate new tools or technologies
- Strong verbal and written communication skills
- Demonstrated technical experience and a passion for delivering high-quality data solutions
Benefits and Perks
- Competitive salary and benefits package
- Opportunity to work with a mission-driven organization that is committed to advancing the fight against cancer
- Collaborative and dynamic work environment
- Professional development opportunities, including training and education
- Flexible working arrangements, including remote work options
- Access to cutting-edge technologies and tools
- Recognition and reward for outstanding performance and contributions
- Comprehensive health and wellness program
- Generous PTO and holiday schedule
How to Stand Out
- Develop a strong portfolio that showcases your data engineering expertise, particularly in cloud technologies and AI/ML initiatives.
- Be prepared to discuss your experience with data pipelines, data integration, and data modernization efforts.
- Familiarize yourself with the latest data engineering trends and technologies, including Databricks, Azure Cloud, and GenAI.
- Highlight your ability to communicate technical concepts to both technical and non-technical stakeholders.
- Prepare to discuss your approach to data quality, reliability, and performance, and how you ensure seamless data integration across systems.
- Research Sarah Cannon Research Institute's mission and values, and be prepared to discuss how your skills and experience align with the organization's goals.
- Practice answering behavioral questions that demonstrate your problem-solving skills, attention to detail, and passion for delivering high-quality data solutions.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.