Business Intelligence Analyst Senior (AI Evaluation & Monitoring)

About the Role

Day-to-day, the Senior Business Intelligence Analyst will be responsible for collecting, cleaning, and interpreting data sets to answer questions or solve problems. This includes identifying and effectively communicating improvement opportunities and supporting the evaluation of existing AI/ML projects. The ability to operate independently and act as an analytics expert in meetings and discussions with stakeholders is crucial.

The role also involves mentoring junior BI developers by offering project feedback, participating in code reviews, and providing training in areas of expertise. Excellent communication skills, both oral and written, are essential for translating analyses and opportunity insights to non-technical stakeholders and for presenting analysis and reports to internal customers and stakeholders.

What You Will Do

• Independently consult with AI stakeholders to gather evaluation and data requirements and define scope on projects of all sizes.
• Execute the evaluation work that keeps Geisinger's AI portfolio safe, performant, and accountable — running validation studies, instrumenting production monitoring, analyzing results, and turning findings into clear written work product that governance and program teams can act on.
• Collaborate with internal partners and organizations in the design and development of reporting solutions and analytic studies to support business needs.
• Plan projects and request completion tasks, providing time and effort estimates based on requirements gathering.
• Demonstrate strong experience in independently managing multiple projects.
• Develop, validate, and execute complex queries.
• Develop complex reports and perform complex data analysis that answers business questions for internal customers.
• Interpret results and make recommendations to business areas based on findings.
• Present analysis and reports to internal customers and stakeholders.
• Routinely use statistical methods during analyses and consider how best to visualize data that accurately reflects the intended message, including limitations.
• Report and help troubleshoot data quality issues when performing data profiling, testing, or validation.

What We Are Looking For

• Strong working knowledge of Excel and proficiency with related databases/data marts.
• Experience in managing multiple projects independently.
• Ability to articulate analyses and opportunity insights to non-technical stakeholders.
• Excellent communication and presentation skills.
• Strong understanding of data structures, programming, and statistics.
• Ability to mentor junior BI developers.
• Familiarity with business intelligence software systems.
• Strong attention to detail and the ability to be precise and clear when describing results of data analyses.
• Ability to stay abreast of current industry trends.

Nice to Have

• Experience with AI/ML projects and their evaluation.
• Knowledge of data visualization tools.
• Familiarity with agile project management methodologies.
• Participation in industry advisory and/or user groups.

Benefits and Perks

• Opportunity to work remotely and contribute to a leading healthcare organization.
• Collaborative and dynamic work environment.
• Professional development opportunities, including training and mentorship.
• Access to the latest tools and technologies in business intelligence and data analysis.
• Competitive benefits package, including health insurance and retirement plans.
• Flexible work arrangements to support work-life balance.

• When applying, ensure your resume and cover letter highlight specific examples of your experience with Excel and data analysis, as well as any projects you've led or contributed to that demonstrate your ability to drive data-driven decisions.
• Be prepared to discuss your approach to mentoring junior team members and how you handle complex data analysis and presentation to non-technical stakeholders.
• Familiarize yourself with Geisinger's current AI and ML initiatives to show your interest and readiness to contribute to the company's goals.
• Practice presenting complex data insights in a clear, concise manner, as this will be a key component of the interview process.
• Consider creating a portfolio that showcases your previous work in business intelligence, including any reports, dashboards, or models you've developed, to share with the interviewers.
• Prepare questions to ask the interviewers about the team, the role, and the company culture to demonstrate your engagement and interest in the position.