Databricks Administrator
WFA Digital Insight
As demand for data engineering experts grows, with a 25% increase in 2025, Databricks Administrators are in high demand. This role stands out for its focus on platform operations and governance, requiring skills like Databricks SQL, Python, and Excel. With the Affordable Care Act's emphasis on data integrity, professionals with experience in data analysis and process methodologies are highly sought after. Candidates should be prepared to discuss their experience with Databricks administration and data engineering operations, as well as their ability to work with stakeholders to shape platform design decisions.
Job Description
About the Role
The Databricks Administrator plays a critical role in leading the administration, governance, and operational management of enterprise Databricks environments. This position serves as a technical advisor to stakeholders, shaping platform design decisions, operational policies, and best practices for scalable and well-governed data product development. The ideal candidate will have a strong background in Databricks administration, platform engineering, or data engineering operations, with a focus on platform operations, but also improving how the platform is structured, governed, and used across teams.The role is part of the data science and data engineering team, working closely with stakeholders to prevent, detect, and resolve noncompliance with Marketplace rules, requirements, and laws. The team's goal is to support the oversight of the Health Insurance Marketplace, ensuring the integrity of consumer data and taxpayer dollars.
As a Databricks Administrator, you will be responsible for managing the day-to-day operations of the Databricks environment, including administering and maintaining workspaces, catalogs, schemas, storage integrations, and platform configurations.
What You Will Do
- Administer and maintain Databricks workspaces, catalogs, schemas, storage integrations, and platform configurations
- Troubleshoot platform issues related to permissions, connectivity, compute usage, storage access, workspace administration, and job execution
- Support cost optimization efforts by recommending best practices for workload management, scheduling, and efficient resource usage
- Participate in platform design discussions, architecture reviews, and operational planning to improve scalability, maintainability, and governance maturity
- Create and maintain documentation, standards, runbooks, and repeatable operating procedures for platform administration and governed delivery
- Provide platform-level guidance for adjacent analytics and AI capabilities in alignment with governance and operational standards
- Coach and provide guidance to less experienced professionals
- Assist in ad-hoc educational and outreach sessions with partners as needed
- Safeguard PII and PHI
What We Are Looking For
- 5+ years of Databricks administration, platform engineering, or data engineering operations experience
- Technical training or certification in Databricks, data engineering, or a related field
- Strong skills in Databricks SQL, Python, and Excel
- Experience with CMS, data analysis, and process methodologies
- Ability to work with stakeholders to shape platform design decisions and operational policies
- Strong understanding of data governance and compliance
- Experience with data engineering operations and platform management
Nice to Have
- Experience with cloud-based data platforms and cloud storage solutions
- Knowledge of data warehousing and ETL processes
- Familiarity with machine learning and AI technologies
Benefits and Perks
- Competitive salary and benefits package
- Opportunity to work with a talented team of data professionals
- Professional development and growth opportunities
- Flexible working hours and remote work options
- Access to cutting-edge technologies and tools
- Comprehensive health insurance and wellness programs
How to Stand Out
- Be prepared to discuss your experience with Databricks administration and data engineering operations, highlighting specific examples of how you've improved platform operations and governance.
- Showcase your skills in Databricks SQL, Python, and Excel, and be ready to provide examples of how you've applied these skills in previous roles.
- Emphasize your ability to work with stakeholders to shape platform design decisions and operational policies, demonstrating your understanding of data governance and compliance.
- Highlight any experience you have with data analysis and process methodologies, and be prepared to discuss how you've applied these skills in previous roles.
- Be prepared to discuss your understanding of cloud-based data platforms and cloud storage solutions, and how you've worked with these technologies in previous roles.
- Consider creating a portfolio that showcases your experience and skills in Databricks administration and data engineering operations, including any relevant certifications or training.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.