Distinguished Engineer Apache Spark
Software Development
Excel
WFA Digital Insight
Demand for skilled engineers in accelerated computing has surged, driven by large-scale data processing needs. With NVIDIA's commitment to open-source innovation, this Distinguished Engineer role stands out. As a candidate, you should be prepared to showcase expertise in Apache Spark, GPU acceleration, and distributed systems, with 17+ years of experience in software development.
Job Description
About the Role
NVIDIA is seeking a Distinguished Engineer for the Apache Spark Acceleration group, focusing on accelerating Spark applications on GPUs without code changes.Responsibilities
- Lead the architecture, design, and implementation of accelerated Apache Spark and related big-data frameworks
- Engage with open-source communities for technical discussions and contributions
- Collaborate with distributed systems teams to define solutions for large-scale processing challenges
Requirements
- BS, MS, or PhD in Computer Science, Computer Engineering, or a closely related field (or equivalent experience)
- 17+ years of work or research experience in software development
- Prior experience in delivering big-data solutions
How to Stand Out
- Showcase your expertise in Apache Spark, GPU acceleration, and distributed systems through specific examples in your portfolio.
- Highlight your experience with open-source projects, such as RAPIDS, Apache Iceberg, and Delta Lake.
- Be prepared to discuss your approach to leading architecture and design for big-data frameworks.
- Emphasize your ability to collaborate with cross-functional teams, including distributed systems engineers and open-source communities.
- Develop a deep understanding of NVIDIA's open-source plugins and their applications in cloud and on-premises deployments.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.