Java Developer with Spark Experience

About the Role

Day-to-day, this role entails working on complex data processing projects, optimizing Spark applications for high-volume data workloads, and ensuring the scalability and reliability of the solutions developed. The team context is dynamic, with a focus on delivering results and meeting client expectations. The reporting structure is designed to support professional growth, with regular feedback and opportunities for advancement.

What You Will Do

• Design, code, and maintain applications and data processing solutions using Java, Kotlin, Scala, and Apache Spark.
• Develop and implement data loading and transformation processes for large datasets, handling various data formats and compression codecs.
• Utilize Spark SQL, DataFrames, and Datasets for efficient data manipulation and querying within Spark applications.
• Optimize Spark applications, including configuration tuning, memory management, and data serialization and task partitioning optimization.
• Collaborate with cross-functional teams to integrate Spark-based solutions with other systems and technologies.
• Participate in code reviews to ensure high-quality, maintainable code.
• Troubleshoot and resolve issues in existing Spark applications and data pipelines.
• Stay updated with the latest advancements in Spark, Java, and related technologies, applying this knowledge to improve existing solutions and develop new ones.
• Work closely with the development team to implement automated testing and deployment scripts.

What We Are Looking For

• 5+ years of professional software engineering experience, with a strong focus on JVM-based development and large-scale data processing solutions.
• Hands-on experience developing applications using Java and Kotlin, with a solid understanding of object-oriented and functional programming concepts.
• Practical working knowledge of Scala, including familiarity with commonly used Scala libraries, frameworks, and development practices.
• Strong experience designing, developing, and maintaining Apache Spark-based data pipelines and processing jobs.
• Proficiency with Spark SQL, DataFrames, distributed data processing, and performance optimization for high-volume data workloads.
• Solid understanding of big data engineering principles, distributed computing models, and scalable application design.
• Strong SQL skills and experience working with relational database systems.
• Experience building or supporting cloud-based data solutions within AWS environments.
• Familiarity with version control and collaborative development workflows using Git or similar tools.

Nice to Have

• Experience with other big data technologies such as Hadoop, Hive, or NoSQL databases.
• Knowledge of data visualization tools and techniques to present complex data insights.
• Certification in Java, Spark, or related technologies.
• Experience working in an agile development environment.

Benefits and Perks

• Competitive salary package.
• Full benefits, including health, dental, and vision insurance.
• Generous PTO policy, including vacation days, sick leave, and holidays.
• Remote work stipend to support home office setup and productivity.
• Opportunities for professional growth and career advancement.
• Collaborative and dynamic work environment with a team of professionals passionate about technology and innovation.
• Access to the latest technologies and tools to stay updated with industry trends.
• Recognition and reward programs for outstanding performance and contributions.

• Tip: Ensure your resume and cover letter highlight your hands-on experience with Java, Kotlin, Scala, and Apache Spark, as well as your understanding of big data engineering principles and distributed computing models.
• Tip: Prepare to discuss specific examples of Spark applications you've optimized for performance, including how you've tuned configurations, managed memory, and fine-tuned data serialization and task partitioning.
• Tip: Familiarize yourself with the company's products and services, and be ready to explain how your skills and experience align with their mission and goals.
• Tip: Consider creating a personal project or contributing to an open-source project that demonstrates your skills with Spark and Java, to showcase during the interview process.
• Tip: Research the market salary range for Java Developers with Spark experience and be prepared to negotiate your salary based on your skills and experience.
• Tip: Don't hesitate to ask about the company culture, team dynamics, and opportunities for growth and professional development during the interview.
• Tip: Be prepared to back up your claims of proficiency with specific examples or certifications, and show enthusiasm for continuous learning and adapting to new technologies.