Software Engineer, Data Platform

About the Role

The ideal candidate for this role is someone who is passionate about building and maintaining large-scale data infrastructure. You should have experience working with modern data technologies, including data lakes, data warehouses, and cloud-based data platforms. You should also be familiar with data governance practices and have a strong understanding of data security and compliance.

What You Will Do

• Design and implement foundational data infrastructure that enables scalable storage, reliable data processing, and secure access to data across the organization
• Develop and maintain a set of reusable connection and query utilities that empower internal stakeholders to interact with the data platform efficiently and safely
• Standardize Lattice's data infrastructure and practices through establishing a simple, cohesive, and reliable platform that seamlessly integrates internal and partner data
• Design, develop, and deploy scalable data pipelines that can ingest, process, and serve data across multiple teams for batch and streaming workloads
• Make data effortlessly accessible by abstracting infrastructure complexity through reusable SDKs, libraries, and tooling
• Shape data governance practices to ensure access to data is secure, compliant, and high-quality
• Partner with engineering, product, and business leaders to identify data needs and implement solutions that align with strategic objectives
• Collaborate with cross-functional teams to ensure that data is properly integrated into various systems and applications
• Develop and maintain documentation of data infrastructure, data pipelines, and data governance practices

What We Are Looking For

• 2+ years of experience in software, data, or analytics engineering with exposure to a centralized data platform or large-scale data infrastructure project
• Fluency in SQL and a general-purpose programming language, such as Python or TypeScript
• Familiarity with a data warehouse or lakehouse platform, such as Snowflake, Redshift, BigQuery, or Databricks
• Experience working with AWS services or their equivalents, such as IAM, Glue, Lambda, Athena, Redshift, Kinesis, or EKS
• Strong understanding of data governance practices and data security and compliance
• Experience working with agile development methodologies and version control systems, such as Git
• Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams

Nice to Have

• Hands-on experience with data processing frameworks, such as dbt, Spark, Kafka Streams, or Flink
• Experience working with cloud-based data platforms, such as AWS Lake Formation or Google Cloud Data Fusion
• Familiarity with machine learning or artificial intelligence technologies, such as TensorFlow or scikit-learn
• Experience working with containerization technologies, such as Docker or Kubernetes

Benefits and Perks

• Opportunity to work with a modern tech stack and contribute to the development of a cutting-edge data platform
• Collaborative and dynamic work environment with a team of experienced engineers and data professionals
• Flexible working hours and remote work options, with a stipend for home office setup
• Comprehensive benefits package, including medical, dental, and life insurance, as well as a retirement plan
• Access to a learning and development budget, with opportunities for professional growth and career advancement
• Incentive stock options, with the potential for long-term financial rewards
• Paid parental leave and paid time off, with a generous vacation policy
• Wellness programs and mental health support, with access to counseling services and employee assistance programs

• Tip: When applying for this role, be sure to highlight your experience working with large-scale data infrastructure and cloud-based data platforms.
• Tip: Showcase your ability to design and implement scalable data pipelines and data governance practices.
• Tip: Familiarize yourself with Lattice's products and services, and be prepared to discuss how you can contribute to the company's data-driven decision making.
• Tip: Emphasize your strong communication and collaboration skills, and provide examples of how you have worked effectively with cross-functional teams in the past.
• Tip: Be prepared to discuss your experience working with agile development methodologies and version control systems, such as Git.
• Tip: Consider creating a portfolio of your work, including examples of data pipelines, data governance practices, and data visualizations you have created in the past.