Data Engineer - Data Foundry Engineer
Software Development
WFA Digital Insight
The demand for skilled data engineers has grown exponentially, with a 25% increase in remote job postings in the last year alone. As companies like Tractian continue to harness the power of artificial intelligence, professionals with expertise in data pipelines and infrastructure are in high demand. With the global data engineering market expected to reach $77 billion by 2027, this role offers a unique opportunity to contribute to Tractian's innovative approach to industrial data analysis. Candidates should be prepared to showcase their technical expertise, as well as their ability to work collaboratively in a fast-paced environment.
Job Description
About the Role
As a Data Engineer at Tractian, you will play a critical role in the company's Data Science team, focusing on extracting valuable insights from vast amounts of industrial data. You will be responsible for designing and maintaining robust data pipelines, integrating and optimizing ETL/ELT processes, and ensuring the quality and governance of the data. Your work will have a direct impact on the company's decision-making processes, driving operational efficiency and product quality. The Data Foundry team is at the forefront of Tractian's data-driven approach, and as a Data Engineer, you will be the bridge between model training and data annotation teams. You will work closely with cross-functional teams to build and maintain labeling pipeline infrastructure for ML applications, and participate in architectural decisions, code reviews, and technical mentorship. Tractian is committed to innovation and excellence, and this role offers the opportunity to work with cutting-edge technologies and collaborate with a talented team of professionals.What You Will Do
- Design and maintain robust data pipelines to ingest data from various sources, including APIs, documents, websites, and raw sensor data
- Integrate and optimize ETL/ELT processes developed by MLE colleagues, improving performance, reliability, and long-term maintainability
- Own the full dataset lifecycle, from raw ingestion through cleaning, validation, and delivery as training-ready data
- Define and enforce data quality standards and governance practices across the Data Foundry team
- Build and maintain labeling pipeline infrastructure for ML applications, working closely with the annotation team
- Participate in architectural decisions, code reviews, and technical mentorship within the team
- Document data sources, pipeline logic, and processing decisions for reproducibility and team alignment
- Collaborate with cross-functional teams to ensure seamless data integration and analysis
- Stay up-to-date with industry trends and emerging technologies, applying this knowledge to continuously improve data engineering practices
What We Are Looking For
- 3+ years of experience in data engineering
- Degree in Computer Science, Data Engineering, Computer Engineering, Information Systems, or equivalent technical background
- Solid understanding of the ML training lifecycle and what properties make a dataset suitable for model training
- Familiarity with layered data architecture patterns such as Medallion Architecture (Bronze/Silver/Gold) or Data Mesh
- Proficiency in Python, with focus on data manipulation, pipeline development, and automation
- Workflow orchestration using code-based tools such as Temporal, Airflow, Prefect, Dagster, or equivalent
- Distributed data processing with Spark, Databricks, or similar
- REST and gRPC API integration
- Strong SQL skills, both for data modeling and query optimization
- Experience with streaming systems and event-driven pipelines (Kafka, Kinesis, or equivalent)
Nice to Have
- Experience making architectural decisions and contributing to the technical growth of a team, formally or informally
- Familiarity with Go, for high-performance pipeline components
- Experience with dbt for transformation layer modeling
- Knowledge of open table formats: Delta Lake, Apache Iceberg, or Hudi
- Experience with data quality frameworks such as Great Expectations or Soda
- Cloud experience, preferably OCI (our current migration target)
Benefits and Perks
- Competitive salary and benefits package
- Opportunity to work with a talented team of professionals in a fast-paced and innovative environment
- Flexible working hours and remote work options
- Professional development and growth opportunities
- Access to cutting-edge technologies and tools
- Collaborative and dynamic company culture
- Recognition and rewards for outstanding performance
- Comprehensive health insurance and wellness programs
- Generous paid time off and vacation days
- Remote work stipend and home office setup support
How to Stand Out
- Ensure your portfolio showcases your expertise in data engineering, including examples of complex data pipelines and infrastructure you've designed and implemented.
- Develop a strong understanding of machine learning workflows and the importance of high-quality training data.
- Familiarize yourself with Tractian's technology stack and be prepared to discuss how your skills align with their needs.
- Highlight your experience with agile development methodologies and collaborative version control systems like Git.
- Be prepared to discuss your approach to data governance and quality, and how you ensure the integrity of the data you work with.
- Show enthusiasm for innovation and a willingness to learn and adapt to new technologies and techniques.
- Research the company culture and be prepared to discuss how your values and work style align with Tractian's mission and vision.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.