Senior QA Automation Engineer – AI Applications

Autodesk·Remote(Canada)

Software Development

Excel

WFA Digital Insight

As remote software development continues to grow, the demand for skilled QA automation engineers has skyrocketed. With over 70% of companies adopting AI-powered tools, expertise in automated testing and AI integration is highly prized. Autodesk, a leader in digital design, is seeking a seasoned QA automation engineer to drive the quality and reliability of their AI applications. With the global AI market expected to reach

90 billion by 2025, this role offers a chance to work at the forefront of innovation. Before applying, candidates should be aware of the evolving landscape of AI testing and the need for continuous learning.

Job Description

About the Role

As a Senior QA Automation Engineer at Autodesk, you will play a pivotal role in ensuring the quality, reliability, and performance of AI-powered applications. Your expertise in automated testing and software quality engineering will be crucial in building scalable testing frameworks and leveraging AI-powered testing tools to improve test development, maintenance, and coverage. The role is part of a dynamic team that values collaboration, innovation, and continuous learning. You will work closely with cross-functional teams to design and implement comprehensive test strategies, identify areas for improvement, and drive the adoption of best practices in QA automation. The team's success is measured by the quality and reliability of the applications, and your contributions will have a direct impact on the user experience.

What You Will Do

Design and maintain automated test suites, evaluation scenarios, metrics, and test datasets for AI-powered features.
Automate QA workflows using Python and CI/CD tools like GitHub Actions and Jenkins, leveraging AI-powered testing tools to enhance test development and maintenance.
Create and maintain test harnesses for AI services, applications, and APIs.
Perform API testing for AI services and backend systems.
Define quality strategy and acceptance criteria for AI-powered applications across functional, API, integration, and AI/ML features.
Test AI/ML applications and machine learning models from a product and user perspective.
Evaluate AI/ML model outputs for correctness, consistency, and expected application behavior.
Define structured rubrics that translate qualitative findings into measurable evaluation gates.
Build quality gates for CI/CD and deployment pipelines, including automated regression and integration testing.
Mentor teams on QA automation best practices and consistent quality standards for AI-powered applications.
Contribute to multi-team projects and codebases, ensuring code quality and consistency.
Participate in code reviews and provide constructive feedback to peers.
Document and present findings and ideas across the company.

What We Are Looking For

Bachelor’s degree in Computer Science, Engineering, or equivalent experience.
5+ years of professional experience in software quality assurance, test automation, or software engineering.
Strong programming skills in Python, with experience in test automation.
Hands-on experience using AI-powered testing tools or AI coding assistants to improve test automation, productivity, and quality.
Experience with CI/CD tools and processes.
Familiarity with popular CAD environments and tooling.
Proficient in automation and UAT test suites/frameworks.
Experience designing QA frameworks or platforms used by multiple teams.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills.
Understanding of software architecture and design patterns.
Ability to work in an Agile development environment.

Nice to Have

Experience testing AI/ML applications or validating machine learning models.
Experience with data validation tooling or labeling workflows.
Familiarity with ML frameworks like PyTorch or TensorFlow.
Experience with data pipelines and orchestration tools like Airflow or Metaflow.
Knowledge of MLOps practices, including model monitoring, drift detection, and deployment validation.

Benefits and Perks

Competitive compensation package.
Opportunity to work with cutting-edge AI technologies.
Collaborative and dynamic work environment.
Professional development opportunities, including training and conference participation.
Flexible working hours and remote work options.
Access to the latest tools and technologies.
Recognition and reward for outstanding performance.
Comprehensive health insurance and wellness programs.
Generous paid time off and vacation days.
Retirement savings plan with company matching.
Employee stock purchase plan.
Diversity, equity, and inclusion programs.

How to Stand Out

To stand out, highlight your experience with AI-powered testing tools and CI/CD pipelines in your resume and cover letter.
Showcase your ability to design and implement comprehensive test strategies and your understanding of software architecture and design patterns.
Prepare to discuss your experience with automated testing frameworks and your approach to testing AI/ML applications.
Demonstrate your problem-solving skills by providing examples of complex issues you've resolved in previous roles.
Be ready to talk about your experience working in an Agile development environment and your ability to collaborate with cross-functional teams.
Consider creating a portfolio that showcases your work in QA automation, including examples of test suites and frameworks you've developed.
When negotiating salary, emphasize your unique blend of technical skills and experience in the field.

This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.