Principal AI Engineer
WFA Digital Insight
The demand for skilled AI engineers is on the rise, with a projected 25% growth in the next two years. Gorgias, a pioneer in conversational commerce, is seeking a Principal AI Engineer to lead the development of its AI systems. With the global conversational AI market expected to reach
Job Description
About the Role
The Principal AI Engineer role at Gorgias is a unique opportunity to lead the development of AI systems that power conversational commerce. As a Principal AI Engineer, you will be responsible for architecting and leading the development of the company's internal evaluation platform, moving the needle from manual testing to a fully automated lifecycle. You will work closely with the Orchestration team to build the robust, scalable infrastructure required to run complex evaluations and agentic simulations at scale.The role entails day-to-day collaboration with cross-functional teams, including AI, ML, and product teams. You will serve as the "AI Technical Lead" for product squads, guiding them through the complexities of agent design, failure analysis, and prompting best practices. Your expertise will be instrumental in defining what "good" looks like for AI at Gorgias, translating non-deterministic AI behavior into predictable engineering metrics that the whole organization can trust.
Gorgias is an AI-first company building products powered by LLMs and agent-based systems. As the company scales its AI capabilities, it needs to improve how it evaluates, iterates, and operates these systems in production. This role will focus on building and scaling the systems that support AI evaluation and iteration, helping the team move faster and more reliably.
What You Will Do
- Architect the Evaluation "Factory" - End-to-End Platform Ownership: Architect and lead the development of the internal evaluation platform, moving the needle from manual testing to a fully automated lifecycle.
- Accelerate Time-to-Market: Design tools and workflows that drastically reduce the time it takes to deliver a calibrated, production-ready agent.
- Infrastructure Collaboration: Partner with the Orchestration team to build the robust, scalable infrastructure required to run complex evaluations and agentic simulations at scale.
- Squad Empowerment: Serve as the "AI Technical Lead" for product squads, guiding them through the complexities of agent design, failure analysis, and prompting best practices.
- Decentralize Quality: Build the "paved road" that allows product squads to become autonomous in measuring and maintaining their own agent quality.
- Standard Setting: Define what "good" looks like for AI at Gorgias, translating non-deterministic AI behavior into predictable engineering metrics.
- Mentor & Level Up: Bridge the gap between traditional software engineering and AI, mentoring engineers on how to apply rigorous system design to the world of LLMs and agents.
- Continuous Observability: Take ownership of the feedback loop, ensuring that production insights from agents directly inform the next iteration of evaluation datasets.
What We Are Looking For
- 8+ Years of Engineering Excellence: You are a Staff-level engineer with experience building systems that handle high scale and know how to architect for long-term maintainability and performance.
- Agentic Curiosity: You have moved beyond the "chatbot" phase and are actively experimenting with AI Agents, understanding that the challenge isn't the prompt, but the orchestration, state management, and more.
- Excel skills: You have experience working with Excel and can apply it to data analysis and visualization.
- Strong Communication Skills: You can communicate complex technical concepts to non-technical stakeholders and collaborate effectively with cross-functional teams.
- Experience with AI Development: You have experience developing and deploying AI systems, with a strong understanding of machine learning principles and practices.
- Experience with Cloud Infrastructure: You have experience working with cloud infrastructure, including AWS or Google Cloud, and can design and deploy scalable systems.
Nice to Have
- Experience with LLMs and Agent-Based Systems: You have experience working with Large Language Models and agent-based systems, with a deep understanding of their strengths and limitations.
- Experience with DevOps Tools: You have experience working with DevOps tools, including CI/CD pipelines, and can design and deploy automated testing and deployment systems.
- Experience with Data Analytics: You have experience working with data analytics tools, including data visualization and machine learning, and can apply these skills to drive business insights.
Benefits and Perks
- Competitive Salary: Gorgias offers a competitive salary and benefits package, with opportunities for growth and professional development.
- Flexible Working Hours: Gorgias offers flexible working hours and remote work options, allowing you to work from anywhere in the world.
- Professional Development: Gorgias offers opportunities for professional development, including training and education programs, to help you grow your skills and career.
- Health and Wellness: Gorgias offers a comprehensive health and wellness program, including mental health support and wellness initiatives.
- Equity and Ownership: Gorgias offers equity and ownership opportunities, allowing you to share in the company's success and growth.
How to Stand Out
- Tip: Showcase your experience with AI development, iteration, and deployment, and highlight your ability to collaborate with cross-functional teams.
- Tip: Be prepared to demonstrate your expertise in AI development, including your understanding of machine learning principles and practices.
- Tip: Highlight your experience working with cloud infrastructure, including AWS or Google Cloud, and your ability to design and deploy scalable systems.
- Tip: Emphasize your strong communication skills, including your ability to communicate complex technical concepts to non-technical stakeholders.
- Tip: Be prepared to discuss your experience with data analytics, including data visualization and machine learning, and how you can apply these skills to drive business insights.
- Tip: Research the company's focus on quality, experience, and re-engagement, and be prepared to demonstrate how your skills and experience align with these values.
- Tip: Be prepared to discuss your experience working with LLMs and agent-based systems, including your understanding of their strengths and limitations.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.