Software Engineer, AI

About the Role

The role entails working on AI evaluation pipelines, implementing performance metrics, and analyzing results to propose incremental improvements to model and agent quality. You will also contribute to the development of AI system components, write clean and maintainable Python code, and support improvements to system reliability and performance.

Lattice's Engineering team is committed to continuous improvement and innovation, and you will be expected to contribute to this culture of excellence. You will work closely with senior engineers, product managers, and designers to deliver well-scoped projects and ensure that the company's AI systems meet the highest standards of quality and reliability.

What You Will Do

• Contribute to AI evaluation pipelines, including offline evaluations, production tracing, and feedback systems
• Implement and maintain performance metrics using established frameworks
• Analyze results and propose incremental improvements to model and agent quality
• Develop and maintain evaluation datasets and test cases to identify regressions
• Collaborate with cross-functional partners to ship user-facing features
• Contribute to AI system components such as RAG pipelines, retrieval systems, and multi-step workflows
• Write clean and maintainable Python code that integrates with LLM providers and internal services
• Support improvements to system reliability, observability, and performance in production
• Deliver well-scoped projects with guidance from more senior engineers
• Break down tasks, make steady progress, and be proactive in unblocking yourself by asking for help when needed
• Contribute to team excellence through code reviews, documentation, and knowledge sharing

What We Are Looking For

• 2-5 years of professional software engineering experience
• Experience contributing to production systems as part of a team
• Exposure to AI/ML systems with a strong interest in LLM-powered products
• Experience debugging systems, working with data, and iterating on performance
• Proficiency in Python or a similar language
• Strong understanding of LLM concepts (prompting, RAG, evaluation)
• Familiarity with backend systems, APIs, and cloud environments (e.g., AWS, GCP)
• Exposure to logging, monitoring, or debugging tools
• Interest in learning tools like LangGraph, vector databases, and evaluation platforms
• Strong ownership: you reliably deliver high-quality work on well-defined tasks, on time, and communicate progress clearly
• Learning mindset: you actively seek feedback and improve quickly

Nice to Have

• Hands-on experience with LLMs, prompt iteration, or MLOps
• Familiarity with vector databases or retrieval systems
• Exposure to experimentation, metrics, or basic statistical analysis
• Familiarity with TypeScript

Benefits and Perks

• Competitive compensation package
• Opportunity to work with a cutting-edge company in the AI industry
• Collaborative and dynamic work environment
• Professional development and growth opportunities
• Flexible working hours and remote work arrangement
• Access to the latest tools and technologies
• Comprehensive health insurance and benefits package

• To stand out as an applicant, make sure to highlight your experience with AI/ML systems and Python programming
• Be prepared to discuss your understanding of LLM concepts and how you have applied them in previous roles
• Emphasize your ability to work collaboratively and communicate effectively with cross-functional partners
• Showcase your proficiency in backend systems, APIs, and cloud environments
• Familiarize yourself with the company's products and services to demonstrate your interest and enthusiasm for the role
• Be prepared to provide examples of your experience with debugging systems, working with data, and iterating on performance
• Consider creating a portfolio that showcases your work and achievements in AI engineering