Senior Technical Program Manager, Machine Learning Infrastructure
WFA Digital Insight
As demand for AI and machine learning specialists continues to soar, with a 25% increase in job openings in the last year, technical program managers with expertise in ML infrastructure are in high demand. With Cohere at the forefront of security-first enterprise AI, this role offers a unique opportunity to work with cutting-edge technology and talented engineers. Candidates should be prepared to showcase their ability to manage complex programs, drive scalability, and collaborate effectively in a fast-paced environment. Before applying, consider how your skills align with the company's focus on innovation and customer-centricity.
Job Description
About the Role
The Senior Technical Program Manager for Machine Learning Infrastructure at Cohere is a pivotal role that will drive the success of the company's AI initiatives. As a TPM, you will be responsible for managing the program portfolio covering inference, efficiency, serving, and endpoints, ensuring that Cohere's infrastructure continues to scale for a rapidly expanding user base. You will lead the end-to-end coordination and execution across the program, collaborating with cross-functional teams to identify pain points, establish processes, and drive continuous improvement.The role is part of a global technology company co-headquartered in Toronto and San Francisco, with key offices in London, New York City, Montreal, Seoul, Germany, and Paris. As a remote-first company, you will have the opportunity to work with a talented team of researchers, engineers, designers, and more, who are passionate about their craft.
Cohere is committed to widespread adoption of AI and is looking for individuals who share this vision. As a TPM, you will be instrumental in shaping the company's ML infrastructure, driving innovation, and delivering value to customers.
What You Will Do
- Manage the program portfolio covering inference, efficiency, serving, and endpoints to guarantee scalable infrastructure for internal and external users
- Lead cross-functional collaboration with Modeling and customer-facing teams to drive program execution
- Identify pain points and establish processes to improve engineering best practices and meet user needs
- Build a culture of continuous improvement, liaising with incident management leads to ensure timely problem resolution
- Manage overlapping projects and programs, prioritizing asks to meet company top priorities
- Collaborate with stakeholders to set, track, and manage timelines, deliverables, budgets, and scope
- Deliver clear, timely, and consistent updates across engineering, leadership, and non-technical teams
- Act as a tactical and strategic partner to senior leads, providing support and driving impact at the company level
- Develop and maintain relationships with key stakeholders, including internal teams and external partners
- Stay up-to-date with industry trends and emerging technologies, applying this knowledge to drive innovation and improvement
What We Are Looking For
- 5+ years of Technical Program Management experience focusing on Machine Learning Infrastructure
- Proven track record of managing complex programs, driving scalability, and collaborating effectively in a fast-paced environment
- Strong technical skills, with the ability to understand and communicate complex technical concepts
- Excellent project management skills, with the ability to prioritize tasks, manage timelines, and allocate resources
- Strong collaboration and communication skills, with the ability to work effectively with cross-functional teams
- Experience with Agile development methodologies and version control systems
- Strong problem-solving skills, with the ability to analyze complex problems and develop creative solutions
- Experience with cloud-based infrastructure and machine learning platforms
- Strong business acumen, with the ability to understand and drive business outcomes
Nice to Have
- Experience with natural language processing or computer vision
- Knowledge of security-first enterprise AI principles and practices
- Experience with containerization and orchestration tools, such as Docker and Kubernetes
- Familiarity with DevOps practices and tools, such as Jenkins and GitLab
Benefits and Perks
- Competitive compensation package
- Equity opportunities
- Flexible remote work arrangements
- Comprehensive health and wellness benefits
- Professional development opportunities, including training and conference attendance
- Access to cutting-edge technology and tools
- Collaborative and dynamic work environment
- Recognition and reward programs for outstanding performance
- Generous paid time off and holiday schedule
How to Stand Out
- To stand out in this role, highlight your experience with machine learning infrastructure and technical program management, and be prepared to provide specific examples of how you've driven scalability and collaboration in previous roles.
- Make sure to showcase your technical skills, including proficiency in programming languages, cloud-based infrastructure, and machine learning platforms.
- Emphasize your ability to communicate complex technical concepts to non-technical stakeholders, and provide examples of how you've driven business outcomes through technical program management.
- Be prepared to discuss your experience with Agile development methodologies, version control systems, and DevOps practices.
- Consider creating a portfolio or case studies that demonstrate your technical program management skills and experience, and be prepared to walk the interviewer through your thought process and decision-making.
- Don't be afraid to ask questions during the interview, such as what the biggest challenges facing the team are, or how the company approaches innovation and customer-centricity.
- Be prepared to negotiate your salary and benefits package, and do your research beforehand to determine a fair and competitive range for the role.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.