Senior Software Engineer - AI Platform Team

CoinbaseCoinbase·Remote(Remote - USA)
Software Development

WFA Digital Insight

As demand for AI specialists surges, with a 25% growth in remote AI jobs in 2025, Coinbase stands out for its commitment to remote-first innovation. The company's AI Platform team is pivotal in this space, requiring skilled engineers who can navigate complex AI landscapes. With the global AI market expected to reach

90 billion by 2027, this role offers a unique chance to be at the forefront of AI development, working with cutting-edge technologies and contributing to the future of finance. Candidates should be prepared to showcase their expertise in AI infrastructure, agent development, and collaborative problem-solving.

Job Description

About the Role

The Senior Software Engineer position on the AI Platform team at Coinbase is a pivotal role that involves building and operating the Large Language Model (LLM) and agent infrastructure. This infrastructure is crucial as it serves as the foundation upon which every team at Coinbase builds, enabling the development and deployment of high-impact AI agents. The role is intense and challenging, requiring an individual who is not only skilled in software engineering and AI but also passionate about driving innovation in the financial sector.

As a Senior Software Engineer, you will be part of a remote-first but not remote-only company. This means you will have the opportunity to work from anywhere but also be required to participate in quarterly in-person working sessions, known as 'surges,' which are designed to foster collaboration, innovation, and alignment among team members.

What You Will Do

  • Develop and maintain the LLM Gateway, ensuring seamless integration with over 60 models across various providers, including self-hosted open weight models, while focusing on auth, PII redaction, quotas, fallbacks, and cost optimization.
  • Build and operate the AI Hub, serving as the single front door for agents, skills, MCP servers, knowledge bases, models, memories, and keys.
  • Design and implement the Agent and MCP runtime, utilizing microVM sandboxes for each agent run, a governed MCP gateway spanning over 125 servers, and ensuring cross-trust agent identity.
  • Develop and maintain Knowledge Bases, enabling connection to any data source, auto-provisioning vector and markdown stores, and ensuring queryability by any agent over MCP.
  • Work on the AI Spend Hub, focusing on FinOps for AI, spend attribution, and governance across the company.
  • Contribute to the development of evaluation and observability tools, including an in-house LLM as a judge harness with full tracing and evaluation tooling.
  • Participate in the development of company-wide chat and low-code workflow surfaces, with a focus on user experience and scalability for thousands of weekly active users.
  • Embed with teams to build production agents, develop feedback loops for subject matter experts to refine them, and apply traditional ML techniques, including fine-tuning where it outperforms prompting.
  • Utilize and build generative AI responsibly, ensuring human oversight to deliver business-ready outputs and drive measurable improvements in workflow efficiency, cost, and quality.

What We Are Looking For

  • A Bachelor's degree in Computer Science, Engineering, or a related field.
  • Significant experience in software engineering, preferably with a focus on AI, machine learning, or a related field.
  • Proficiency in multiple programming languages, with a strong foundation in at least one.
  • Experience with cloud platforms, particularly with major providers.
  • Understanding of AI and machine learning principles, including model development, training, and deployment.
  • Strong collaborative and communication skills, with the ability to work effectively in a remote environment.
  • Experience with DevOps practices and tools.
  • Familiarity with security and compliance principles in software development.

Nice to Have

  • Experience with containerization using Docker.
  • Knowledge of Kubernetes for deployment and management.
  • Familiarity with agile development methodologies.
  • Participation in open-source projects or personal projects that demonstrate coding skills and interest in AI/ML.

Benefits and Perks

  • Competitive salary and equity package.
  • Comprehensive health insurance.
  • Flexible PTO policy.
  • Professional development opportunities, including conference sponsorships and training programs.
  • Access to the latest technologies and tools.
  • Remote work stipend to support your home office setup.
  • Quarterly in-person 'surge' sessions for collaboration and team building.

How to Stand Out

  • Ensure you have a strong portfolio that showcases your experience in AI and software engineering, highlighting projects that demonstrate your ability to work with complex systems and collaborate in a remote environment.
  • Prepare to discuss your approach to responsible AI development, including how you ensure human oversight and ethical considerations in your projects.
  • Familiarize yourself with Coinbase's products and mission, and be ready to explain how your skills and experience align with the company's goals and values.
  • Practice explaining technical concepts in a clear, concise manner, as this will be important for collaboration with both technical and non-technical teams.
  • Consider reaching out to current or former employees to gain insights into the company culture and what to expect from the interview process.
  • Be prepared to discuss your long-term career goals and how this role at Coinbase fits into your overall career aspirations.

This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.