Software Engineer, Gen AI Platform
WFA Digital Insight
As demand for AI-powered healthcare solutions grows, companies like abridge are pioneering new technologies. With a 25% increase in AI adoption in healthcare, skilled engineers are in high demand. abridge stands out for its commitment to responsible AI deployment, making it an attractive choice for those passionate about healthcare and technology. Before applying, candidates should be familiar with LLM APIs, retrieval systems, and service design. Abridge's unique approach to AI-powered clinical documentation requires candidates who can balance technical expertise with a deep understanding of healthcare needs.
Job Description
About the Role
The Software Engineer, Gen AI Platform, will play a crucial role in designing and building the runtime, orchestration engine, and evaluation platform for agentic orchestration and LLM-driven workflows. This position entails collaboration with a cross-functional team of researchers, clinical scientists, and product engineers to drive the development of generative AI-powered products. As part of the engineering team, the successful candidate will work on building GenAI systems that turn LLMs into composable, dependable tools, leveraging retrieval, tool use, agentic reasoning, and structured outputs.The role is critical in empowering clinicians to focus on patient care by improving clinical documentation efficiencies. The team at abridge is pioneering the use of generative AI in healthcare, setting industry standards for responsible AI deployment. This is a unique opportunity to join a growing team of professionals passionate about making care more accessible and meaningful.
What You Will Do
- Design and build GenAI systems that integrate LLMs with retrieval, tool use, and agentic reasoning capabilities
- Develop a highly reliable and scalable agent runtime, including orchestration, shared state and memory, tool-calling interfaces, and scheduling for cost, latency, and quality
- Implement secure, sandboxed execution for agent actions and code, focusing on cold start optimization, isolation, and observability
- Ship unified interfaces for multiple model sizes and providers, integrating with open tool ecosystems
- Develop an evaluation platform for online and offline assessments, A/B tests, safety checks, and regression gates to improve agent reliability
- Partner with Research to deliver new agent capabilities from prototype to production
- Collaborate with the engineering team to design and implement scalable and efficient systems
- Work on optimizing system performance, ensuring high availability and reliability
- Participate in code reviews, contributing to the improvement of the overall code quality
- Engage in troubleshooting and debugging of complex issues, providing creative solutions
What We Are Looking For
- Experience in building agent applications with tool-calling, context engineering, or open connector integrations
- Fluency with LLM APIs, prompting strategies, and orchestration patterns
- Experience with retrieval systems, function calling, tool use, or agentic workflows
- Strong coding skills in Python, Java, or Go
- Comfortable with service design, APIs, and data models for high-throughput systems
- Working knowledge of containers and Kubernetes concepts
- Familiarity with metrics, tracing, on-call rotations, and incident response practices
- Self-motivated with a willingness to take ownership and contribute to a collaborative environment
- Strong communication skills, able to work effectively with cross-functional teams
Nice to Have
- Prior work on agent orchestration pipelines, including task routing, planning, memory graphs, vector search, or browser automation
- Experience with evaluations, preference optimization, or RL to improve LLM reliability
- Knowledge of healthcare technology and clinical documentation systems
- Experience working in an agile development environment
Benefits and Perks
- Competitive compensation package
- Opportunity to work on cutting-edge AI technology in healthcare
- Collaborative and dynamic work environment
- Professional development opportunities, including training and conference sponsorships
- Flexible remote work arrangements, with occasional in-person meetings
- Access to the latest tools and technologies
- Comprehensive health insurance and wellness programs
- Generous PTO policy and paid holidays
- Employee stock options, allowing you to share in the company's success
How to Stand Out
- Tip: Showcase your experience with LLM APIs and retrieval systems in your resume and cover letter, highlighting specific projects or accomplishments.
- Familiarize yourself with abridge's technology and mission before applying, demonstrating your understanding of their unique approach to AI in healthcare.
- Prepare to discuss your problem-solving approach and how you handle complex technical issues during the interview process.
- Having a portfolio or examples of your work with agent applications or similar technologies can significantly strengthen your application.
- Be ready to discuss your experience with agile development methodologies and collaboration tools.
- Research the current market salary range for similar roles to ensure you're well-prepared for salary negotiations.
- Consider reaching out to current or former employees to gain insights into the company culture and work environment.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.