Senior Software Engineer
WFA Digital Insight
As the demand for AI and LLM-based innovation grows, companies like Kong are leading the charge. With a 23% increase in AI adoption in 2025, the need for skilled software engineers is higher than ever. Kong's AI gateway team is at the forefront of this movement, and this role offers a unique chance to work on cutting-edge technology. Candidates should be prepared to showcase their expertise in distributed systems, Linux networking, and API management. Before applying, consider the importance of strong communication skills and experience working with remotely distributed teams.
Job Description
About the Role
The Senior Software Engineer position at Kong is a chance to join a team of innovators who are shaping the future of AI and LLM-based technology. As a key member of the AI gateway team, you will be responsible for designing, building, and maintaining API management software for AI and LLMs. Your work will empower companies and developers worldwide to govern every step of their AI and LLM-based innovation. The AI gateway team is a critical component of Kong's unified API and AI platform, Kong Konnect, which enables organizations to secure, manage, and monetize the flow of intelligence across APIs and AI models.In this role, you will be working on core features such as multi-LLM routing and balancing, semantic caching and routing, and more. You will be collaborating with a team of experienced engineers who are passionate about building scalable, distributed, and reliable software systems. If you are excited about the opportunity to work on complex technical challenges and make a significant impact, this role is for you.
What You Will Do
- Design, build, and maintain API management software for AI and LLMs
- Architect, design, and implement new innovative features, including proxying capabilities and load balancing
- Troubleshoot bugs, tune performance, and optimize low-level systems
- Fill gaps between Kong and third-party deployment platforms and tooling
- Mentor junior members of the team
- Collaborate with cross-functional teams to identify and prioritize project requirements
- Develop and maintain technical documentation for your products
- Participate in code reviews and contribute to the improvement of the codebase
- Stay up-to-date with industry trends and emerging technologies
- Contribute to the development of best practices and standards for software development
What We Are Looking For
- 5+ years of experience in programming server-side applications and components
- Experience designing, prototyping, building, and debugging applications that are highly scalable, distributed, reliable, and resilient
- Solid hands-on low-level technical expertise in Linux systems troubleshooting and profiling
- Experience in distributed systems, Linux networking stack, and computer systems programming
- Comfortable working with a remotely distributed team
- Strong sense of ownership and excellent verbal and written communication skills
- Familiarity with AI and LLM concepts and applications development
- Hands-on experience with Rust
- Experience with Excel
Nice to Have
- Hands-on experience with NGINX/OpenResty/Kong/LuaJIT
- Hands-on experience with Envoy or Istio
- Experience with cloud-based deployment platforms
- Knowledge of containerization and orchestration tools such as Docker and Kubernetes
Benefits and Perks
- Opportunity to work on cutting-edge technology and make a significant impact
- Collaborative and dynamic work environment
- Professional development and growth opportunities
- Flexible working hours and remote work options
- Access to the latest tools and technologies
- Competitive compensation and benefits package
- Recognition and rewards for outstanding performance
How to Stand Out
- Make sure to highlight your experience with distributed systems, Linux networking, and API management in your resume and cover letter.
- Prepare to showcase your problem-solving skills and ability to troubleshoot complex technical issues.
- Familiarize yourself with Kong's products and services, and be prepared to discuss how your skills and experience align with the company's goals.
- Demonstrate your ability to work independently and collaboratively as part of a distributed team.
- Be prepared to discuss your experience with AI and LLM concepts and applications development, and how you can contribute to the development of Kong's AI gateway.
- Use your portfolio or GitHub repository to showcase your coding skills and experience with relevant technologies.
- Research the current market salary range for Senior Software Engineers in Italy and be prepared to negotiate your salary based on your experience and qualifications.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.