Host Systems Software Engineer
WFA Digital Insight
As the demand for AI systems continues to grow, with a 25% increase in AI adoption in 2025, the need for skilled software engineers who can create and optimize host software stacks is becoming increasingly important. Openai's commitment to developing custom silicon and system-level solutions for advanced AI workloads makes this role particularly exciting. Candidates with experience in low-level systems software and a strong understanding of Linux systems fundamentals will be well-suited to this position. With the rise of remote work, digital skills are in high demand, and this role offers the opportunity to work with a cutting-edge technology company. Before applying, candidates should be aware that this role requires strong technical skills, excellent communication abilities, and the capacity to work in a fast-paced environment.
Job Description
About the Role
The Host Systems Software Engineer position at Openai is a unique opportunity to work on the development of custom silicon and system-level solutions for advanced AI workloads. As a member of the Hardware organization, you will be responsible for designing and building the host software stack for next-generation AI systems. This role requires a deep understanding of low-level systems software, Linux kernel drivers, and high-throughput I/O paths.The successful candidate will be working closely with the hardware, systems architecture, and software teams to bring up new platforms, integrate emerging technologies, and develop the host-side systems software needed to make these systems performant, reliable, and production-ready. This role spans architecture, implementation, platform bring-up, debugging, and performance optimization.
What You Will Do
- Design, implement, and debug host-side systems software for AI infrastructure, including Linux kernel drivers and supporting userspace components
- Build and optimize software paths for high-throughput, low-latency communication, including RDMA and related networking functionality
- Develop software around PCIe, DMA, NICs, accelerators, memory movement, and device interaction
- Bring up new hardware platforms and diagnose complex issues across kernel, firmware, networking, and hardware boundaries
- Build tooling for integration, testing, diagnostics, observability, qualification, and performance characterization
- Collaborate with hardware, networking, and platform teams to define interfaces and integrate new capabilities
- Work with external vendors where needed to integrate technologies and drive issues to resolution
- Contribute across the systems software stack as the platform and team evolve
- Help shape the technical direction and engineering practices for a growing systems software stack
What We Are Looking For
- Experience building low-level or performance-critical systems software
- Strong programming skills in C or C++, with proficiency using Python and Linux tooling for automation and debugging
- Strong Linux systems fundamentals and the ability to debug across hardware and software boundaries
- Hands-on experience in at least one relevant area, such as Linux kernel drivers, kernel networking, RDMA, PCIe, DMA, NIC software, or high-performance I/O
- Experience owning complex software projects from design through implementation, bring-up, and validation
- Ability to thrive in ambiguity, work across subsystem boundaries, and build systems from scratch
- Strong cross-functional communication skills
Nice to Have
- Experience developing Linux kernel drivers or other OS-level performance-critical components
- Familiarity with RDMA or RoCE, ibverbs, kernel networking, or congestion-control concepts such as ECN and DCQCN
- Experience with PCIe, DMA, peer-to-peer communication, SR-IOV, IOMMU, dma-buf, or related accelerator and I/O subsystems
- Experience bringing up accelerators, NICs, SoCs, or custom hardware platforms
Benefits and Perks
- Opportunity to work with a cutting-edge technology company
- Collaborative and dynamic work environment
- Professional development and growth opportunities
- Access to the latest technologies and tools
- Flexible working hours and remote work options
- Competitive compensation and benefits package
- Recognition and reward for outstanding performance
- Opportunity to work on high-impact projects that can change the world
How to Stand Out
- Make sure to highlight your experience with low-level systems software and Linux kernel drivers in your application.
- Showcase your ability to work across subsystem boundaries and build systems from scratch.
- Familiarize yourself with Openai's technology stack and be prepared to discuss your experience with similar technologies.
- Be prepared to provide examples of your experience with complex software projects and your ability to debug across hardware and software boundaries.
- Research the company culture and values, and be prepared to discuss how your skills and experience align with them.
- Consider creating a personal project that demonstrates your skills in systems software development, such as a custom Linux kernel driver or a high-performance I/O system.
- Be prepared to negotiate your salary based on your experience and qualifications, and don't be afraid to ask about benefits and perks.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.