Manager, Software Engineering (Resilience Engineering)
WFA Digital Insight
Affirm’s Resilience Engineering Manager sits at the intersection of reliability and innovation, tasked with turning production environments into controlled testing grounds. Unlike generic reliability roles, this position makes chaos engineering a first‑class discipline, requiring the leader to craft safe load‑testing platforms and embed them across the software lifecycle. The team will build guardrails—approval workflows, isolation boundaries, and automated rollback—so experiments never jeopardize real users. Candidates will work hand‑in‑hand with infrastructure, product, and security leads, turning abstract failure scenarios into concrete, observable experiments. Success hinges on hands‑on experience with fault‑injection tools, cloud‑native stacks, and a mindset that prefers “testing failure before failure tests you.”
Job Description
Affirm is reinventing credit to make it more honest and friendly, giving consumers the flexibility to buy now and pay later without any hidden fees or compounding interest.
We are seeking a seasoned Engineering Manager to lead our Resilience Engineering team. This role is critical in ensuring the safety and reliability of our production systems through proactive validation techniques, including production load testing and chaos engineering.
You will lead the development of systems and practices that allow engineers to safely test system behavior under stress and failure conditions in production, ensuring issues are discovered and mitigated before they impact real users.
What you’ll do
Leadership & Strategy
- Define and drive the vision for resilience engineering at Affirm, with a focus on production load testing and chaos engineering as first-class engineering practices.
- Lead and mentor a team of engineers building platforms and tooling for safe production experimentation.
- Partner with infrastructure, product, and security leadership to embed resilience validation into the software development lifecycle.
- Establish best practices for safely testing system limits and failure scenarios in production.
Systems & Operations
- Own the design and evolution of platforms that enable safe, controlled production load testing and fault injection.
- Ensure strong safeguards are in place, including isolation boundaries, approval workflows, and automated rollback mechanisms to protect real users.
- Build systems that provide end-to-end observability, traceability, and auditability for all resilience experiments.
- Drive reliability improvements by systematically identifying weaknesses through load testing and chaos experiments.
- Establish monitoring, alerting, and incident response practices tailored to proactive resilience validation.
Collaboration & Enablement
- Work closely with engineering teams to design and execute production load tests and chaos experiments safely.
- Partner with infrastructure teams to build guardrails around tests and experimentations.
- Enable teams to adopt resilience practices by providing reusable tooling, frameworks, and standardized workflows.
- Identify systemic weaknesses and lead cross-functional efforts to improve reliability and fault tolerance.
- Evangelize a culture of “test failure before failure tests you” across the organization.
What we look for
-
Proven experience leading engineering teams in reliability, infrastructure, or distributed systems.
-
Hands-on experience with production load testing, chaos engineering, or large-scale system validation.
-
Experience with leveraging a chaos engineering vendor such as Gremlin, Harness, or something similar.
-
Strong understanding of failure modes in distributed systems, including latency, partial failure, and cascading outages.
-
Experience building or operating systems with strong safety guarantees (isolation, rate limiting, guardrails, auditability).
-
Familiarity with cloud-native environments (AWS, Kubernetes) and observability tooling.
-
Strong programming background (e.g., Python, Kotlin, Java, or similar).
-
Excellent problem-solving skills and the ability to balance long-term resilience investments with immediate business needs.
-
Strong communication and leadership skills, with a track record of influencing engineering practices across teams.
- This position requires either equivalent practical experience or a Bachelor’s degree in a related field.
Base Pay Grade - P
Equity Grade - 13
Employees new to Affirm typically come in at the start of the pay range. Affirm focuses on providing a simple and transparent pay structure which is based on a variety of factors, including location, experience and job-related skills.
Base pay is part of a total compensation package that may include equity rewards, monthly stipends for health, wellness and tech spending, and benefits (including 100% subsidized medical coverage, dental and vision for you and your dependents.)
USA base pay range (CA, WA, NY, NJ, CT) per year: 230,000 - 290,000
USA base pay range (all other U.S. states) per year: 204,000 - 264,000
#LI-Remote
Affirm is proud to be a remote-first company! The majority of our roles are remote and you can work almost anywhere within the country of employment. Affirmers in proximal roles have the flexibility to work remotely, but will occasionally be required to work out of their assigned Affirm office. A limited number of roles remain office-based due to the nature of their job responsibilities.
We’re extremely proud to offer competitive benefits that are anchored to our core value of people come first. Some key highlights of our benefits package include:
- Health care coverage - Affirm covers all premiums for all levels of coverage for you and your dependents
- Flexible Spending Wallets - generous stipends for spending on Technology, Food, various Lifestyle needs, and family forming expenses
- Time off - competitive vacation and holiday schedules allowing you to take time off to rest and recharge
- ESPP - An employee stock purchase plan enabling you to buy shares of Affirm at a discount
We believe It’s On Us to provide an inclusive interview experience for all, including people with disabilities. We are happy to provide reasonable accommodations to candidates in need of individualized support during the hiring process.
[For U.S. positions that could be performed in Los Angeles or San Francisco] Pursuant to the San Francisco Fair Chance Ordinance and Los Angeles Fair Chance Initiative for Hiring Ordinance, Affirm will consider for employment qualified applicants with arrest and conviction records.
By clicking "Submit Application," you acknowledge that you have read Affirm's Global Candidate Privacy Notice and hereby freely and unambiguously give informed consent to the collection, processing, use, and storage of your personal information as described therein.
How to Stand Out
- Highlight any prior work with chaos engineering tools (e.g., Gremlin) in your resume and be ready to discuss a specific experiment you ran.
- Prepare a short case study that shows how you identified a production weakness, designed a test, and implemented a fix.
- Demonstrate strong Python or Java code samples that illustrate automation of testing or safety mechanisms.
- Expect interviewers to probe your understanding of distributed‑system failure modes; review latency, partial failure, and cascade scenarios beforehand.
- When negotiating, emphasize the value of equity and remote‑work allowances, especially if you have a proven track record improving system reliability.
- Watch for vague descriptions of “on‑call” responsibilities; ask how often you’ll be expected to respond to incidents arising from your own experiments.
- Tailor your cover letter to affirm the cultural fit: a proactive, data‑driven mindset that prefers testing failure before it happens.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.