Senior Adversarial Infrastructure Engineer
WFA Digital Insight
As the demand for sophisticated data infrastructure grows, companies like RevenueBase Inc are seeking experts who can build and maintain high-scale systems. With the rise of AI, the need for trustworthy data has never been more pressing. In this role, you'll be working on the cutting edge of data enumeration, using your skills in reverse-engineering and bot detection evasion to stay one step ahead. Candidates with experience in distributed systems, stealth engineering, and data pipeline management are in high demand, with some studies suggesting a 25% increase in job postings for these skills in the past year. Before applying, be prepared to showcase your technical expertise and ability to work in a fast-paced, autonomous environment.
Job Description
About the Role
The Senior Adversarial Infrastructure Engineer role at RevenueBase Inc is a unique opportunity to work on the development of high-scale data enumeration systems. As a key member of the team, you will be responsible for designing and deploying horizontally scalable scraping nodes, discovering hidden APIs, and implementing advanced techniques to bypass enterprise-grade bot detection. Your work will be critical to the success of RevenueBase's mission to provide trustworthy data for AI agents.The ideal candidate will have experience working in a remote environment and be comfortable with the concept of 'technical sovereignty,' where they are given the freedom to own the technical strategy and stack. You will be working against the highest level of web security in existence, making this a challenging and rewarding role for those who enjoy solving complex engineering problems.
What You Will Do
- Design and deploy horizontally scalable scraping nodes on AWS Lambda/Fargate or Kubernetes
- Discover hidden APIs and mobile backend endpoints using tools like Charles Proxy, Fiddler, or Burp Suite
- Implement advanced techniques to bypass enterprise-grade bot detection, including TLS fingerprinting, HTTP/2 headers, and browser fingerprinting evasion
- Manage large-scale residential and mobile proxy pools to ensure a sustained rate of 1M+ requests per hour
- Develop real-time monitoring to track success rates and 'burn' rates of proxy infrastructure
- Build and maintain distributed stealth systems capable of processing 1 million+ records per hour
- Stay up-to-date with the latest developments in anti-bot technologies and adjust the system accordingly
- Collaborate with the core team to ensure seamless handoff and maintenance of the system
- Continuously optimize the system for cost and success rate
What We Are Looking For
- Deep experience with Playwright/Puppeteer and custom HTTP clients for high-speed, headless extraction
- Massive scale experience, having managed data pipelines that process millions of requests daily
- Reverse engineering mastery, with the ability to deconstruct mobile apps or complex JavaScript bundles to find data endpoints
- Builder mindset, with a focus on building 'ghost' architecture that runs seamlessly in the background
- Experience with AWS Lambda/Fargate or Kubernetes
- Strong understanding of rate-limiting at the IP, session, and header level
- Familiarity with tools like curl_cffi and cycle-tls
- Excellent problem-solving skills and ability to work in a fast-paced environment
Nice to Have
- Experience with digital marketing and paid media
- Knowledge of AI and machine learning concepts
- Familiarity with agile development methodologies
- Certification in cloud computing or cybersecurity
Benefits and Perks
- Competitive compensation package
- Opportunity to work on cutting-edge technology and contribute to the development of trustworthy data infrastructure
- Collaborative and dynamic work environment
- Flexible working hours and remote work options
- Professional development opportunities and access to the latest tools and technologies
- Comprehensive health insurance and benefits package
- Generous paid time off and holiday package
How to Stand Out
- Be prepared to showcase your technical expertise in distributed systems, stealth engineering, and data pipeline management. Provide specific examples of your experience and how you can apply it to this role.
- Highlight your ability to work in a fast-paced, autonomous environment and your experience with remote work.
- Familiarize yourself with the latest developments in anti-bot technologies and be prepared to discuss how you would stay ahead of these technologies in this role.
- Emphasize your problem-solving skills and ability to think creatively to solve complex engineering problems.
- Research RevenueBase Inc and be prepared to discuss how your skills and experience align with the company's mission and values.
- Be prepared to discuss your experience with tools like AWS Lambda/Fargate or Kubernetes, and how you have used them in previous roles.
- Show your passion for building and maintaining high-scale systems and your enthusiasm for working on the cutting edge of data enumeration.
This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.