Safeguards Policy Analyst, Fraud & Scams

AnthropicAnthropic·Remote(Remote-Friendly (Travel-Required) | San Francisco, CA | New York City, NY)
Data & Analytics

WFA Digital Insight

The demand for digital safeguards specialists has seen significant growth, with a focus on protecting against fraud and scams in the AI sector. As companies like Anthropic lead the way in AI development, experts who can navigate the complex landscape of online threats are in high demand. With the remote job market offering more flexibility than ever, professionals with a keen eye for policy development and a strong background in digital skills are well-positioned for success. Anthropic stands out for its commitment to creating reliable and interpretable AI systems, making this role an exciting opportunity for those passionate about AI safety.

Job Description

About the Role

The Safeguards Policy Analyst focused on Fraud & Scams is a critical position at Anthropic, dedicated to designing, building, and executing enforcement workflows that detect and mitigate fraud and scam-related harms on Anthropic's products. This role requires a deep understanding of fraud typologies, scam ecosystems, and the threat actors who perpetrate them, translating that expertise into durable and scalable policies. The successful candidate will serve as a subject matter expert within the Integrity & Authenticity team, working closely with threat investigative and enforcement teams to develop guidelines that power classifiers and drive content moderation efforts.

As part of the I&A team, the policy analyst will function both as a policy owner and work in tandem with cross-functional teams to ensure that policies are effective, up-to-date, and aligned with Anthropic's mission to create beneficial AI systems. The role involves working in a dynamic environment where no two days are alike, requiring adaptability, strong analytical skills, and the ability to stay current with the ever-evolving fraud and scam landscape.

What You Will Do

  • Draft, maintain, and iterate on Fraud & Scams policies governing Anthropic's products and APIs, ensuring clarity for both model enforcement and human reviewers.
  • Conduct regular structured policy reviews to identify gaps, ambiguities, and coverage failures, leading the process to close them.
  • Develop detailed threat models for fraud and scam vectors, including social engineering, financial fraud, impersonation scams, phishing, and AI-enabled fraud, and translate these into enforceable policy language.
  • Stay current on the fraud and scam landscape, including emerging typologies, regulatory shifts, and threat actor tactics, techniques, and procedures (TTPs).
  • Design and architect automated enforcement systems and human review workflows that scale effectively while maintaining high precision and recall.
  • Review flagged content to drive enforcement decisions and surface policy improvements grounded in real-world cases.
  • Define and manage precision/recall tradeoffs in enforcement, working with data science teams to continuously tune classifiers and detection signals.
  • Build and maintain an effective feedback loop between threat intelligence, policy, and enforcement operations to ensure timely response to novel and evolving fraud threats.
  • Serve as the primary policy point of contact for ML and Engineering teams developing fraud detection classifiers, working to translate policy intent into technical artifacts and training signals.
  • Partner with Product, Engineering, and Data Science teams to optimize detection models, automated enforcement pipelines, and tooling for fraud-specific policy violations.
  • Collaborate with external researchers, law enforcement liaisons, and fraud SMEs to gather feedback on policy effectiveness and emerging risk areas.

What We Are Looking For

  • 3+ years of experience in policy development, enforcement, or a related field, preferably in the tech industry.
  • Strong understanding of fraud and scam typologies, including social engineering, phishing, and AI-enabled fraud.
  • Experience with policy development, enforcement strategies, and content moderation.
  • Excellent analytical and problem-solving skills, with the ability to interpret complex data and translate it into actionable insights.
  • Strong communication skills, with the ability to collaborate with cross-functional teams and external partners.
  • Ability to work in a fast-paced environment, adapting to changing priorities and deadlines.
  • Familiarity with regulatory requirements and industry standards related to fraud and scam prevention.

Nice to Have

  • Experience working with AI systems, machine learning models, or natural language processing technologies.
  • Knowledge of programming languages such as Python or SQL.
  • Certification in fraud prevention, cybersecurity, or a related field.
  • Experience working in a remote or distributed team environment.

Benefits and Perks

  • Competitive salary and equity package.
  • Opportunity to work with a leading AI company dedicated to creating beneficial and safe AI systems.
  • Collaborative and dynamic work environment with a team of experienced professionals.
  • Flexible remote work options, with the possibility of working from anywhere in the world.
  • Access to cutting-edge technologies and tools to support your work.
  • Continuous learning and professional development opportunities.
  • Comprehensive health insurance and benefits package.
  • Generous PTO and holiday policy.

How to Stand Out

  • Develop a strong understanding of fraud and scam typologies, including the latest trends and technologies used by threat actors.
  • Build a portfolio of your policy development and enforcement work, highlighting your ability to translate complex data into actionable insights.
  • Prepare to discuss your experience with regulatory requirements and industry standards related to fraud and scam prevention.
  • Emphasize your analytical and problem-solving skills, and be ready to provide examples of how you've applied these skills in previous roles.
  • Show enthusiasm for working in a fast-paced environment and adapting to changing priorities and deadlines.
  • Highlight any experience working with AI systems, machine learning models, or natural language processing technologies, as these are highly valued in this role.

This is a remote position listed on WFA Digital, the platform for professionals who work from anywhere. Browse more remote jobs across all categories.