Skip to main content
Loading navigation
Back to challenges

Construct an Anti-Scam Fraud Triage Crew with CrewAI & Resemble AI

Public sector anti-scam units face escalating phone and voice impersonation attacks. Construct a CrewAI multi-agent workflow integrated with Resemble AI voice verification to analyze reported scam interactions, categorize fraud tactics, and output structured triage reports with a false positive rate under 3%.

Workflow AutomationHosted by Vera
Sign in free to start

What you are building

Build a CrewAI multi-agent anti-scam triage workflow using Resemble AI synthetic voice analysis to identify deepfake voice scams.

How work is evaluated

Evaluation

Evaluates the accuracy of scam classification and false positive rate in detecting synthetic voice impersonation attacks.

Datasets

Public datasets, plus the private datasets you have access to.

How submissions are scored

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

triage_priority_match

Checks if high-severity deepfake scams are assigned HIGH priority.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

false_positive_rate

Rate of legitimate calls misclassified as scams. • target: 0.01 • range: 0-0.03

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

  • Build role-based multi-agent teams using CrewAI for incident triage

  • Integrate audio forensic signals from Resemble AI into agent tools

  • Classify scam operational tactics according to national scam taxonomies

  • Produce automated actionable alert summaries for law enforcement agencies

Resources

Dataset notes

Synthetic multi-modal dataset containing 100 call transcripts paired with Resemble AI voice verification scores.

Challenge setup

Evaluates the accuracy of scam classification and false positive rate in detecting synthetic voice impersonation attacks.

Challenge input

JSON containing transcript and Resemble AI audio forensic scores

CrewAI

Facilitates multi-role collaborative agent workflows.

Resemble AI

Provides synthetic audio detection scores for voice scam triage.

Evaluated output

JSON triage report with scam taxonomy and priority score

Evaluation checks
  • Checks if high-severity deepfake scams are assigned HIGH priority.
  • Rate of legitimate calls misclassified as scams. • target: 0.01 • range: 0-0.03
Configured evaluation evidence
  • Benchmark: ScamDetectionBench
  • False Positive Rate target: 1%
  • 1 public reference case
Configured runtime
  • Python execution harness
  • Python sandbox (unavailable on Versalist)

Shows the first task, up to three tools, and up to three evidence items.

View technical recipe

Configured tools

Action Space
  • CrewAI · Required
  • crewAI · Optional
  • Resemble AI · Optional

Evaluation contract

  • triage_priority_match · Weight 1
  • false_positive_rate · Weight 1

Metrics

  • false_positive_rate · Target 0.01

Benchmarks

  • ScamDetectionBench
  • security

Reference cases

  • 1 public reference case

Workflow tasks

  1. Task 1

    Input: JSON containing transcript and Resemble AI audio forensic scores

    Output: JSON triage report with scam taxonomy and priority score

    Execution harness: Python

Evaluation tools

  • CrewAI · Agent Framework
  • Resemble AI · Audio Forensics Tool

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Construct an Anti-Scam Fraud Triage Crew with CrewAI & Resemble AI