Back to evaluations
Draft evaluation
Construct an Anti-Scam Fraud Triage Crew with CrewAI & Resemble AI — evaluation
Evaluates the accuracy of scam classification and false positive rate in detecting synthetic voice impersonation attacks.
Evaluation type
task based
Challenge
Construct an Anti-Scam Fraud Triage Crew with CrewAI & Resemble AI
Difficulty
Intermediate
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
scam_triage_eval
Evaluates audio artifact parsing and scam classification accuracy.
Input format
JSON containing transcript and Resemble AI audio forensic scores
Output format
JSON triage report with scam taxonomy and priority score