Back to evaluations
Public evaluation
claims_audit_task
Evaluate the fraud detection agent on synthetic Beryl property claims and satellite image vectors.
Evaluation type
task based
Challenge
Hurricane Claims Fraud Detection RAG Agent with LlamaIndex and Claude 4.1 Opus
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
claims_audit_task
Audits a hurricane claim against spatial-temporal wind gust data and image metadata.
Input format
JSON object containing claim_id, text_report, damage_date, geolocation, and ground_truth_imagery_ref
Output format
JSON object with fraud_score (0.0 to 1.0), reasoning_summary, and flag_status (BOOLEAN)