Back to evaluations
Draft evaluation

Hurricane Claims Fraud Detection RAG Agent with LlamaIndex and Claude 4.1 Opus — evaluation

Evaluate the fraud detection agent on synthetic Beryl property claims and satellite image vectors.

Evaluation type
task based
Challenge
Hurricane Claims Fraud Detection RAG Agent with LlamaIndex and Claude 4.1 Opus
Difficulty
Advanced
Rigor
Not declared

The author has not specified a rigor level.

Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

claims_audit_task

Audits a hurricane claim against spatial-temporal wind gust data and image metadata.

Input format

JSON object containing claim_id, text_report, damage_date, geolocation, and ground_truth_imagery_ref

Output format

JSON object with fraud_score (0.0 to 1.0), reasoning_summary, and flag_status (BOOLEAN)