Back to evaluations
Public evaluation
ilw_trigger_verification
Assess trigger execution accuracy and verify absence of false positives across storm scenario test suite.
Evaluation type
task based
Challenge
Industry Loss Warranty Trigger Verifier using LangChain and LangGraph
Difficulty
Intermediate
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
ilw_trigger_verification
Determine if catastrophe event satisfies contract trigger terms without false positives.
Input format
JSON containing official industry loss report and physical sensor metadata
Output format
JSON trigger evaluation decision with timing and verification metrics