Back to evaluations
Draft evaluation
LlamaIndex Construction Risk: Underwriting Knowledge Transfer Engine — evaluation
Evaluates RAG retrieval precision and extraction speed on commercial policy documents.
Evaluation type
task based
Challenge
LlamaIndex Construction Risk: Underwriting Knowledge Transfer Engine
Difficulty
Intermediate
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
construction_portfolio_transfer_audit
Extracts policy summary, total exposure, and non-compete risk status from portfolio docs.
Input format
PDF document texts representing construction policies
Output format
JSON containing aggregate_exposure_usd, total_accounts, high_risk_accounts