Back to evaluations
Draft evaluation
Build Startup IPO Regulatory Auditor with LlamaIndex Advanced RAG — evaluation
Evaluates retrieval recall and factual correctness of risk analysis extracted from startup IPO filings.
Evaluation type
task based
Challenge
Build Startup IPO Regulatory Auditor with LlamaIndex Advanced RAG
Difficulty
Advanced
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
drhp_risk_extraction
Queries prospectus document index and extracts key financial risk clauses.
Input format
JSON containing company_name and target_metric string
Output format
JSON containing answer, source_chunk_id, and faithfulness_score