Back to evaluations
Public evaluation
Financial Model Generation and Auditability
Evaluation will assess the LlamaIndex agent's accuracy in financial modeling, the completeness and clarity of its audit trails, and its ability to handle structured financial data.
Evaluation type
task based
Challenge
Agent for Auditable Financial Model Generation
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
Financial Model Generation and Auditability
Evaluate if the LlamaIndex agent correctly generates a simple financial model (e.g., revenue projection) from raw data and provides a clear audit trail of its calculations.
Input format
{'financial_data_csv': 'string (CSV content)', 'model_parameters': 'dict'}
Output format
{'financial_model_output': 'dict', 'audit_trail': 'list of strings', 'summary': 'string'}