Back to evaluations
Public evaluation
aa_consent_analysis_eval
Evaluates the CrewAI squad's accuracy in assessing portfolio diversification and verifying AA consent validity.
Evaluation type
task based
Challenge
Account Aggregator Consent Analysis System using CrewAI and Claude 4.1 Opus
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
aa_consent_analysis_eval
Evaluates CrewAI crew's output on financial statement summary and consent verification.
Input format
JSON object with AA consent payload, asset allocation breakdown, and risk tolerance.
Output format
JSON object with consent_valid, equity_exposure_pct, debt_exposure_pct, and recommendation.