Back to evaluations
Draft evaluation

Account Aggregator Consent Analysis System using CrewAI and Claude 4.1 Opus — evaluation

Evaluates the CrewAI squad's accuracy in assessing portfolio diversification and verifying AA consent validity.

Evaluation type
task based
Challenge
Account Aggregator Consent Analysis System using CrewAI and Claude 4.1 Opus
Difficulty
Advanced
Rigor
Not declared

The author has not specified a rigor level.

Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

aa_consent_analysis_eval

Evaluates CrewAI crew's output on financial statement summary and consent verification.

Input format

JSON object with AA consent payload, asset allocation breakdown, and risk tolerance.

Output format

JSON object with consent_valid, equity_exposure_pct, debt_exposure_pct, and recommendation.