Back to evaluations
Draft evaluation

Implement a VASP License Risk Auditor with Pydantic AI & AI SDK — evaluation

Evaluates schema strictness and compliance rule checking against VASP submission documents.

Evaluation type
task based
Challenge
Implement a VASP License Risk Auditor with Pydantic AI & AI SDK
Difficulty
Intermediate
Rigor
Not declared

The author has not specified a rigor level.

Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

vasp_audit_eval

Validates compliance score and entity validation output for a VASP applicant.

Input format

JSON containing entity details and custody architecture

Output format

JSON conforming to strict Pydantic AuditResult model