Back to evaluations
Public evaluation

SkillProofDocumentGeneration

The evaluation module will assess the Mastra AI agent's ability to generate accurate, well-structured 'SkillProof' documents and correctly apply verification logic. Focus areas include document content quality, adherence to schema, and verification accuracy.

Evaluation type
task based
Challenge
SkillProof Document Agent
Difficulty
Intermediate
Rigor
Unspecified
Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
2
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

SkillProofDocumentGeneration

Evaluate the agent's ability to generate a 'SkillProof' document given a user's skill description.

Input format

{"skill_description": "string", "user_profile": {"name": "string", "experience_years": "number"}}

Output format

{"document_json": {"skill_name": "string", "proficiency_level": "string", "description_generated": "string", "vibe_coding_assessment": "string"}}

Task 2

ProficiencyVerification

Evaluate the agent's ability to verify a generated skill proficiency using a custom tool.

Input format

{"skill_name": "string", "proficiency_level": "string", "verification_threshold": "number"}

Output format

{"verification_status": "string", "verification_score": "number", "verified_by": "string"}