RiskIdentification
The evaluation will assess the system's ability to accurately identify compliance risks in AI projects, provide justified recommendations, and generate comprehensive, well-structured compliance reports based on the given regulations and project details.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Task templates
Inputs and expected outputs.
RiskIdentification
Evaluate the system's ability to identify relevant compliance risks based on a project description and specific regulatory text.
JSON object: {'project_description': 'string', 'regulation_text': 'string'}
JSON object: {'identified_risks': [{'risk_type': 'string', 'severity': 'low|medium|high', 'justification': 'string', 'relevant_clauses': ['string']}]}
ComplianceReportGeneration
Assess the system's ability to generate a structured compliance report for a given AI project, including risks, recommendations, and evidence.
JSON object: {'project_name': 'string', 'project_description': 'string', 'identified_risks': [...]}
Markdown string of a compliance report, including summary, detailed risks, and mitigation strategies.