ImpactAssessmentReport
Evaluation will assess the quality and comprehensiveness of the multi-agent system's mental health impact assessment, the ethical soundness of proposed mitigation strategies, and the overall collaborative effectiveness of the CrewAI team. The use of RAG, extended thinking, and MCP tools will be closely examined.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Task templates
Inputs and expected outputs.
ImpactAssessmentReport
Generate a comprehensive report assessing the potential mental health impacts of a specific generative AI application.
{'ai_application_description': 'Description of the AI model/application', 'focus_areas': ['anxiety', 'social_comparison', 'information_overload']}
{'report': {'executive_summary': '...', 'identified_impacts': [{'impact': '...', 'mechanisms': '...', 'severity': '...', 'evidence_sources': ['...']}], 'mitigation_strategies': [{'strategy': '...', 'responsible_agent': '...', 'tools_used': ['...']}], 'ethical_considerations': ['...']}}
PolicyRecommendationGeneration
Formulate policy recommendations to mitigate identified mental health risks, based on the assessment report.
{'impact_assessment_report': {...}, 'relevant_policies_db_access': 'MCP_PolicyDB_API'}
{'policy_recommendations': [{'area': 'regulation', 'recommendation': '...', 'justification': '...', 'agents_involved': ['...']}]}