ContentComplianceCheck
The evaluation will assess the Claude Agent system's ability to accurately detect policy violations in simulated real-time content streams, correctly interpret complex regulatory guidelines, and trigger appropriate compliance actions within specified time limits. It will also evaluate the agent's reasoning process and explanation capabilities.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Task templates
Inputs and expected outputs.
ContentComplianceCheck
Evaluates the agent's ability to identify policy violations in a given content input (text or audio transcription) and recommend an action.
{'content_type': 'text|audio_transcription', 'content_data': 'string', 'policy_rules': ['string'], 'time_limit_minutes': 'int'}
{'decision': 'compliant|violating', 'violation_type': 'string', 'explanation': 'string', 'recommended_action': 'string'}