Back to evaluations
Public evaluation

Simulated Anomaly Detection

The evaluation will assess the multi-agent system's ability to accurately detect and report simulated security anomalies, its robustness in handling diverse data, and the clarity of its output.

Evaluation type
task based
Challenge
Multi-Agent System for Internal Security Anomaly Detection
Difficulty
Advanced
Rigor
Unspecified
Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

Simulated Anomaly Detection

Evaluate if the agent system correctly identifies a predefined security incident based on a set of simulated logs and news articles.

Input format

{'access_logs': 'list of strings', 'email_samples': 'list of strings', 'news_articles': 'list of strings'}

Output format

{'anomaly_detected': 'boolean', 'report_summary': 'string', 'confidence_score': 'float'}