Back to evaluations
Public evaluation
cyber_physical_eval
Evaluates whether the AutoGen conversation accurately identifies physical sensor manipulation in scenarios with clean network logs.
Evaluation type
task based
Challenge
Physical-Cyber Anomaly Diagnostic System for Water Plants with AutoGen
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
cyber_physical_eval
Injects physical telemetry incongruity with normal network logs into AutoGen debate.
Input format
JSON containing network_log_status and physical_flow_delta_pct.
Output format
JSON containing threat_category, consensus_reached, and recommended_action.