Physical-Cyber Anomaly Diagnostic System for Water Plants with AutoGen
Water treatment plants face silent physical threats like sensor tampering that occur without network security breaches. Implement a multi-agent conversational simulation using AutoGen where Physical Process Diagnostic and Network Security agents debate and isolate uncompromised physical attacks versus cyber intrusions.
What you are building
The core problem, expected build, and operating context for this challenge.
Develop an AutoGen multi-agent debate system to distinguish physical sensor spoofing from network cyber intrusions in municipal water networks.
How work is evaluated
Evaluates whether the AutoGen conversation accurately identifies physical sensor manipulation in scenarios with clean network logs.
Shared data for this challenge
Review public datasets and any private uploads tied to your build.
How submissions are scored
These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.
threat_classification_match
Verifies threat is correctly categorized as physical vs cyber.
This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.
debate_convergence_turns
Number of conversation turns required to reach accurate consensus. • target: 4 • range: 1-10
This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.
What you should walk away with
Build AutoGen multi-agent conversational loops between OT domain specialists
Simulate physical process dynamics vs network packet verification
Detect sensor drift and signal spoofing absent of IT/OT network compromise
Formulate localized safety isolation procedures for water plant operators
Reference links and supporting material
Paired network firewall logs and physical water flow/pH/pressure sensor streams from test water treatment plants.
How this agent runs
Evaluates whether the AutoGen conversation accurately identifies physical sensor manipulation in scenarios with clean network logs.
Challenge input
JSON containing network_log_status and physical_flow_delta_pct.
AutoGen
Enables multi-turn conversational debate and group consensus mechanisms.
Evaluated output
JSON containing threat_category, consensus_reached, and recommended_action.
- Verifies threat is correctly categorized as physical vs cyber.
- Number of conversation turns required to reach accurate consensus. • target: 4 • range: 1-10
- Benchmark: Cyber-Physical Threat Isolation Benchmark
- Debate Convergence Turns target: 4
- 1 public reference case
- Python execution harness
- Python sandbox (unavailable on Versalist)
View technical recipe
Configured tools
- AutoGen · Required
- Microsoft AutoGen · Optional
Evaluation contract
- threat_classification_match · Weight 1
- debate_convergence_turns · Weight 1
Recipe state
This is a preview. The configuration can change before the evaluation recipe is locked.