Back to evaluations
Public evaluation

isa62443_config_audit

Evaluates detection of cybersecurity policy violations in network switch and PLC firewall configurations.

Evaluation type
task based
Challenge
Google ADK ISA/IEC 62443 Security Compliance Agent with Patronus AI
Difficulty
Advanced
Rigor
Unspecified
Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

isa62443_config_audit

Audits input switch config string for ISA/IEC 62443 compliance violations.

Input format

JSON object with device_id and config_text

Output format

JSON object with compliant_flag, violations, and patronus_eval_score