Back to evaluations
Public evaluation
isa_62443_audit_task
Evaluates multi-agent compliance auditing accuracy and prompt injection defense efficacy.
Evaluation type
task based
Challenge
CrewAI ISA/IEC 62443 Security Compliance Verification with Lakera
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
isa_62443_audit_task
Evaluate network boundary rules and text queries for security compliance and safety injections.
Input format
JSON with zone_definitions, conduit_rules, and text_queries containing prompt injection attempts
Output format
JSON with non_compliant_conduits (list), prompt_injection_blocked (bool), compliance_score (float)