OSHA Plant Safety Audit Multi-Agent System with AutoGen
Manufacturing facilities face heavy penalties and worker safety hazards when asset management practices diverge from OSHA compliance standards. Construct an automated safety compliance system using Microsoft AutoGen to cross-examine machinery asset logs against regulatory safety standards and output actionable audit reports.
What you are building
The core problem, expected build, and operating context for this challenge.
Build an interactive multi-agent conversation framework using AutoGen to execute OSHA regulatory compliance audits on factory maintenance records.
How work is evaluated
Evaluates multi-agent AutoGen debate output for accurate detection of OSHA LOTO protocol violations.
Shared data for this challenge
Review public datasets and any private uploads tied to your build.
How submissions are scored
These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.
citation_accuracy
Verifies correct OSHA 1910 standard is cited for LOTO failure.
This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.
hazard_detection_recall
Recall metric of non-compliant maintenance logs identified • target: 0.98 • range: 0-1
This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.
What you should walk away with
Set up AutoGen ConversableAgents representing Auditor, Plant Engineer, and Safety Regulator
Parse equipment maintenance histories, Lockout/Tagout (LOTO) logs, and PPE compliance records
Identify OSHA standards non-compliance (e.g., 29 CFR 1910.147 Control of Hazardous Energy)
Synthesize unified plant safety remediation plans with priority hazard indices
Reference links and supporting material
Factory maintenance logs containing normal servicing actions and safety protocol omissions.
How this agent runs
Evaluates multi-agent AutoGen debate output for accurate detection of OSHA LOTO protocol violations.
Challenge input
JSON object with asset_id, action_logged, loto_applied, ppe_verified
AutoGen
Microsoft framework for building multi-agent conversational systems
Evaluated output
JSON object with compliant (boolean), citation (string), risk_level (string)
- Verifies correct OSHA 1910 standard is cited for LOTO failure.
- Recall metric of non-compliant maintenance logs identified • target: 0.98 • range: 0-1
- Benchmark: OSHA-SafetyAudit-2025
- Hazard Detection Recall target: 0.98
- 1 public reference case
- Python execution harness
- Python sandbox (unavailable on Versalist)
View technical recipe
Configured tools
- AutoGen · Required
- Microsoft AutoGen · Optional
Evaluation contract
- citation_accuracy · Weight 1
- hazard_detection_recall · Weight 1
Recipe state
This is a preview. The configuration can change before the evaluation recipe is locked.