Challenge

CrewAI OSHA Plant Safety Audit Crew with Specialized Expert Roles

Scaling Industry 4.0 applications requires strict adherence to workplace safety standards like OSHA 1910. Construct a collaborative CrewAI team featuring an OSHA Inspector, Safety Engineer, and Operations Lead to audit plant floor inspection logs. Success is measured by achieving 95%+ precision in identifying OSHA non-compliance events across factory floor operational logs.

EngineeringHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Orchestrate a CrewAI multi-agent team with distinct safety inspection roles to audit industrial telemetry and work order logs against OSHA standards.

Delivery guide

How work is evaluated

Evaluation

Evaluates precision and recall of OSHA non-compliance safety violation detection.

Datasets

Shared data for this challenge

Review public datasets and any private uploads tied to your build.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

citation_present

Ensures output includes accurate 29 CFR 1910 citation strings.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

audit_f1_score

F1 score of identified safety violations against true risk incidents. • target: 0.95 • range: 0-1

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Formulate specialized CrewAI Agents with explicit roles, goals, and backstories.

  • Assign structured Tasks for auditing Lockout/Tagout (LOTO) and machine guarding logs.

  • Synthesize crew findings into an executive plant safety risk score report.

  • Validate audit findings against published OSHA 1910 standard guidelines.

Resources and assets

Reference links and supporting material

Dataset notes

Factory maintenance work order logs and incident reports containing embedded safety policy violations.

How this agent runs

Evaluates precision and recall of OSHA non-compliance safety violation detection.

Challenge input

JSON object with work_orders array and safety_log_text

CrewAI

Required framework for building role-playing agent crews with collaborative tasks.

Evaluated output

JSON object with violations_found, osha_clause_citations, and overall_risk_score

Checks for
  • Ensures output includes accurate 29 CFR 1910 citation strings.
  • F1 score of identified safety violations against true risk incidents. • target: 0.95 • range: 0-1
Proof of success
  • Benchmark: OSHAAuditBench-2026
  • Audit F1 Score target: 0.95
  • 1 public reference case
Runtime evidence
  • Python execution harness
  • Python sandbox (unavailable on Versalist)
View technical recipe

Configured tools

Action Space
  • CrewAI · Required
  • crewAI · Optional

Evaluation contract

  • citation_present · Weight 1
  • audit_f1_score · Weight 1

Recipe state

This is a preview. The configuration can change before the evaluation recipe is locked.

Frequently Asked Questions about CrewAI OSHA Plant Safety Audit Crew with Specialized Expert Roles