Back to evaluations
Draft evaluation

CrewAI OSHA Plant Safety Audit Crew with Specialized Expert Roles — evaluation

Evaluates precision and recall of OSHA non-compliance safety violation detection.

Evaluation type
task based
Challenge
CrewAI OSHA Plant Safety Audit Crew with Specialized Expert Roles
Difficulty
Intermediate
Rigor
Not declared

The author has not specified a rigor level.

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

osha_safety_audit

Evaluates CrewAI safety report against ground truth safety violations in work order text.

Input format

JSON object with work_orders array and safety_log_text

Output format

JSON object with violations_found, osha_clause_citations, and overall_risk_score