Back to evaluations
Draft evaluation
Industry 4.0 Scale Bottleneck Analyzer using Google ADK and OpenAI o3 — evaluation
Evaluates the agent's ability to identify scaling bottlenecks and formulate compliant ISA-95 architectures.
Evaluation type
task based
Challenge
Industry 4.0 Scale Bottleneck Analyzer using Google ADK and OpenAI o3
Difficulty
Advanced
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
i40_scaling_eval_task
Parses plant pilot descriptions and outputs identified bottlenecks and architectural recommendations.
Input format
JSON object describing current pilot architecture, protocol specs, and data throughput
Output format
JSON report listing bottleneck_categories, uns_hierarchy, and migration_steps