Back to evaluations
Public evaluation
i40_scaling_eval_task
Evaluates the agent's ability to identify scaling bottlenecks and formulate compliant ISA-95 architectures.
Evaluation type
task based
Challenge
Industry 4.0 Scale Bottleneck Analyzer using Google ADK and OpenAI o3
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
i40_scaling_eval_task
Parses plant pilot descriptions and outputs identified bottlenecks and architectural recommendations.
Input format
JSON object describing current pilot architecture, protocol specs, and data throughput
Output format
JSON report listing bottleneck_categories, uns_hierarchy, and migration_steps