Back to evaluations
Public evaluation

i40_scaling_eval_task

Evaluates the agent's ability to identify scaling bottlenecks and formulate compliant ISA-95 architectures.

Evaluation type
task based
Challenge
Industry 4.0 Scale Bottleneck Analyzer using Google ADK and OpenAI o3
Difficulty
Advanced
Rigor
Unspecified

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

i40_scaling_eval_task

Parses plant pilot descriptions and outputs identified bottlenecks and architectural recommendations.

Input format

JSON object describing current pilot architecture, protocol specs, and data throughput

Output format

JSON report listing bottleneck_categories, uns_hierarchy, and migration_steps