Back to evaluations
Public evaluation

tag_harmonization_task

Evaluates multi-agent group chat consensus rate and OPC UA tag harmonization precision across distinct plant schemas.

Evaluation type
task based
Challenge
AutoGen Multi-Agent Factory Scaling Assistant for Equipment Rollouts
Difficulty
Advanced
Rigor
Unspecified

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

tag_harmonization_task

Harmonize non-standard plant tag schemas into a single unified OPC UA node map.

Input format

JSON object with array of plant_schemas containing raw local tag names and descriptions

Output format

JSON object mapping local tags to standardized_opc_tag and iso_14224_category