Challenge

AutoGen Multi-Agent Factory Scaling Assistant for Equipment Rollouts

Scaling Industry 4.0 initiatives across multi-factory sites frequently fails due to fragmented machine configuration models. Develop a multi-agent conversational system using AutoGen to harmonize OPC UA tags and standardize downtime categorization logic across facilities. The system must achieve 95% alignment on asset taxonomy mappings across five simulated factory sites.

EngineeringHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Deploy an AutoGen multi-agent group chat (Factory Architect, OPC UA Specialist, Maintenance Lead) to resolve equipment taxonomy mismatches across multi-plant deployments.

Delivery guide

How work is evaluated

Evaluation

Evaluates multi-agent group chat consensus rate and OPC UA tag harmonization precision across distinct plant schemas.

Datasets

Shared data for this challenge

Review public datasets and any private uploads tied to your build.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

schema_harmonization

Ensures all local tags are mapped to non-null unified tag definitions

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

taxonomy_alignment_score

Accuracy of tag categorization against reference standard • target: 0.95 • range: 0-1

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Configure an AutoGen `GroupChat` with specialized industrial roles

  • Harmonize disparate factory OPC UA tag naming conventions (e.g., ISO 14224 standard)

  • Standardize downtime cause codes across distinct plant MES instances

  • Automate consensus-building and output unified asset taxonomy schemas

Resources and assets

Reference links and supporting material

Dataset notes

Heterogeneous tag export datasets from five manufacturing plants containing unstandardized PLC and MES tags.

How this agent runs

Evaluates multi-agent group chat consensus rate and OPC UA tag harmonization precision across distinct plant schemas.

Challenge input

JSON object with array of plant_schemas containing raw local tag names and descriptions

AutoGen

Assigned framework for conversational multi-agent systems.

Evaluated output

JSON object mapping local tags to standardized_opc_tag and iso_14224_category

Checks for
  • Ensures all local tags are mapped to non-null unified tag definitions
  • Accuracy of tag categorization against reference standard • target: 0.95 • range: 0-1
Proof of success
  • Benchmark: Multi-Plant Taxonomy Harmonization Benchmark
  • Taxonomy Alignment Score target: 0.95
  • 1 public reference case
Runtime evidence
  • Python execution harness
  • Python sandbox (unavailable on Versalist)
View technical recipe

Configured tools

Action Space
  • AutoGen · Required
  • Microsoft AutoGen · Optional

Evaluation contract

  • schema_harmonization · Weight 1
  • taxonomy_alignment_score · Weight 1

Recipe state

This is a preview. The configuration can change before the evaluation recipe is locked.

Frequently Asked Questions about AutoGen Multi-Agent Factory Scaling Assistant for Equipment Rollouts