Back to evaluations
Draft evaluation
Plug-and-Produce MTP Module Orchestration with AutoGen and Arcee AI — evaluation
Evaluates multi-agent group conversation accuracy in mapping recipe demands to available MTP process modules.
Evaluation type
task based
Challenge
Plug-and-Produce MTP Module Orchestration with AutoGen and Arcee AI
Difficulty
Advanced
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
mtp_orchestration_task
Processes MTP dynamic manifests and creates an execution matrix for a target chemical recipe.
Input format
JSON with recipe requirements and list of MTP manifest XML strings
Output format
JSON execution sequence detailing mapped service_id, module_id, and OPC UA endpoint