Back to evaluations
Draft evaluation
Orchestrate MTP Module Data Integration with LlamaIndex and Portia — evaluation
Evaluates MTP manifest processing accuracy and generated SCADA mapping correctness.
Evaluation type
task based
Challenge
Orchestrate MTP Module Data Integration with LlamaIndex and Portia
Difficulty
Advanced
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
mtp_tag_mapping_eval
Parses an MTP AML manifest and outputs standardized OPC UA node mapping JSON.
Input format
XML string containing MTP service and interface definitions
Output format
JSON array of { service_name, opc_node_id, data_type, access_level }