Back to evaluations
Public evaluation
mtp_tag_mapping_eval
Evaluates MTP manifest processing accuracy and generated SCADA mapping correctness.
Evaluation type
task based
Challenge
Orchestrate MTP Module Data Integration with LlamaIndex and Portia
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
mtp_tag_mapping_eval
Parses an MTP AML manifest and outputs standardized OPC UA node mapping JSON.
Input format
XML string containing MTP service and interface definitions
Output format
JSON array of { service_name, opc_node_id, data_type, access_level }