Back to evaluations
Public evaluation
plc_code_translation
Evaluates logical equivalence and execution correctness of translated PLC Structured Text code.
Evaluation type
task based
Challenge
AutoGen IEC 61131-3 Code Translation & Refactoring Multi-Agent System
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
plc_code_translation
Evaluates Python module translated from PLC Structured Text.
Input format
JSON object with st_code string and test_cases array
Output format
JSON object with python_code, tests_passed, and equivalence_score