Back to evaluations
Public evaluation
ladder_to_st_conversion
Evaluates code conversion precision, AST syntax validity, and functional equivalence of refactored control code.
Evaluation type
task based
Challenge
AI SDK Software-Defined Controls Code Generator with DeepSeek R1
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
ladder_to_st_conversion
Convert input Ladder Logic string to IEC 61131-3 Structured Text.
Input format
JSON containing ladder_logic_rung (string) and I/O variable bindings
Output format
JSON containing structured_text (string), syntax_valid (bool), unit_tests_passed (bool)