Back to evaluations
Draft evaluation

AI SDK Software-Defined Controls Code Generator with DeepSeek R1 — evaluation

Evaluates code conversion precision, AST syntax validity, and functional equivalence of refactored control code.

Evaluation type
task based
Challenge
AI SDK Software-Defined Controls Code Generator with DeepSeek R1
Difficulty
Advanced
Rigor
Not declared

The author has not specified a rigor level.

Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

ladder_to_st_conversion

Convert input Ladder Logic string to IEC 61131-3 Structured Text.

Input format

JSON containing ladder_logic_rung (string) and I/O variable bindings

Output format

JSON containing structured_text (string), syntax_valid (bool), unit_tests_passed (bool)