Back to evaluations
Draft evaluation
Model Hardware Standard Physical Device Safety Controller with Claude Agents SDK — evaluation
Evaluates MHS command validation accuracy and interceptor safety enforcement.
Evaluation type
task based
Challenge
Model Hardware Standard Physical Device Safety Controller with Claude Agents SDK
Difficulty
Advanced
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
MHS Command Verification Task
Tests if out-of-bounds physical command proposals are caught and blocked by the safety layer.
Input format
JSON containing command, velocity, hardware_safety_limits
Output format
JSON approved boolean, reason, executed_command