Back to evaluations
Draft evaluation
Build an MHS Hardware Control Safety Adapter with Mastra AI and OpenAI o3 — evaluation
Evaluates MHS compliance parsing accuracy, invalid action rejection rate, and validation throughput.
Evaluation type
task based
Challenge
Build an MHS Hardware Control Safety Adapter with Mastra AI and OpenAI o3
Difficulty
Advanced
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
MHS Validation Test
Submits MHS control frames to the Mastra AI workflow and checks safety verdicts.
Input format
JSON array of MHS action payloads
Output format
JSON array of safety verdicts with latency metrics