Back to evaluations
Public evaluation
MHS Validation Test
Evaluates MHS compliance parsing accuracy, invalid action rejection rate, and validation throughput.
Evaluation type
task based
Challenge
Build an MHS Hardware Control Safety Adapter with Mastra AI and OpenAI o3
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
MHS Validation Test
Submits MHS control frames to the Mastra AI workflow and checks safety verdicts.
Input format
JSON array of MHS action payloads
Output format
JSON array of safety verdicts with latency metrics