Back to evaluations
Public evaluation

MHS Validation Test

Evaluates MHS compliance parsing accuracy, invalid action rejection rate, and validation throughput.

Evaluation type
task based
Challenge
Build an MHS Hardware Control Safety Adapter with Mastra AI and OpenAI o3
Difficulty
Advanced
Rigor
Unspecified

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

MHS Validation Test

Submits MHS control frames to the Mastra AI workflow and checks safety verdicts.

Input format

JSON array of MHS action payloads

Output format

JSON array of safety verdicts with latency metrics