Back to evaluations
Draft evaluation

Build an MHS Hardware Control Safety Adapter with Mastra AI and OpenAI o3 — evaluation

Evaluates MHS compliance parsing accuracy, invalid action rejection rate, and validation throughput.

Evaluation type
task based
Challenge
Build an MHS Hardware Control Safety Adapter with Mastra AI and OpenAI o3
Difficulty
Advanced
Rigor
Not declared

The author has not specified a rigor level.

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

MHS Validation Test

Submits MHS control frames to the Mastra AI workflow and checks safety verdicts.

Input format

JSON array of MHS action payloads

Output format

JSON array of safety verdicts with latency metrics