Back to evaluations
Public evaluation
procurement_delay_eval
Evaluates Mastra AI agent's ability to trigger Retell AI voice synthesis calls and compute project delay impact based on call transcripts.
Evaluation type
task based
Challenge
Substation Procurement & Telemetry Agent with Mastra AI and Retell AI
Difficulty
Intermediate
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
procurement_delay_eval
Parses voice transcript from vendor check call and updates critical path schedule calculation.
Input format
JSON payload containing vendor call audio transcription and target component ID.
Output format
JSON payload detailing component status, updated delivery date, and total days delay impact.