Back to evaluations
Draft evaluation
Build a Voice-Enabled Substation Procurement RAG Agent with LlamaIndex and LiveKit — evaluation
Evaluates accuracy of answers extracted from substation contract PDFs and latency over LiveKit voice channel.
Evaluation type
task based
Challenge
Build a Voice-Enabled Substation Procurement RAG Agent with LlamaIndex and LiveKit
Difficulty
Advanced
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
substation_query_task
Query specific transformer ratings and breaker isolation protocols from contract index.
Input format
Audio chunk or audio transcript string query
Output format
JSON containing string response, source_node_id, latency_ms