Back to evaluations
Draft evaluation
Salalah AI & Hydrogen Knowledge RAG Assistant using LlamaIndex — evaluation
Evaluates accuracy of query answer retrieval and faithfulness against Salalah energy paper ground truth.
Evaluation type
task based
Challenge
Salalah AI & Hydrogen Knowledge RAG Assistant using LlamaIndex
Difficulty
Beginner
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
rag_retrieval_eval
Queries LlamaIndex engine on 2050 power demand projections and validates citation.
Input format
JSON object with user query string.
Output format
JSON object with retrieved_answer, cited_year, and projected_demand_growth.