Build a LlamaIndex Traditional Medicine Clinical Research Auditor
Standardizing research literature in traditional medicine requires automated evaluation of clinical study design and outcomes. Build a LlamaIndex RAG audit engine that indexes scientific journals and outputs trial validity scores with 90% extraction precision.
What you are building
The core problem, expected build, and operating context for this challenge.
Construct a LlamaIndex audit workflow that analyzes traditional medicine clinical trial publications against WHO trial reporting standards.
How work is evaluated
Evaluates clinical trial parameter extraction and score assignment precision.
Shared data for this challenge
Review public datasets and any private uploads tied to your build.
How submissions are scored
These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.
methodology_check
Verifies placebo parameter detection
This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.
extraction_precision
Precision ratio of extracted clinical trial variables • target: 0.94 • range: 0-1
This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.
What you should walk away with
Construct LlamaIndex document graph structures over clinical research PDFs
Extract sample sizes, control groups, and statistical significance measures
Evaluate trial design against CONSORT and WHO research standards
Output structured research credibility indexes
Reference links and supporting material
Synthetic medical research publications on traditional medicine formulations.
How this agent runs
Evaluates clinical trial parameter extraction and score assignment precision.
Challenge input
JSON trial paper text object
LlamaIndex
Structured information extraction engine
Evaluated output
JSON audit report with sample_size, placebos_used, and trial_grade
- Verifies placebo parameter detection
- Precision ratio of extracted clinical trial variables • target: 0.94 • range: 0-1
- Benchmark: Biomedical Paper Extraction Benchmark
- Extraction Precision target: 0.94
- 1 public reference case
- Python execution harness
- Python sandbox (unavailable on Versalist)
View technical recipe
Configured tools
- Llama Index · Required
- AutoML (H2O) · Optional
- All Hands AI · Optional
Evaluation contract
- methodology_check · Weight 1
- extraction_precision · Weight 1
Recipe state
This is a preview. The configuration can change before the evaluation recipe is locked.