Back to evaluations
Draft evaluation
Vaccine Clinical Trial Literature Synthesizer with CrewAI and Daytona — evaluation
Evaluates recall of identified adverse event safety signals from vaccine clinical trial papers.
Evaluation type
task based
Challenge
Vaccine Clinical Trial Literature Synthesizer with CrewAI and Daytona
Difficulty
Intermediate
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
trial_safety_synthesis
Extract all flagged adverse events and study design biases from clinical trial summaries.
Input format
JSON containing PubMed text abstracts of 5 vaccine trials.
Output format
JSON object with safety_signals list, risk_of_bias_assessment, and strategic_summary.