Back to evaluations
Public evaluation
trial_safety_synthesis
Evaluates recall of identified adverse event safety signals from vaccine clinical trial papers.
Evaluation type
task based
Challenge
Vaccine Clinical Trial Literature Synthesizer with CrewAI and Daytona
Difficulty
Intermediate
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
trial_safety_synthesis
Extract all flagged adverse events and study design biases from clinical trial summaries.
Input format
JSON containing PubMed text abstracts of 5 vaccine trials.
Output format
JSON object with safety_signals list, risk_of_bias_assessment, and strategic_summary.