Back to evaluations
Public evaluation
SimulatedExperimentExecution
Evaluation will focus on the correctness of the multi-agent system's workflow, the accuracy of its scientific outputs, proper tool utilization, and the robustness of agent communication.
Evaluation type
task based
Challenge
Automate Life Sciences Research
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
SimulatedExperimentExecution
The agent system generates a hypothesis, designs a simulated experiment, executes it via MCP tools, and analyzes the results.
Input format
{ 'research_topic': 'Immunotherapy for Glioblastoma', 'available_tools': ['sim_benchling_api', 'sim_spectrometer_api'] }
Output format
{ 'hypothesis': '...', 'experimental_design': '...', 'simulated_results': '{...}', 'analysis_report': '...', 'conclusion': '...' }