Back to evaluations
Public evaluation

MultiAgentSystemInitialization

Participants will submit their code, a detailed report on the multi-agent system architecture, the iterative optimization process, and the top 10 optimized lead compounds with their predicted properties. Evaluation will prioritize the robustness of the multi-agent framework, the novelty and quality of the generated compounds, and the predictive accuracy of the integrated models.

Evaluation type
task based
Challenge
Accelerating Obesity Drug Lead Optimization
Difficulty
Advanced
Rigor
Unspecified

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
3
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

MultiAgentSystemInitialization

Initialize the CAMEL multi-agent system with defined agents and roles for drug optimization.

Input format

JSON with 'target_protein_id': string, 'initial_lead_SMILES': string.

Output format

JSON with 'agents_initialized': boolean, 'initial_dialogue_summary': string.

Task 2

LeadOptimizationIteration

Execute one iteration of the multi-agent lead optimization process, generating new compounds and predicting properties.

Input format

JSON with 'current_lead_SMILES': string, 'iteration_number': integer.

Output format

JSON array of objects, each with 'SMILES', 'binding_affinity_score', 'ADMET_profile': dictionary.

Task 3

PineconeIntegrationAndSearch

Store optimized lead compounds in Pinecone and perform a similarity search.

Input format

JSON array of objects, each with 'SMILES', 'embedding': array of floats, 'properties': dictionary, 'query_SMILES': string for similarity search.

Output format

JSON array of objects, each with 'SMILES', 'score': float (similarity).