Challenge

Precision Target Prioritization Agent

Design a target-disease prioritization system that leverages the Claude Agents SDK's 'Extended Thinking' capabilities to reason over complex genetic evidence. Your agent will interface with the Open Targets GraphQL API to retrieve genetic constraint scores (pLI), target-disease association scores, and drug tractability data. Using the o4-mini model for rapid data parsing within the agent loop, the system must prioritize therapeutic targets for specific diseases based on evidence strength and clinical tractability. The challenge involves writing a GraphQL planner that dynamically constructs queries to minimize data transfer while maximizing information gain (e.g., fetching L2G scores for specific variants). Claude will then synthesize this data to explain 'why' a specific target is prioritized, citing genetic scores and clinical trial status.

Frontier Science & ResearchHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Design a target-disease prioritization system that leverages the Claude Agents SDK's 'Extended Thinking' capabilities to reason over complex genetic evidence. Your agent will interface with the Open Targets GraphQL API to retrieve genetic constraint scores (pLI), target-disease association scores, and drug tractability data. Using the o4-mini model for rapid data parsing within the agent loop, the system must prioritize therapeutic targets for specific diseases based on evidence strength and clinical tractability. The challenge involves writing a GraphQL planner that dynamically constructs queries to minimize data transfer while maximizing information gain (e.g., fetching L2G scores for specific variants). Claude will then synthesize this data to explain 'why' a specific target is prioritized, citing genetic scores and clinical trial status.

Datasets

Shared data for this challenge

Review public datasets and any private uploads tied to your build.

Loading datasets...
Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

GraphQL Validity

Ensures the agent generates syntactically correct GraphQL queries.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

Ranking Precision

Correlation between agent ranking and Open Targets platform ranking. • target: 0.9 • range: 0-1

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Design a Claude-based agent that uses the 'thinking' parameter to deliberate on the importance of genetic constraint (pLI) versus disease association scores

  • Implement a Python-based GraphQL client that the agent uses to fetch nested 'target' and 'disease' objects

  • Leverage the o4-mini model to parse large JSON responses from Open Targets and extract key 'evidence' nodes

  • Orchestrate a multi-step workflow: Disease ID lookup -> Association query -> Tractability analysis -> Prioritization report

  • Create a custom ranking algorithm within the agent's toolset that combines L2G (Locus-to-Gene) scores and target safety data

  • Implement error handling for GraphQL depth limits and complex connection types (edges/nodes)

  • Develop a 'Tractability Explainer' that interprets 'clinicalPrecedence' data for the end user

How this agent runs

Evaluation will focus on the agent's ability to rank a list of targets correctly according to a specific scoring weighted formula provided in the prompt.

Preview configuration

Challenge input

Disease name: 'Alzheimer's Disease'

Zed

High-performance code editor

RAI

Agentic framework for robotics using ROS 2

o4-mini

Policy Serving in the agent workflow.

Evaluated output

Ordered JSON list of target symbols with justification

Checks for
  • Ensures the agent generates syntactically correct GraphQL queries.
  • Correlation between agent ranking and Open Targets platform ranking. • target: 0.9 • range: 0-1
Proof of success
  • Ranking Precision target: 0.9
  • 1 public reference case
Runtime evidence
  • Python execution harness
View technical recipe

Configured tools

Action Space
  • Zed · Optional
  • RAI · Optional
Policy Serving
  • o4-mini · Required

Evaluation contract

  • GraphQL Validity · Weight 1
  • Ranking Precision · Weight 1

Recipe state

This is a preview. The configuration can change before the evaluation recipe is locked.

Run this agent on your dataset and AI stack

Bring your dataset, model providers, and success criteria. We will scope the right managed run for your team.

Scope a managed run
Start from your terminal
$npx -y @versalist/cli start precision-target-prioritization-agent

[ok] Wrote CHALLENGE.md

[ok] Wrote .versalist.json

[ok] Wrote eval/examples.json

Requires VERSALIST_API_KEY. Works with any MCP-aware editor.

Docs
Manage API keys
Explore

Find another challenge

Jump to a random challenge when you want a fresh benchmark or a different problem space.

Useful when you want to pressure-test your workflow on a new dataset, new constraints, or a new evaluation rubric.

Frequently Asked Questions about Precision Target Prioritization Agent