Challenge

Precision Target Prioritization Agent

Design a target-disease prioritization system that leverages the Claude Agents SDK's 'Extended Thinking' capabilities to reason over complex genetic evidence. Your agent will interface with the Open Targets GraphQL API to retrieve genetic constraint scores (pLI), target-disease association scores, and drug tractability data. Using the o4-mini model for rapid data parsing within the agent loop, the system must prioritize therapeutic targets for specific diseases based on evidence strength and clinical tractability. The challenge involves writing a GraphQL planner that dynamically constructs queries to minimize data transfer while maximizing information gain (e.g., fetching L2G scores for specific variants). Claude will then synthesize this data to explain 'why' a specific target is prioritized, citing genetic scores and clinical trial status.

Data ScienceHosted by Vera
Status
Always open
Difficulty
Advanced
Points
500
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Design a target-disease prioritization system that leverages the Claude Agents SDK's 'Extended Thinking' capabilities to reason over complex genetic evidence. Your agent will interface with the Open Targets GraphQL API to retrieve genetic constraint scores (pLI), target-disease association scores, and drug tractability data. Using the o4-mini model for rapid data parsing within the agent loop, the system must prioritize therapeutic targets for specific diseases based on evidence strength and clinical tractability. The challenge involves writing a GraphQL planner that dynamically constructs queries to minimize data transfer while maximizing information gain (e.g., fetching L2G scores for specific variants). Claude will then synthesize this data to explain 'why' a specific target is prioritized, citing genetic scores and clinical trial status.

Datasets

Shared data for this challenge

Review public datasets and any private uploads tied to your build.

Loading datasets...
Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks, how much each dimension matters, and which criteria separate a passable run from a strong one.

Max Score: 2
Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1graphql_validity

GraphQL Validity

Ensures the agent generates syntactically correct GraphQL queries.

binary
Weight: 1
Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2ranking_precision

Ranking Precision

Correlation between agent ranking and Open Targets platform ranking. • target: 0.9 • range: 0-1

binary
Weight: 1
Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Design a Claude-based agent that uses the 'thinking' parameter to deliberate on the importance of genetic constraint (pLI) versus disease association scores

  • Implement a Python-based GraphQL client that the agent uses to fetch nested 'target' and 'disease' objects

  • Leverage the o4-mini model to parse large JSON responses from Open Targets and extract key 'evidence' nodes

  • Orchestrate a multi-step workflow: Disease ID lookup -> Association query -> Tractability analysis -> Prioritization report

  • Create a custom ranking algorithm within the agent's toolset that combines L2G (Locus-to-Gene) scores and target safety data

  • Implement error handling for GraphQL depth limits and complex connection types (edges/nodes)

  • Develop a 'Tractability Explainer' that interprets 'clinicalPrecedence' data for the end user

Start from your terminal
$npx -y @versalist/cli start precision-target-prioritization-agent

[ok] Wrote CHALLENGE.md

[ok] Wrote .versalist.json

[ok] Wrote eval/examples.json

Requires VERSALIST_API_KEY. Works with any MCP-aware editor.

Docs
Manage API keys
Host and timing
Vera

AI Research & Mentorship

Starts Available now
Evergreen challenge
Your progress

Participation status

You haven't started this challenge yet

Timeline and host

Operating window

Key dates and the organization behind this challenge.

Start date
Available now
Run mode
Evergreen challenge
Explore

Find another challenge

Jump to a random challenge when you want a fresh benchmark or a different problem space.

Useful when you want to pressure-test your workflow on a new dataset, new constraints, or a new evaluation rubric.

Tool Space Recipe

Draft
Action Space
ZedHigh-performance code editor
RAIAgentic framework for robotics using ROS 2
Policy Serving
o4-mini
required
Evaluation
Rubric: 2 dimensions
·GraphQL Validity(1%)
·Ranking Precision(1%)
Gold items: 1 (1 public)

Frequently Asked Questions about Precision Target Prioritization Agent