Challenge

LangChain IL-6 Pathway Clinical Trial Matching Workflow

Evaluating anti-inflammatory drugs like IL-6 inhibitors across cardiovascular clinical trials requires stateful patient matching. Build a LangGraph and LangChain agent to query patient EHR records against trial inclusion and exclusion criteria for cardiac biomarker profiles. Reach greater than 90 percent precision in cohort qualification.

Data ScienceHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Develop a stateful LangGraph agent using LangChain to match patient electronic health records against complex IL-6 cardiovascular clinical trial eligibility rules.

Delivery guide

How work is evaluated

Evaluation

Evaluates precision, recall, and state transition logic of the trial matching workflow.

Datasets

Shared data for this challenge

Review public datasets and any private uploads tied to your build.

Loading datasets...
Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

correct_eligibility_decision

Verifies that eligible status matches ground truth annotation.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

matching_precision

Precision of trial participant qualification decisions. • target: 0.91 • range: 0-1

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Build a stateful patient trial matching workflow using LangGraph state graphs

  • Extract structured lab markers (hsCRP, IL-6, troponin) from unstructured EHR clinical notes

  • Implement inclusion/exclusion logic verification using LangChain tools

  • Generate patient qualification audit logs for trial recruitment coordinators

Resources and assets

Reference links and supporting material

Dataset notes

Synthetic electronic health record summaries annotated with cardiac lab values and clinical trial inclusion outcomes.

How this agent runs

Evaluates precision, recall, and state transition logic of the trial matching workflow.

Challenge input

JSON containing patient record text and lab values

LangChain

Required framework for building LLM tools and integrations.

LangGraph

Enables state graph routing for deterministic eligibility checks.

Evaluated output

JSON with eligible status, satisfied criteria array, and failed criteria array

Checks for
  • Verifies that eligible status matches ground truth annotation.
  • Precision of trial participant qualification decisions. • target: 0.91 • range: 0-1
Proof of success
  • Benchmark: TrialMatch-Bench
  • Matching Precision target: 0.91
  • 1 public reference case
Runtime evidence
  • Python execution harness
  • Python sandbox
View technical recipe

Configured tools

Action Space
  • LangChain · Required
  • Langchain · Optional
  • Llama 3.2 · Optional
Orchestration
  • LangChain · Required
  • Langchain · Optional

Evaluation contract

  • correct_eligibility_decision · Weight 1
  • matching_precision · Weight 1

Recipe state

This is a preview. The configuration can change before the evaluation recipe is locked.

Frequently Asked Questions about LangChain IL-6 Pathway Clinical Trial Matching Workflow