Skip to main content
Challenge

Build a Gene Transcript FASTA Curation Pipeline with DSPy and FHIR

Parse eukaryotic gene packages from NCBI Datasets to validate transcript coding sequences with Biopython. Structure sequence verification summaries into FHIR Molecular Observation resources.

Data ScienceHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Parse eukaryotic gene packages from NCBI Datasets to validate transcript coding sequences with Biopython. Structure sequence verification summaries into FHIR Molecular Observation resources.

Bioinformatics Curation Specialist

Unpack NCBI Datasets zip archive containing transcript rna.fna and data_report.jsonl.

Parse transcript sequences using Biopython SeqIO to check start and stop codon integrity.

Execute a DSPy signature to categorize transcript completeness based on sequence coordinates.

Construct FHIR R5 Observation resources containing sequence validity status for curator review.

Web curation console with sequence audit tables and interactive JSON bundle inspector.

Download open NCBI Datasets packages using CLI for gene ID 672 or read bundled mock fixture zip archives. Starter examples below are synthetic. They are not downloaded records.

NCBI Datasets gene download Utilizes the NCBI Datasets gene data package structure containing transcript RNA sequences and data report lines.

dspy, biopython, pydantic. DSPy compiles robust prompt pipelines to extract structured metadata assessments from open reading frame audits. Local quantized Llama 3 or hosted small instruction model via standard API.

Submit runnable source, pinned dependencies, setup commands, a working interface, example outputs, and a recorded end-to-end demo. Include tests and an action log.

Extracts valid SeqRecord instances from transcript FASTA input without fatal parser exceptions.

Outputs valid FHIR R5 Observation JSON containing code 'molecular-sequence-assessment'.

Flags incomplete reading frames lacking standard ATG initiation codons with warning status.

```json [ { "input": { "gene_id": "672", "fasta_header": "NM_007294.4 Homo sapiens BRCA1 transcript variant 1", "sequence": "ATGGATTTATCTGCTCTTCGCGTTGAAGAAGTACAAAATGTCATTAATGCTATGCAGAAAATCTTAGAGTGTCCCATCTGA" }, "expected_output": { "resourceType": "Observation", "status": "final", "code": { "coding": [ { "system": "http://example.org/fhir/codes", "code": "molecular-sequence-assessment" } ] }, "valueString": "complete_cds", "component": [ { "code": { "text": "has_valid_start_and_stop" }, "valueBoolean": true } ] } }, { "input": { "gene_id": "672", "fasta_header": "NM_007294.4_truncated Homo sapiens BRCA1 partial", "sequence": "TTATCTGCTCTTCGCGTTGAAGAAGTACAAAATGTCATTAATGCTATGCAGAAAATCTTAGAGTGTCCC" }, "expected_output": { "resourceType": "Observation", "status": "preliminary", "code": { "coding": [ { "system": "http://example.org/fhir/codes", "code": "molecular-sequence-assessment" } ] }, "valueString": "incomplete_cds", "component": [ { "code": { "text": "has_valid_start_and_stop" }, "valueBoolean": false } ] } } ] ```

Research software only; outputs are non-diagnostic and must undergo curator sign-off before biobank indexing. Use mock external writes. Require human review before any real deployment.

Rules

Participation guide

Research software only; outputs are non-diagnostic and must undergo curator sign-off before biobank indexing. Use mock external writes and human review.

Delivery guide

How work is evaluated

Evaluation

Extracts valid SeqRecord instances from transcript FASTA input without fatal parser exceptions. Outputs valid FHIR R5 Observation JSON containing code 'molecular-sequence-assessment'. Flags incomplete reading frames lacking standard ATG initiation codons with warning status.

Submission format

Runnable source, pinned dependencies, setup commands, working interface, example outputs, recorded demo, tests, and action logs.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
4 scoring checks
Binary
1 pass or fail dimensions
Ordinal
3 scaled dimensions
Dimension 1

Complete workflow

Unpack NCBI Datasets zip archive containing transcript rna.fna and data_report.jsonl. Parse transcript sequences using Biopython SeqIO to check start and stop codon integrity. Execute a DSPy signature to categorize transcript completeness based on sequence coordinates. Construct FHIR R5 Observation resources containing sequence validity status for curator review.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 2

Correctness and evidence

Extracts valid SeqRecord instances from transcript FASTA input without fatal parser exceptions. Outputs valid FHIR R5 Observation JSON containing code 'molecular-sequence-assessment'. Flags incomplete reading frames lacking standard ATG initiation codons with warning status.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 3

Review interface

Web curation console with sequence audit tables and interactive JSON bundle inspector.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 4

Safe execution

Research software only; outputs are non-diagnostic and must undergo curator sign-off before biobank indexing.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Unpack NCBI Datasets zip archive containing transcript rna.fna and data_report.jsonl.

  • Parse transcript sequences using Biopython SeqIO to check start and stop codon integrity.

  • Execute a DSPy signature to categorize transcript completeness based on sequence coordinates.

  • Construct FHIR R5 Observation resources containing sequence validity status for curator review.

Resources and assets

Reference links and supporting material

Dataset notes

Download open NCBI Datasets packages using CLI for gene ID 672 or read bundled mock fixture zip archives. Supplied starter examples are synthetic, not source extracts.

Challenge setup

Configuration summary for this challenge.

Challenge input

Input details are not configured.

DSPy

Prompt and LM program optimization framework.

Evaluated output

No output checks are configured.

Evaluation checks
  • Unpack NCBI Datasets zip archive containing transcript rna.fna and data_report.jsonl. Parse transcript sequ...
  • Extracts valid SeqRecord instances from transcript FASTA input without fatal parser exceptions. Outputs val...
  • Web curation console with sequence audit tables and interactive JSON bundle inspector.
Configured evaluation evidence
  • 2 public reference cases
Configured runtime
  • 3 configured tools

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Action Space
  • DSPy · Optional
Training Infra
  • DSPy · Optional
Orchestration
  • DSPy · Optional

Evaluation contract

  • Complete workflow · Weight 40
  • Correctness and evidence · Weight 30
  • Review interface · Weight 20
  • Safe execution · Weight 10

Reference cases

  • 2 public reference cases

Workflow tasks

No workflow tasks are configured.

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Build a Gene Transcript FASTA Curation Pipeline with DSPy and FHIR