Skip to main content
Challenge

Build a Prokaryotic Gene RefSeq Coordinate Discrepancy Auditor

Download prokaryotic WP_ accession metadata and FASTA sequences to detect ribosomal slippage annotation gaps. Generate FHIR Molecular Observation logs to track curated sequence revisions.

Data ScienceHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Download prokaryotic WP_ accession metadata and FASTA sequences to detect ribosomal slippage annotation gaps. Generate FHIR Molecular Observation logs to track curated sequence revisions.

Microbial Biocurator

Download prokaryotic gene packages using NCBI Datasets WP_ protein accession queries.

Parse FASTA headers and protein strings using Biopython to calculate amino acid lengths.

Compare sequence lengths against the reported gene coordinate boundaries from the metadata report.

Generate FHIR Observation records cataloging coordinate matching status and length discrepancies.

Interactive data table showing prokaryotic gene accessions, length deltas, and automated FHIR output viewers.

Query NCBI Datasets CLI using synthetic mock WP_ accessions with the --include gene,protein flags. Starter examples below are synthetic. They are not downloaded records.

NCBI Datasets gene download Extracts prokaryotic gene data packages containing WP_ accessions, gene and protein sequences.

agno, biopython, sqlite3. agno provides lightweight workflow orchestration to manage sequential API queries and Biopython parsing tasks. Local Python 3.12 runtime with Ollama or local LLM fallback for automated curator note generation.

Submit runnable source, pinned dependencies, setup commands, a working interface, example outputs, and a recorded end-to-end demo. Include tests and an action log.

Download and parse both gene nucleotide and WP_ protein sequences from the data package.

Detect discrepancy between expected peptide length and gene length divided by 3.

Produce FHIR Observation resource with code indicating coordinate match status.

```json [ { "input": { "accession": "WP_000001.1", "gene_length_bp": 900, "protein_length_aa": 300 }, "expected_output": { "accession": "WP_000001.1", "length_delta": 0, "coordinate_match": true, "fhir_observation": { "resourceType": "Observation", "status": "final", "valueBoolean": true } } }, { "input": { "accession": "WP_000002.1", "gene_length_bp": 900, "protein_length_aa": 250 }, "expected_output": { "accession": "WP_000002.1", "length_delta": -50, "coordinate_match": false, "fhir_observation": { "resourceType": "Observation", "status": "preliminary", "valueBoolean": false } } } ] ```

Research-oriented microbial genomics pipeline utilizing open RefSeq accessions. No clinical diagnosis or diagnostic utility. Use mock external writes. Require human review before any real deployment.

Rules

Participation guide

Research-oriented microbial genomics pipeline utilizing open RefSeq accessions. No clinical diagnosis or diagnostic utility. Use mock external writes and human review.

Delivery guide

How work is evaluated

Evaluation

Download and parse both gene nucleotide and WP_ protein sequences from the data package. Detect discrepancy between expected peptide length and gene length divided by 3. Produce FHIR Observation resource with code indicating coordinate match status.

Submission format

Runnable source, pinned dependencies, setup commands, working interface, example outputs, recorded demo, tests, and action logs.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
4 scoring checks
Binary
1 pass or fail dimensions
Ordinal
3 scaled dimensions
Dimension 1

Complete workflow

Download prokaryotic gene packages using NCBI Datasets WP_ protein accession queries. Parse FASTA headers and protein strings using Biopython to calculate amino acid lengths. Compare sequence lengths against the reported gene coordinate boundaries from the metadata report. Generate FHIR Observation records cataloging coordinate matching status and length discrepancies.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 2

Correctness and evidence

Download and parse both gene nucleotide and WP_ protein sequences from the data package. Detect discrepancy between expected peptide length and gene length divided by 3. Produce FHIR Observation resource with code indicating coordinate match status.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 3

Review interface

Interactive data table showing prokaryotic gene accessions, length deltas, and automated FHIR output viewers.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 4

Safe execution

Research-oriented microbial genomics pipeline utilizing open RefSeq accessions. No clinical diagnosis or diagnostic utility.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Download prokaryotic gene packages using NCBI Datasets WP_ protein accession queries.

  • Parse FASTA headers and protein strings using Biopython to calculate amino acid lengths.

  • Compare sequence lengths against the reported gene coordinate boundaries from the metadata report.

  • Generate FHIR Observation records cataloging coordinate matching status and length discrepancies.

Resources and assets

Reference links and supporting material

Dataset notes

Query NCBI Datasets CLI using synthetic mock WP_ accessions with the --include gene,protein flags. Supplied starter examples are synthetic, not source extracts.

Challenge setup

Configuration summary for this challenge.

Challenge input

Input details are not configured.

Agno

Framework for multimodal agents.

Evaluated output

No output checks are configured.

Evaluation checks
  • Download prokaryotic gene packages using NCBI Datasets WP_ protein accession queries. Parse FASTA headers a...
  • Download and parse both gene nucleotide and WP_ protein sequences from the data package. Detect discrepancy...
  • Interactive data table showing prokaryotic gene accessions, length deltas, and automated FHIR output viewers.
Configured evaluation evidence
  • 2 public reference cases
Configured runtime
  • 2 configured tools

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Action Space
  • Agno · Optional
Orchestration
  • Agno · Optional

Evaluation contract

  • Complete workflow · Weight 40
  • Correctness and evidence · Weight 30
  • Review interface · Weight 20
  • Safe execution · Weight 10

Reference cases

  • 2 public reference cases

Workflow tasks

No workflow tasks are configured.

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Build a Prokaryotic Gene RefSeq Coordinate Discrepancy Auditor