Skip to main content
Challenge

Build a Wildfire Exposure Boundary Metadata Auditor

Evaluate commercial real estate exposure locations by compiling intersecting STAC metadata records. Identify available high-resolution multispectral imagery links for defensive vegetation buffer audits using an LLM-assisted metadata retrieval workflow.

Data ScienceHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Evaluate commercial real estate exposure locations by compiling intersecting STAC metadata records. Identify available high-resolution multispectral imagery links for defensive vegetation buffer audits using an LLM-assisted metadata retrieval workflow.

Commercial Property Risk Surveyor

Load commercial facility polygon geometries and perimeter buffer specifications.

Discover recent high-resolution STAC Items covering the extended perimeter zones.

Extract valid spatial asset links representing optical imagery bands from the STAC records.

Generate a structured metadata retrieval report for downstream vegetation analysis by human reviewers.

Web inspection terminal presenting property boundary overlays and retrieved STAC metadata links.

Query open STAC Catalog collections for Sentinel-2 or NAIP metadata, or utilize bundled local STAC GeoJSON files. Starter examples below are synthetic. They are not downloaded records.

STAC specification Traverses STAC Collections and Item metadata to parse asset bounding boxes and multispectral imagery links.

anthropic-claude, pystac, shapely. Claude parses complex STAC JSON schemas to extract valid optical imagery links and formats structured retrieval summaries. Hosted Claude API for contextual JSON parsing and metadata audit reporting.

Submit runnable source, pinned dependencies, setup commands, a working interface, example outputs, and a recorded end-to-end demo. Include tests and an action log.

Queries STAC catalogs to find items intersecting property polygons.

Successfully filters items containing optical imagery asset links.

Emits human-readable metadata retrieval summaries for property inspection teams.

```json [ { "input": { "facility_id": "FAC-WUI-01", "buffer_clearance_m": 12.5, "stac_collection": "naip" }, "expected_output": { "facility_id": "FAC-WUI-01", "imagery_links_found": 2, "metadata_status": "READY_FOR_REVIEW", "record_type": "simplified synthetic app record" } }, { "input": { "facility_id": "FAC-WUI-02", "buffer_clearance_m": 45, "stac_collection": "naip" }, "expected_output": { "facility_id": "FAC-WUI-02", "imagery_links_found": 0, "metadata_status": "NO_IMAGERY_FOUND", "record_type": "simplified synthetic app record" } } ] ```

Provides preliminary metadata screening; does not execute physical site audits or replace qualified municipal fire marshals. Use mock external writes. Require human review before any real deployment.

Rules

Participation guide

Provides preliminary metadata screening; does not execute physical site audits or replace qualified municipal fire marshals. Use mock external writes and human review.

Delivery guide

How work is evaluated

Evaluation

Queries STAC catalogs to find items intersecting property polygons. Successfully filters items containing optical imagery asset links. Emits human-readable metadata retrieval summaries for property inspection teams.

Submission format

Runnable source, pinned dependencies, setup commands, working interface, example outputs, recorded demo, tests, and action logs.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
4 scoring checks
Binary
1 pass or fail dimensions
Ordinal
3 scaled dimensions
Dimension 1

Complete workflow

Load commercial facility polygon geometries and perimeter buffer specifications. Discover recent high-resolution STAC Items covering the extended perimeter zones. Extract valid spatial asset links representing optical imagery bands from the STAC records. Generate a structured metadata retrieval report for downstream vegetation analysis by human reviewers.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 2

Correctness and evidence

Queries STAC catalogs to find items intersecting property polygons. Successfully filters items containing optical imagery asset links. Emits human-readable metadata retrieval summaries for property inspection teams.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 3

Review interface

Web inspection terminal presenting property boundary overlays and retrieved STAC metadata links.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 4

Safe execution

Provides preliminary metadata screening; does not execute physical site audits or replace qualified municipal fire marshals.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Load commercial facility polygon geometries and perimeter buffer specifications.

  • Discover recent high-resolution STAC Items covering the extended perimeter zones.

  • Extract valid spatial asset links representing optical imagery bands from the STAC records.

  • Generate a structured metadata retrieval report for downstream vegetation analysis by human reviewers.

Resources and assets

Reference links and supporting material

Dataset notes

Query open STAC Catalog collections for Sentinel-2 or NAIP metadata, or utilize bundled local STAC GeoJSON files. Supplied starter examples are synthetic, not source extracts.

Challenge setup

Configuration summary for this challenge.

Challenge input

Input details are not configured.

Anthropic Claude

LLM for code generation & more

Evaluated output

No output checks are configured.

Evaluation checks
  • Load commercial facility polygon geometries and perimeter buffer specifications. Discover recent high-resol...
  • Queries STAC catalogs to find items intersecting property polygons. Successfully filters items containing o...
  • Web inspection terminal presenting property boundary overlays and retrieved STAC metadata links.
Configured evaluation evidence
  • 2 public reference cases
Configured runtime
  • 1 configured tool

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Action Space
  • Anthropic Claude · Optional

Evaluation contract

  • Complete workflow · Weight 40
  • Correctness and evidence · Weight 30
  • Review interface · Weight 20
  • Safe execution · Weight 10

Reference cases

  • 2 public reference cases

Workflow tasks

No workflow tasks are configured.

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Build a Wildfire Exposure Boundary Metadata Auditor