Skip to main content
Challenge

Build a Disaster Claim Document Completeness and Adjuster Visit Scheduler

Inspect submitted property damage loss documents against declared disaster incident logs and geospatial imagery. Flag missing required evidentiary records and construct prioritized field adjuster inspection routing itineraries.

Data ScienceHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Inspect submitted property damage loss documents against declared disaster incident logs and geospatial imagery. Flag missing required evidentiary records and construct prioritized field adjuster inspection routing itineraries.

Claim intake coordinators managing disaster loss inspection queues for commercial and agricultural properties.

Ingest property loss notification payloads and cross-check against OpenFEMA disaster declarations for date and jurisdiction validity.

Audit submitted document manifests against mandatory evidence checklists including photo proof, itemized estimates, and ownership deeds.

Calculate completeness scores and isolate critical missing evidentiary items required for formal adjuster triage.

Synthesize structured adjuster site-visit itineraries prioritizing high-severity claims with complete documentation.

Multi-pane intake console with checklist reconciliation tables, document gap callouts, and field visit dispatch calendar.

Combine OpenFEMA v2 DisasterDeclarationsSummaries query responses with synthetic claim file manifests in local JSON fixture format. Starter examples below are synthetic. They are not downloaded records.

FEMA OpenFEMA Extracts disasterNumber, incidentType, and declarationDate from OpenFEMA v2 DisasterDeclarationsSummaries to validate incident jurisdiction and timing.

mastra-ai, pydantic, dateutil. Mastra AI provides deterministic workflow orchestration to evaluate sequential document validation rules and generate visit schedules. Local small LLM (e.g. Mistral 7B via Ollama) or hosted API to draft claimant missing-document notices.

Submit runnable source, pinned dependencies, setup commands, a working interface, example outputs, and a recorded end-to-end demo. Include tests and an action log.

Rejects claims where asserted loss dates fall outside the declared OpenFEMA disaster incident window.

Detects missing mandatory document categories from submitted property claim manifests.

Generates sorted adjuster inspection itineraries respecting priority triage scores.

Emits claimant document request notices specifying exact missing attachments.

```json [ { "input": { "claim_id": "CLM-2023-8801", "policy_holder": "Apex Logistics Yard", "county_fips": "22051", "asserted_loss_date": "2023-08-30T10:00:00Z", "disaster_declaration": { "disasterNumber": 4720, "incidentType": "Hurricane", "incidentBeginDate": "2023-08-28T00:00:00Z", "incidentEndDate": "2023-09-02T23:59:59Z" }, "uploaded_documents": [ "deed_of_ownership.pdf", "interior_flood_photos.zip", "repair_contractor_estimate.pdf" ] }, "expected_output": { "claim_id": "CLM-2023-8801", "incident_verified": true, "completeness_score": 1, "missing_mandatory_items": [], "adjuster_status": "READY_TO_SCHEDULE", "scheduled_priority_tier": "HIGH", "visit_window_start": "2023-09-05T09:00:00Z" } }, { "input": { "claim_id": "CLM-2023-9042", "policy_holder": "Delta River Marina", "county_fips": "22051", "asserted_loss_date": "2023-08-30T10:00:00Z", "disaster_declaration": { "disasterNumber": 4720, "incidentType": "Hurricane", "incidentBeginDate": "2023-08-28T00:00:00Z", "incidentEndDate": "2023-09-02T23:59:59Z" }, "uploaded_documents": [ "interior_flood_photos.zip" ] }, "expected_output": { "claim_id": "CLM-2023-9042", "incident_verified": true, "completeness_score": 0.33, "missing_mandatory_items": [ "deed_of_ownership", "repair_contractor_estimate" ], "adjuster_status": "PENDING_DOCUMENTATION", "scheduled_priority_tier": "ON_HOLD", "visit_window_start": null } } ] ```

Demonstration intake scheduler only. Does not make final insurance liability determinations, issue claim denials, or authorize payments. Use mock external writes. Require human review before any real deployment.

Rules

Participation guide

Demonstration intake scheduler only. Does not make final insurance liability determinations, issue claim denials, or authorize payments. Use mock external writes and human review.

Delivery guide

How work is evaluated

Evaluation

Rejects claims where asserted loss dates fall outside the declared OpenFEMA disaster incident window. Detects missing mandatory document categories from submitted property claim manifests. Generates sorted adjuster inspection itineraries respecting priority triage scores. Emits claimant document request notices specifying exact missing attachments.

Submission format

Runnable source, pinned dependencies, setup commands, working interface, example outputs, recorded demo, tests, and action logs.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
4 scoring checks
Binary
1 pass or fail dimensions
Ordinal
3 scaled dimensions
Dimension 1

Complete workflow

Ingest property loss notification payloads and cross-check against OpenFEMA disaster declarations for date and jurisdiction validity. Audit submitted document manifests against mandatory evidence checklists including photo proof, itemized estimates, and ownership deeds. Calculate completeness scores and isolate critical missing evidentiary items required for formal adjuster triage. Synthesize structured adjuster site-visit itineraries prioritizing high-severity claims with complete documentation.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 2

Correctness and evidence

Rejects claims where asserted loss dates fall outside the declared OpenFEMA disaster incident window. Detects missing mandatory document categories from submitted property claim manifests. Generates sorted adjuster inspection itineraries respecting priority triage scores. Emits claimant document request notices specifying exact missing attachments.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 3

Review interface

Multi-pane intake console with checklist reconciliation tables, document gap callouts, and field visit dispatch calendar.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 4

Safe execution

Demonstration intake scheduler only. Does not make final insurance liability determinations, issue claim denials, or authorize payments.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Ingest property loss notification payloads and cross-check against OpenFEMA disaster declarations for date and jurisdiction validity.

  • Audit submitted document manifests against mandatory evidence checklists including photo proof, itemized estimates, and ownership deeds.

  • Calculate completeness scores and isolate critical missing evidentiary items required for formal adjuster triage.

  • Synthesize structured adjuster site-visit itineraries prioritizing high-severity claims with complete documentation.

Resources and assets

Reference links and supporting material

Dataset notes

Combine OpenFEMA v2 DisasterDeclarationsSummaries query responses with synthetic claim file manifests in local JSON fixture format. Supplied starter examples are synthetic, not source extracts.

Challenge setup

Configuration summary for this challenge.

Challenge input

Input details are not configured.

Mastra AI

TypeScript agent framework.

Evaluated output

No output checks are configured.

Evaluation checks
  • Ingest property loss notification payloads and cross-check against OpenFEMA disaster declarations for date...
  • Rejects claims where asserted loss dates fall outside the declared OpenFEMA disaster incident window. Detec...
  • Multi-pane intake console with checklist reconciliation tables, document gap callouts, and field visit disp...
Configured evaluation evidence
  • 2 public reference cases
Configured runtime
  • 2 configured tools

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Action Space
  • Mastra AI · Optional
Orchestration
  • Mastra AI · Optional

Evaluation contract

  • Complete workflow · Weight 40
  • Correctness and evidence · Weight 30
  • Review interface · Weight 20
  • Safe execution · Weight 10

Reference cases

  • 2 public reference cases

Workflow tasks

No workflow tasks are configured.

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Build a Disaster Claim Document Completeness and Adjuster Visit Scheduler