Skip to main content
Challenge

Build a Multi-Provider Logistics Route Settlement and Dispute Explainer

Evaluate multi-hop delivery fulfillment legs across independent mock carriers to identify mileage variances and charge discrepancies. Construct objective variance dossiers to resolve courier compensation disputes without financial routing.

Workflow AutomationHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Evaluate multi-hop delivery fulfillment legs across independent mock carriers to identify mileage variances and charge discrepancies. Construct objective variance dossiers to resolve courier compensation disputes without financial routing.

Logistics network operations dispatcher

Ingest multi-leg fulfillment milestone logs and base rate cards from simulated Beckn logistics packets.

Compare documented GPS transit distances against contracted route corridors and toll allowances.

Identify fuel surcharge discrepancies and detention fee mismatches across carrier handover checkpoints.

Generate a structured variance resolution summary for review by carrier dispute arbiters.

Multi-carrier timeline view displaying route waypoint timestamps, cost breakdowns, and disputed amount highlights.

Construct synthetic multi-hop logistics order records and simulated waybill telemetry files in local JSON format. Starter examples below are synthetic. They are not downloaded records.

ONDC network extension Adopts ONDC protocol-network-extension logistics API contract definitions and participant handover states.

langfuse, fastapi, pydantic-ai. Tracks telemetry traces, evaluation metrics, and prompt token usage across multi-carrier discrepancy analyses. Instruction-tuned hosted model with high precision in numeric dispute reasoning.

Submit runnable source, pinned dependencies, setup commands, a working interface, example outputs, and a recorded end-to-end demo. Include tests and an action log.

Validates carrier transit legs against minimum and maximum distance tolerances.

Categorizes fee variances into fuel, toll, or detention line items.

Emits structured dispute findings without dispatching fund movements.

```json [ { "input": { "waybill_id": "WB-4410", "contracted_km": 42, "actual_gps_km": 43.5, "agreed_base_rate": 450, "claimed_total": 520, "toll_receipt_present": true, "toll_amount": 50 }, "expected_output": { "approved_amount": 500, "discrepancy_amount": 20, "variance_reason": "Excess mileage within 5% tolerance; unapproved detention surcharge of 20.00 deducted.", "disposition": "partial_approval" } }, { "input": { "waybill_id": "WB-4411", "contracted_km": 15, "actual_gps_km": 28, "agreed_base_rate": 200, "claimed_total": 410, "toll_receipt_present": false, "toll_amount": 0 }, "expected_output": { "approved_amount": 200, "discrepancy_amount": 210, "variance_reason": "Significant unapproved detour (>10km) without prior dispatcher exception authorization.", "disposition": "escalate_to_analyst" } } ] ```

Maintains an auditing framework for logistics invoices without executing courier bank payouts or ledger adjustments. Use mock external writes. Require human review before any real deployment.

Rules

Participation guide

Maintains an auditing framework for logistics invoices without executing courier bank payouts or ledger adjustments. Use mock external writes and human review.

Delivery guide

How work is evaluated

Evaluation

Validates carrier transit legs against minimum and maximum distance tolerances. Categorizes fee variances into fuel, toll, or detention line items. Emits structured dispute findings without dispatching fund movements.

Submission format

Runnable source, pinned dependencies, setup commands, working interface, example outputs, recorded demo, tests, and action logs.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
4 scoring checks
Binary
1 pass or fail dimensions
Ordinal
3 scaled dimensions
Dimension 1

Complete workflow

Ingest multi-leg fulfillment milestone logs and base rate cards from simulated Beckn logistics packets. Compare documented GPS transit distances against contracted route corridors and toll allowances. Identify fuel surcharge discrepancies and detention fee mismatches across carrier handover checkpoints. Generate a structured variance resolution summary for review by carrier dispute arbiters.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 2

Correctness and evidence

Validates carrier transit legs against minimum and maximum distance tolerances. Categorizes fee variances into fuel, toll, or detention line items. Emits structured dispute findings without dispatching fund movements.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 3

Review interface

Multi-carrier timeline view displaying route waypoint timestamps, cost breakdowns, and disputed amount highlights.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 4

Safe execution

Maintains an auditing framework for logistics invoices without executing courier bank payouts or ledger adjustments.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Ingest multi-leg fulfillment milestone logs and base rate cards from simulated Beckn logistics packets.

  • Compare documented GPS transit distances against contracted route corridors and toll allowances.

  • Identify fuel surcharge discrepancies and detention fee mismatches across carrier handover checkpoints.

  • Generate a structured variance resolution summary for review by carrier dispute arbiters.

Resources and assets

Reference links and supporting material

Dataset notes

Construct synthetic multi-hop logistics order records and simulated waybill telemetry files in local JSON format. Supplied starter examples are synthetic, not source extracts.

Challenge setup

Configuration summary for this challenge.

Challenge input

Input details are not configured.

Langfuse

Open-source LLM observability and evals.

Evaluated output

No output checks are configured.

Evaluation checks
  • Ingest multi-leg fulfillment milestone logs and base rate cards from simulated Beckn logistics packets. Com...
  • Validates carrier transit legs against minimum and maximum distance tolerances. Categorizes fee variances i...
  • Multi-carrier timeline view displaying route waypoint timestamps, cost breakdowns, and disputed amount high...
Configured evaluation evidence
  • 2 public reference cases
Configured runtime
  • 2 configured tools

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Observation
  • Langfuse · Optional
Reward / Eval
  • Langfuse · Optional

Evaluation contract

  • Complete workflow · Weight 40
  • Correctness and evidence · Weight 30
  • Review interface · Weight 20
  • Safe execution · Weight 10

Reference cases

  • 2 public reference cases

Workflow tasks

No workflow tasks are configured.

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Build a Multi-Provider Logistics Route Settlement and Dispute Explainer