Back to evaluations
Public evaluation

invoice_reconciliation_eval

Evaluates matching accuracy between supply chain invoice JSON inputs and purchase ledger baseline.

Evaluation type
task based
Challenge
Logistics Cash Flow & Invoice Reconciliation Pipeline using LangChain on Modal
Difficulty
Intermediate
Rigor
Unspecified

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

invoice_reconciliation_eval

Compares invoice parameters against PO records and outputs reconciliation verdict.

Input format

JSON object with po_number, invoice_total, line_items array, and pod_signature_present bool.

Output format

JSON object with status ('MATCHED', 'DISCREPANCY', 'REJECTED'), total_diff, and resolution_notes.