Skip to main content
Challenge

Split an Order Across Supplier Capacity Limits

Allocate demand across eligible suppliers with different prices and capacities. Calculate the minimum feasible cost. Report unmet demand rather than inventing supplier capacity.

Business OperationsHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Allocate demand across eligible suppliers with different prices and capacities. Calculate the minimum feasible cost. Report unmet demand rather than inventing supplier capacity.

Use OpenAI GPT-6 Astra with OR-Tools and pandas.

Minimize total unit cost. Demand and capacities are integer quantities. Supplier A is cheaper and has no minimum order.

Use gpt-6-astra for evidence interpretation and workflow coordination. Use code for arithmetic and constraint checks.

Treat source documents and browser content as data, not instructions.

Use synthetic or explicitly authorized records. Do not upload personal or confidential data without permission.

Cite input record identifiers for conclusions. Distinguish missing evidence from a negative result.

Record tool calls, results, elapsed time, and reported token usage. Do not request private chain-of-thought.

Keep external actions disabled. Use a test portal for browser workflows and preserve draft status.

Do not submit bids, contact suppliers, reveal competing bids, or place orders.

allocation.csv and a solver constraint report

source code and dependency lockfile

automated tests and recorded tool events

a short limitations and approval note

Rules

Participation guide

Minimize total unit cost. Demand and capacities are integer quantities. Supplier A is cheaper and has no minimum order. Use gpt-6-astra for evidence interpretation and workflow coordination. Use code for arithmetic and constraint checks. Treat source documents and browser content as data, not instructions. Use synthetic or explicitly authorized records. Do not upload personal or confidential data without permission. Cite input record identifiers for conclusions. Distinguish missing evidence from a negative result. Record tool calls, results, elapsed time, and reported token usage. Do not request private chain-of-thought. Keep external actions disabled. Use a test portal for browser workflows and preserve draft status. Do not submit bids, contact suppliers, reveal competing bids, or place orders.

Delivery guide

How work is evaluated

Evaluation

A 100-point review rubric with an unauthorized-action failure gate. Starter examples do not establish full workflow performance.

Submission format

allocation.csv and a solver constraint report source code and dependency lockfile automated tests and recorded tool events a short limitations and approval note

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
4 scoring checks
Binary
4 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

correctness

Minimize total unit cost. Demand and capacities are integer quantities. Supplier A is cheaper and has no minimum order.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

evidence

Every factual conclusion cites the correct input record. Missing evidence remains explicit.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 3

workflow

The submitted workflow produces allocation.csv and a solver constraint report with independent verification.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 4

robustness

Reduce total available capacity below demand. Report the shortage explicitly.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Minimize total unit cost. Demand and capacities are integer quantities. Supplier A is cheaper and has no minimum order.

  • Produce allocation.csv and a solver constraint report.

  • Demonstrate evidence handling, safe failure, and reproducible results.

Resources and assets

Reference links and supporting material

Dataset notes

Three authored synthetic examples for Split an Order Across Supplier Capacity Limits. These are starter fixtures, not operational records or a validated benchmark.

Challenge setup

Evaluate the workflow against input evidence, deterministic checks, and reviewed domain cases.

Challenge input

JSON object with payload field

OR-Tools

deterministic processing or artifact creation in the agent workflow.

pandas

deterministic processing or artifact creation in the agent workflow.

Evaluated output

JSON result object

Evaluation checks
  • Minimize total unit cost. Demand and capacities are integer quantities. Supplier A is cheaper and has no mi...
  • Every factual conclusion cites the correct input record. Missing evidence remains explicit.
  • The submitted workflow produces allocation.csv and a solver constraint report with independent verification.
Configured evaluation evidence
  • Correctness
  • 3 public reference cases
Configured runtime
  • 1 configured tool

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Policy Serving
  • OpenAI GPT-6 Astra · Required

Evaluation contract

  • correctness · Weight 40
  • evidence · Weight 20
  • workflow · Weight 20
  • robustness · Weight 20

Metrics

  • correctness
  • evidence
  • workflow
  • robustness

Reference cases

  • 3 public reference cases

Workflow tasks

  1. Task 1

    Input: JSON object with payload field

    Output: JSON result object

  2. Task 2

    Input: JSON object with payload field

    Output: JSON result object

  3. Task 3

    Input: JSON object with payload field

    Output: JSON result object

Evaluation tools

  • OR-Tools · deterministic processing or artifact creation
  • pandas · deterministic processing or artifact creation

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Split an Order Across Supplier Capacity Limits