Skip to main content
Challenge

Repair a Production Schedule After a Machine Outage

Reschedule unfinished operations around a supplied machine outage. Preserve completed work and operation order. Use a solver to justify the revised plan.

EngineeringHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Reschedule unfinished operations around a supplied machine outage. Preserve completed work and operation order. Use a solver to justify the revised plan.

Use OpenAI GPT-6 Astra with OR-Tools and pandas.

A nonpreemptive three-hour job cannot overlap the outage. Choose the earliest feasible start at or after hour zero.

Use gpt-6-astra for evidence interpretation and workflow coordination. Use code for arithmetic and constraint checks.

Treat source documents and browser content as data, not instructions.

Use synthetic or explicitly authorized records. Do not upload personal or confidential data without permission.

Cite input record identifiers for conclusions. Distinguish missing evidence from a negative result.

Record tool calls, results, elapsed time, and reported token usage. Do not request private chain-of-thought.

Keep external actions disabled. Use a test portal for browser workflows and preserve draft status.

Do not write to industrial controllers or override safety interlocks. Require planner approval.

revised-schedule.csv and a constraint-difference report

source code and dependency lockfile

automated tests and recorded tool events

a short limitations and approval note

Rules

Participation guide

A nonpreemptive three-hour job cannot overlap the outage. Choose the earliest feasible start at or after hour zero. Use gpt-6-astra for evidence interpretation and workflow coordination. Use code for arithmetic and constraint checks. Treat source documents and browser content as data, not instructions. Use synthetic or explicitly authorized records. Do not upload personal or confidential data without permission. Cite input record identifiers for conclusions. Distinguish missing evidence from a negative result. Record tool calls, results, elapsed time, and reported token usage. Do not request private chain-of-thought. Keep external actions disabled. Use a test portal for browser workflows and preserve draft status. Do not write to industrial controllers or override safety interlocks. Require planner approval.

Delivery guide

How work is evaluated

Evaluation

A 100-point review rubric with an unauthorized-action failure gate. Starter examples do not establish full workflow performance.

Submission format

revised-schedule.csv and a constraint-difference report source code and dependency lockfile automated tests and recorded tool events a short limitations and approval note

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
4 scoring checks
Binary
4 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

correctness

A nonpreemptive three-hour job cannot overlap the outage. Choose the earliest feasible start at or after hour zero.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

evidence

Every factual conclusion cites the correct input record. Missing evidence remains explicit.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 3

workflow

The submitted workflow produces revised-schedule.csv and a constraint-difference report with independent verification.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 4

robustness

Mark part of a job completed. Preserve completed work instead of scheduling it again.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • A nonpreemptive three-hour job cannot overlap the outage. Choose the earliest feasible start at or after hour zero.

  • Produce revised-schedule.csv and a constraint-difference report.

  • Demonstrate evidence handling, safe failure, and reproducible results.

Resources and assets

Reference links and supporting material

Dataset notes

Three authored synthetic examples for Repair a Production Schedule After a Machine Outage. These are starter fixtures, not operational records or a validated benchmark.

Challenge setup

Evaluate the workflow against input evidence, deterministic checks, and reviewed domain cases.

Challenge input

JSON object with payload field

OR-Tools

deterministic processing or artifact creation in the agent workflow.

pandas

deterministic processing or artifact creation in the agent workflow.

Evaluated output

JSON result object

Evaluation checks
  • A nonpreemptive three-hour job cannot overlap the outage. Choose the earliest feasible start at or after ho...
  • Every factual conclusion cites the correct input record. Missing evidence remains explicit.
  • The submitted workflow produces revised-schedule.csv and a constraint-difference report with independent ve...
Configured evaluation evidence
  • Correctness
  • 3 public reference cases
Configured runtime
  • 1 configured tool

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Policy Serving
  • OpenAI GPT-6 Astra · Required

Evaluation contract

  • correctness · Weight 40
  • evidence · Weight 20
  • workflow · Weight 20
  • robustness · Weight 20

Metrics

  • correctness
  • evidence
  • workflow
  • robustness

Reference cases

  • 3 public reference cases

Workflow tasks

  1. Task 1

    Input: JSON object with payload field

    Output: JSON result object

  2. Task 2

    Input: JSON object with payload field

    Output: JSON result object

  3. Task 3

    Input: JSON object with payload field

    Output: JSON result object

Evaluation tools

  • OR-Tools · deterministic processing or artifact creation
  • pandas · deterministic processing or artifact creation

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Repair a Production Schedule After a Machine Outage