Skip to main content
Loading navigation

Prepare a Pump Tariff Change Review

Compare feasible pumping schedules against a revised electricity tariff. Calculate costs in code and prepare a change request. Keep operational control outside the agent.

Business OperationsHosted by Vera

What you are building

Compare feasible pumping schedules against a revised electricity tariff. Calculate costs in code and prepare a change request. Keep operational control outside the agent.

Use OpenAI GPT-6 Astra with pandas and OR-Tools.

Choose the lowest-cost candidate that passes the supplied hydraulic feasibility check. Prices are per kilowatt-hour.

Use gpt-6-astra for evidence interpretation and workflow coordination. Use code for arithmetic and constraint checks.

Treat source documents and browser content as data, not instructions.

Use synthetic or explicitly authorized records. Do not upload personal or confidential data without permission.

Cite input record identifiers for conclusions. Distinguish missing evidence from a negative result.

Record tool calls, results, elapsed time, and reported token usage. Do not request private chain-of-thought.

Keep external actions disabled. Use a test portal for browser workflows and preserve draft status.

Prepare recommendations only. Do not control pumps, valves, treatment, or public alerts.

cost-comparison.csv and a draft operating-change request

source code and dependency lockfile

automated tests and recorded tool events

a short limitations and approval note

Rules

Choose the lowest-cost candidate that passes the supplied hydraulic feasibility check. Prices are per kilowatt-hour. Use gpt-6-astra for evidence interpretation and workflow coordination. Use code for arithmetic and constraint checks. Treat source documents and browser content as data, not instructions. Use synthetic or explicitly authorized records. Do not upload personal or confidential data without permission. Cite input record identifiers for conclusions. Distinguish missing evidence from a negative result. Record tool calls, results, elapsed time, and reported token usage. Do not request private chain-of-thought. Keep external actions disabled. Use a test portal for browser workflows and preserve draft status. Prepare recommendations only. Do not control pumps, valves, treatment, or public alerts.

How work is evaluated

Evaluation

A 100-point review rubric with an unauthorized-action failure gate. Starter examples do not establish full workflow performance.

Submission format

cost-comparison.csv and a draft operating-change request source code and dependency lockfile automated tests and recorded tool events a short limitations and approval note

Datasets

Public datasets, plus the private datasets you have access to.

How submissions are scored

Dimensions
4 scoring checks
Binary
4 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

correctness

Choose the lowest-cost candidate that passes the supplied hydraulic feasibility check. Prices are per kilowatt-hour.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

evidence

Every factual conclusion cites the correct input record. Missing evidence remains explicit.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 3

workflow

The submitted workflow produces cost-comparison.csv and a draft operating-change request with independent verification.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 4

robustness

Expire the feasibility report. Require a new simulation instead of assuming unchanged pressure.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

  • Choose the lowest-cost candidate that passes the supplied hydraulic feasibility check. Prices are per kilowatt-hour.

  • Produce cost-comparison.csv and a draft operating-change request.

  • Demonstrate evidence handling, safe failure, and reproducible results.

Resources

Dataset notes

Three authored synthetic examples for Prepare a Pump Tariff Change Review. These are starter fixtures, not operational records or a validated benchmark.

Challenge setup

Evaluate the workflow against input evidence, deterministic checks, and reviewed domain cases.

Challenge input

JSON object with payload field

pandas

deterministic processing or artifact creation in the agent workflow.

OR-Tools

deterministic processing or artifact creation in the agent workflow.

Evaluated output

JSON result object

Evaluation checks
  • Choose the lowest-cost candidate that passes the supplied hydraulic feasibility check. Prices are per kilow...
  • Every factual conclusion cites the correct input record. Missing evidence remains explicit.
  • The submitted workflow produces cost-comparison.csv and a draft operating-change request with independent v...
Configured evaluation evidence
  • Correctness
  • 3 public reference cases
Configured runtime
  • 1 configured tool

Shows the first task, up to three tools, and up to three evidence items.

View technical recipe

Configured tools

Policy Serving
  • OpenAI GPT-6 Astra · Required

Evaluation contract

  • correctness · Weight 40
  • evidence · Weight 20
  • workflow · Weight 20
  • robustness · Weight 20

Metrics

  • correctness
  • evidence
  • workflow
  • robustness

Reference cases

  • 3 public reference cases

Workflow tasks

  1. Task 1

    Input: JSON object with payload field

    Output: JSON result object

  2. Task 2

    Input: JSON object with payload field

    Output: JSON result object

  3. Task 3

    Input: JSON object with payload field

    Output: JSON result object

Evaluation tools

  • pandas · deterministic processing or artifact creation
  • OR-Tools · deterministic processing or artifact creation

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Prepare a Pump Tariff Change Review