Skip to main content
Challenge

Build a Bilingual Chiller Refrigerant Leak Safety Packager

Extract cooling plant sensor anomalies and Arabic-English safety logs to classify refrigerant leak severity. Synthesize bilingual environmental safety incident reports to ensure compliance and support audit-ready engineering sign-offs.

EngineeringHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Extract cooling plant sensor anomalies and Arabic-English safety logs to classify refrigerant leak severity. Synthesize bilingual environmental safety incident reports to ensure compliance and support audit-ready engineering sign-offs.

Facilities Asset Manager

Ingest bilingual safety logs and Building Management System (BMS) refrigerant pressure telemetry.

Extract safety interventions, leak locations, and severity indicators across Arabic and English text using an LLM.

Cross-reference asserted leak repair locations against BMS pressure recovery telemetry to verify mitigation success.

Synthesize audit-ready bilingual environmental compliance packets for safety engineering sign-off.

A split-pane web review interface showing aligned Arabic-English source safety logs, BMS pressure telemetry charts, and compliance report export actions.

Construct synthetic normalized JSON documents modeling bilingual Arabic-English chiller leak logs and CSV-based pressure and concentration sensor timeseries. Starter examples below are synthetic. They are not downloaded records.

EnergyPlus Leverages EnergyPlus schema concepts for chiller operational parameters to validate modeled pressure recovery after reported refrigerant leaks.

pydantic-ai, fastapi, jinja2. Enforces type-safe validation over bilingual entity extractions and structured safety incident verification schemas. Hosted or local multilingual LLM capable of robust Arabic-English code-switching and translating technical HVAC safety terms.

Submit runnable source, pinned dependencies, setup commands, a working interface, example outputs, and a recorded end-to-end demo. Include tests and an action log.

Harmonizes bilingual technical terms such as 'refrigerant leak' into standard schema fields.

Flags safety incident reports where asserted leak repair is not corroborated by BMS pressure stabilization.

Outputs verified bilingual safety packet containing Arabic and English executive summaries.

Maintains an audit log requiring safety supervisor approval before closing incident tickets.

```json [ { "input": { "ticket_id": "INC-001", "text_ar": "تم إصلاح تسرب غاز التبريد في المبرد رقم 1 واستقر الضغط.", "text_en": "Refrigerant leak repaired on Chiller 1 and pressure stabilized.", "telemetry_pre_kpa": 150, "telemetry_post_kpa": 350, "target_kpa": 350 }, "expected_output": { "ticket_id": "INC-001", "status": "VERIFIED", "leak_status": "REPAIRED", "summary_bilingual": { "en": "Chiller 1 leak repair verified by pressure recovery.", "ar": "تم التحقق من إصلاح تسرب المبرد 1 من خلال استعادة الضغط." }, "note": "Simplified synthetic app record." } }, { "input": { "ticket_id": "INC-002", "text_ar": "تم استبدال الصمام ولكن الضغط لا يزال منخفضا.", "text_en": "Valve replaced but pressure remains low.", "telemetry_pre_kpa": 180, "telemetry_post_kpa": 185, "target_kpa": 350 }, "expected_output": { "ticket_id": "INC-002", "status": "INVESTIGATION_REQUIRED", "leak_status": "PERSISTENT", "summary_bilingual": { "en": "Discrepancy: Persistent low pressure indicates leak is not fully mitigated.", "ar": "تعارض: يشير الضغط المنخفض المستمر إلى أن التسرب لم يتم التخفيف منه بالكامل." }, "note": "Simplified synthetic app record." } } ] ```

Read-only audit tool for incident records; does not write changes to live Building Management Systems or control physical valves. Use mock external writes. Require human review before any real deployment.

Rules

Participation guide

Read-only audit tool for incident records; does not write changes to live Building Management Systems or control physical valves. Use mock external writes and human review.

Delivery guide

How work is evaluated

Evaluation

Harmonizes bilingual technical terms such as 'refrigerant leak' into standard schema fields. Flags safety incident reports where asserted leak repair is not corroborated by BMS pressure stabilization. Outputs verified bilingual safety packet containing Arabic and English executive summaries. Maintains an audit log requiring safety supervisor approval before closing incident tickets.

Submission format

Runnable source, pinned dependencies, setup commands, working interface, example outputs, recorded demo, tests, and action logs.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
4 scoring checks
Binary
1 pass or fail dimensions
Ordinal
3 scaled dimensions
Dimension 1

Complete workflow

Ingest bilingual safety logs and Building Management System (BMS) refrigerant pressure telemetry. Extract safety interventions, leak locations, and severity indicators across Arabic and English text using an LLM. Cross-reference asserted leak repair locations against BMS pressure recovery telemetry to verify mitigation success. Synthesize audit-ready bilingual environmental compliance packets for safety engineering sign-off.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 2

Correctness and evidence

Harmonizes bilingual technical terms such as 'refrigerant leak' into standard schema fields. Flags safety incident reports where asserted leak repair is not corroborated by BMS pressure stabilization. Outputs verified bilingual safety packet containing Arabic and English executive summaries. Maintains an audit log requiring safety supervisor approval before closing incident tickets.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 3

Review interface

A split-pane web review interface showing aligned Arabic-English source safety logs, BMS pressure telemetry charts, and compliance report export actions.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 4

Safe execution

Read-only audit tool for incident records; does not write changes to live Building Management Systems or control physical valves.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Ingest bilingual safety logs and Building Management System (BMS) refrigerant pressure telemetry.

  • Extract safety interventions, leak locations, and severity indicators across Arabic and English text using an LLM.

  • Cross-reference asserted leak repair locations against BMS pressure recovery telemetry to verify mitigation success.

  • Synthesize audit-ready bilingual environmental compliance packets for safety engineering sign-off.

Resources and assets

Reference links and supporting material

Dataset notes

Construct synthetic normalized JSON documents modeling bilingual Arabic-English chiller leak logs and CSV-based pressure and concentration sensor timeseries. Supplied starter examples are synthetic, not source extracts.

Challenge setup

Configuration summary for this challenge.

Challenge input

Input details are not configured.

Pydantic AI

Typed Python agent framework.

Evaluated output

No output checks are configured.

Evaluation checks
  • Ingest bilingual safety logs and Building Management System (BMS) refrigerant pressure telemetry. Extract s...
  • Harmonizes bilingual technical terms such as 'refrigerant leak' into standard schema fields. Flags safety i...
  • A split-pane web review interface showing aligned Arabic-English source safety logs, BMS pressure telemetry...
Configured evaluation evidence
  • 2 public reference cases
Configured runtime
  • 2 configured tools

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Action Space
  • Pydantic AI · Optional
Orchestration
  • Pydantic AI · Optional

Evaluation contract

  • Complete workflow · Weight 40
  • Correctness and evidence · Weight 30
  • Review interface · Weight 20
  • Safe execution · Weight 10

Reference cases

  • 2 public reference cases

Workflow tasks

No workflow tasks are configured.

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Build a Bilingual Chiller Refrigerant Leak Safety Packager