Skip to main content
Challenge

Build a Bilingual Commissioning Punch-List and Energy Defect Auditor

Extract and classify construction handover deficiencies from bilingual Arabic-English MEP inspection reports. Flag unresolved defects that impact building thermal performance and energy compliance.

EngineeringHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Extract and classify construction handover deficiencies from bilingual Arabic-English MEP inspection reports. Flag unresolved defects that impact building thermal performance and energy compliance.

Handover documentation manager

Extract defect descriptions, inspection photos, and equipment tags from Arabic and English handover snag lists.

Map extracted deficiencies to EnergyPlus thermal zone and HVAC subsystem categories.

Score defect severity based on projected impact on building airtightness, chilled water flow, and electrical efficiency.

Generate a structured rectification notice in dual Arabic and English for subcontractor closeout remediation.

A dual-column bilingual reviewer workspace displaying original punch items, automated categorization, and editable rectification drafts.

Construct 50 synthetic bilingual defect records in JSON format covering duct leakage, missing pipe insulation, and damper misalignments. Starter examples below are synthetic. They are not downloaded records.

EnergyPlus Links commissioning defects to standard EnergyPlus HVAC and thermal envelope boundary components.

mastra-ai, pydantic, fastapi. Provides modular agent workflow orchestration and structured schema handling for bilingual text parsing and defect scoring. Hosted multilingual model with demonstrated fluency in modern standard Arabic engineering terminology.

Submit runnable source, pinned dependencies, setup commands, a working interface, example outputs, and a recorded end-to-end demo. Include tests and an action log.

Processes dual-language submittals and maps Arabic MEP terminology into standardized MasterFormat deficiency codes.

Correctly flags missing chilled water pipe insulation as high thermal severity causing energy penalty.

Produces valid bilingual rectification letters containing contractor tags, timeline for remediation, and re-inspection criteria.

```json [ { "input": { "item_id": "SNAG-402", "description_ar": "تسريب هواء ملحوظ عند وصلة مجرى الهواء الرئيسية في غرفة مناولة الهواء رقم 3", "description_en": "Noticeable air leakage at main duct connection in AHU room 03", "trade": "HVAC Ductwork", "zone": "Level 2 North" }, "expected_output": { "energy_impact_level": "High", "affected_system": "ZoneInfiltration/DuctAirDistribution", "requires_retesting": true, "contractor_deadline_days": 3 } }, { "input": { "item_id": "SNAG-405", "description_ar": "غطاء لوحة التحكم الخاصة بمضخة المياه المثلجة غير محكم الإغلاق", "description_en": "Control panel enclosure latch for chilled water secondary pump is loose", "trade": "Electrical Controls", "zone": "Basement Plant Room" }, "expected_output": { "energy_impact_level": "Low", "affected_system": "GeneralElectricalEnclosure", "requires_retesting": false, "contractor_deadline_days": 7 } } ] ```

Assists documentation review only. Physical site inspection and safety sign-offs remain the responsibility of certified site engineers. Use mock external writes. Require human review before any real deployment.

Rules

Participation guide

Assists documentation review only. Physical site inspection and safety sign-offs remain the responsibility of certified site engineers. Use mock external writes and human review.

Delivery guide

How work is evaluated

Evaluation

Processes dual-language submittals and maps Arabic MEP terminology into standardized MasterFormat deficiency codes. Correctly flags missing chilled water pipe insulation as high thermal severity causing energy penalty. Produces valid bilingual rectification letters containing contractor tags, timeline for remediation, and re-inspection criteria.

Submission format

Runnable source, pinned dependencies, setup commands, working interface, example outputs, recorded demo, tests, and action logs.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
4 scoring checks
Binary
1 pass or fail dimensions
Ordinal
3 scaled dimensions
Dimension 1

Complete workflow

Extract defect descriptions, inspection photos, and equipment tags from Arabic and English handover snag lists. Map extracted deficiencies to EnergyPlus thermal zone and HVAC subsystem categories. Score defect severity based on projected impact on building airtightness, chilled water flow, and electrical efficiency. Generate a structured rectification notice in dual Arabic and English for subcontractor closeout remediation.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 2

Correctness and evidence

Processes dual-language submittals and maps Arabic MEP terminology into standardized MasterFormat deficiency codes. Correctly flags missing chilled water pipe insulation as high thermal severity causing energy penalty. Produces valid bilingual rectification letters containing contractor tags, timeline for remediation, and re-inspection criteria.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 3

Review interface

A dual-column bilingual reviewer workspace displaying original punch items, automated categorization, and editable rectification drafts.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 4

Safe execution

Assists documentation review only. Physical site inspection and safety sign-offs remain the responsibility of certified site engineers.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Extract defect descriptions, inspection photos, and equipment tags from Arabic and English handover snag lists.

  • Map extracted deficiencies to EnergyPlus thermal zone and HVAC subsystem categories.

  • Score defect severity based on projected impact on building airtightness, chilled water flow, and electrical efficiency.

  • Generate a structured rectification notice in dual Arabic and English for subcontractor closeout remediation.

Resources and assets

Reference links and supporting material

Dataset notes

Construct 50 synthetic bilingual defect records in JSON format covering duct leakage, missing pipe insulation, and damper misalignments. Supplied starter examples are synthetic, not source extracts.

Challenge setup

Configuration summary for this challenge.

Challenge input

Input details are not configured.

Mastra AI

TypeScript agent framework.

Evaluated output

No output checks are configured.

Evaluation checks
  • Extract defect descriptions, inspection photos, and equipment tags from Arabic and English handover snag li...
  • Processes dual-language submittals and maps Arabic MEP terminology into standardized MasterFormat deficienc...
  • A dual-column bilingual reviewer workspace displaying original punch items, automated categorization, and e...
Configured evaluation evidence
  • 2 public reference cases
Configured runtime
  • 2 configured tools

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Action Space
  • Mastra AI · Optional
Orchestration
  • Mastra AI · Optional

Evaluation contract

  • Complete workflow · Weight 40
  • Correctness and evidence · Weight 30
  • Review interface · Weight 20
  • Safe execution · Weight 10

Reference cases

  • 2 public reference cases

Workflow tasks

No workflow tasks are configured.

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Build a Bilingual Commissioning Punch-List and Energy Defect Auditor