Build a Bonsai IFC Quality Assurance Gherkin Rule Verifier
Formulate automated Gherkin acceptance test scenarios for architectural IFC models using ifcbimtester principles. Validate deliverable models before client handover against contractual BIM execution plans and classification standards.
What you are building
The core problem, expected build, and operating context for this challenge.
Formulate automated Gherkin acceptance test scenarios for architectural IFC models using ifcbimtester principles. Validate deliverable models before client handover against contractual BIM execution plans and classification standards.
BIM Quality Assurance Manager
Ingest client BIM execution plan clauses and convert requirements into Gherkin feature files.
Execute ifcbimtester rules against incoming architectural IFC model files.
Evaluate entity classifications, mandatory attributes, and geometric representations.
Produce an interactive HTML compliance audit dashboard with actionable remediation steps.
QA scorecard interface displaying pass/fail step indicators, failing IFC entity IDs, and error traces.
Generate mock IFC4 architectural models paired with synthetic Gherkin feature specification scripts. Starter examples below are synthetic. They are not downloaded records.
IfcOpenShell Integrates the ifcbimtester tool from the IfcOpenShell tool directory for Gherkin-based BIM testing.
mastra-ai, ifcopenshell, behave. Mastra AI orchestrates test execution workflows, parameter bindings, and structured evaluation logging. API-hosted LLM capable of translating contractual BIM requirements into formal Gherkin scenarios.
Submit runnable source, pinned dependencies, setup commands, a working interface, example outputs, and a recorded end-to-end demo. Include tests and an action log.
Parses Gherkin feature files defining IFC model acceptance criteria.
Executes entity-level rule evaluation for IfcWall, IfcDoor, and IfcSpace entities.
Outputs structured compliance report itemizing failing entity GlobalIds.
```json [ { "input": { "gherkin_rule": "Feature: Wall Classification\nScenario: All external walls must have FireRating\nGiven the model has IfcWall entities\nThen every external IfcWall must have property FireRating", "ifc_entities": [ { "global_id": "WALL-001", "type": "IfcWall", "is_external": true, "properties": { "FireRating": "2HR" } }, { "global_id": "WALL-002", "type": "IfcWall", "is_external": false, "properties": {} } ] }, "expected_output": { "total_tested": 2, "passed": true, "violations": [] } }, { "input": { "gherkin_rule": "Feature: Wall Classification\nScenario: All external walls must have FireRating\nGiven the model has IfcWall entities\nThen every external IfcWall must have property FireRating", "ifc_entities": [ { "global_id": "WALL-003", "type": "IfcWall", "is_external": true, "properties": {} } ] }, "expected_output": { "total_tested": 1, "passed": false, "violations": [ { "global_id": "WALL-003", "error": "External IfcWall lacks mandatory property 'FireRating'" } ] } } ] ```
Ensures acceptance tests run in sandboxed read-only memory; does not modify submitted master models. Use mock external writes. Require human review before any real deployment.
Participation guide
Ensures acceptance tests run in sandboxed read-only memory; does not modify submitted master models. Use mock external writes and human review.
How work is evaluated
Parses Gherkin feature files defining IFC model acceptance criteria. Executes entity-level rule evaluation for IfcWall, IfcDoor, and IfcSpace entities. Outputs structured compliance report itemizing failing entity GlobalIds.
Runnable source, pinned dependencies, setup commands, working interface, example outputs, recorded demo, tests, and action logs.
Challenge datasets
Public datasets, plus the private datasets you have access to.
How submissions are scored
These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.
Complete workflow
Ingest client BIM execution plan clauses and convert requirements into Gherkin feature files. Execute ifcbimtester rules against incoming architectural IFC model files. Evaluate entity classifications, mandatory attributes, and geometric representations. Produce an interactive HTML compliance audit dashboard with actionable remediation steps.
Missing or incorrect.
Partly complete, with documented gaps.
Complete, with reproducible evidence.
Correctness and evidence
Parses Gherkin feature files defining IFC model acceptance criteria. Executes entity-level rule evaluation for IfcWall, IfcDoor, and IfcSpace entities. Outputs structured compliance report itemizing failing entity GlobalIds.
Missing or incorrect.
Partly complete, with documented gaps.
Complete, with reproducible evidence.
Review interface
QA scorecard interface displaying pass/fail step indicators, failing IFC entity IDs, and error traces.
Missing or incorrect.
Partly complete, with documented gaps.
Complete, with reproducible evidence.
Safe execution
Ensures acceptance tests run in sandboxed read-only memory; does not modify submitted master models.
This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.
What you should walk away with
Ingest client BIM execution plan clauses and convert requirements into Gherkin feature files.
Execute ifcbimtester rules against incoming architectural IFC model files.
Evaluate entity classifications, mandatory attributes, and geometric representations.
Produce an interactive HTML compliance audit dashboard with actionable remediation steps.
Reference links and supporting material
Generate mock IFC4 architectural models paired with synthetic Gherkin feature specification scripts. Supplied starter examples are synthetic, not source extracts.
Challenge setup
Configuration summary for this challenge.
Challenge input
Input details are not configured.
Mastra AI
TypeScript agent framework.
Evaluated output
No output checks are configured.
- Ingest client BIM execution plan clauses and convert requirements into Gherkin feature files. Execute ifcbi...
- Parses Gherkin feature files defining IFC model acceptance criteria. Executes entity-level rule evaluation...
- QA scorecard interface displaying pass/fail step indicators, failing IFC entity IDs, and error traces.
- 2 public reference cases
- 2 configured tools
Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.
View technical recipe
Configured tools
- Mastra AI · Optional
- Mastra AI · Optional
Evaluation contract
- Complete workflow · Weight 40
- Correctness and evidence · Weight 30
- Review interface · Weight 20
- Safe execution · Weight 10
Reference cases
- 2 public reference cases
Workflow tasks
No workflow tasks are configured.
Recipe freeze marker
No recipe freeze time is recorded.