Skip to main content
Back to challenges
Challenge

Office Conversion Feasibility Engine using LangChain and Relicx Workflow Testing

Commercial office-to-residential conversions often encounter budget overruns due to undisclosed structural load limits and egress bottlenecks. Build a LangChain structural audit agent integrated with Relicx test automation to parse CAD metadata and verify building feasibility with 90% accuracy.

Business OperationsHosted by Vera
Sign in free to start
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Implement a stateful LangChain workflow that evaluates structural architectural blueprints against residential building code constraints while validating user interactions via Relicx.

Delivery guide

How work is evaluated

Evaluation

Evaluates the precision of structural feasibility scoring and the pass rate of Relicx workflow assertions.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

Egress Compliance Accuracy

Verifies that egress non-compliance is correctly detected.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

feasibility_score_mae

Mean Absolute Error between predicted feasibility score and expert ground truth • target: 5 • range: 0-100

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Construct a LangGraph agentic pipeline to extract structural constraints from building blueprints.

  • Integrate Relicx workflow assertions to test user-facing conversion feasibility reports.

  • Calculate floor plate depth and HVAC vertical shaft conversion cost penalties.

  • Achieve automated validation of residential egress compliance against regional building codes.

Resources and assets

Reference links and supporting material

Dataset notes

Synthetic dataset of 150 commercial office building floor plans with annotated perimeter depths, shaft counts, window retrofitting flags, and actual conversion cost metrics.

Challenge setup

Evaluates the precision of structural feasibility scoring and the pass rate of Relicx workflow assertions.

Challenge input

JSON containing floor plate depth, core distance, and window perimeter

LangChain

Required framework for building stateful multi-step agent reasoning chains.

Relicx

Required tool for testing end-to-end agent workflow execution and dashboard renders.

Evaluated output

JSON with feasibility_score (0-100), estimated_cost_sqft, and egress_compliant (boolean)

Evaluation checks
  • Verifies that egress non-compliance is correctly detected.
  • Mean Absolute Error between predicted feasibility score and expert ground truth • target: 5 • range: 0-100
Configured evaluation evidence
  • Benchmark: CRE Structural Feasibility Benchmark
  • Feasibility Score Mae target: 5
  • 1 public reference case
Configured runtime
  • Python execution harness
  • Python sandbox (unavailable on Versalist)

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Action Space
  • Relicx · Required
  • Langchain · Optional
  • All Hands AI · Optional
Orchestration
  • Langchain · Optional

Evaluation contract

  • Egress Compliance Accuracy · Weight 1
  • feasibility_score_mae · Weight 1

Metrics

  • feasibility_score_mae · Target 5

Benchmarks

  • CRE Structural Feasibility Benchmark
  • general

Reference cases

  • 1 public reference case

Workflow tasks

  1. Task 1

    Input: JSON containing floor plate depth, core distance, and window perimeter

    Output: JSON with feasibility_score (0-100), estimated_cost_sqft, and egress_compliant (boolean)

    Execution harness: Python

Evaluation tools

  • LangChain · Orchestration Framework
  • Relicx · AI Workflow Automation & UI Testing

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Office Conversion Feasibility Engine using LangChain and Relicx Workflow Testing