Back to challenges
Challenge

Office Conversion Feasibility Engine using LangChain and Relicx Workflow Testing

Commercial office-to-residential conversions often encounter budget overruns due to undisclosed structural load limits and egress bottlenecks. Build a LangChain structural audit agent integrated with Relicx test automation to parse CAD metadata and verify building feasibility with 90% accuracy.

Business OperationsHosted by Vera
Sign in free to start
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Implement a stateful LangChain workflow that evaluates structural architectural blueprints against residential building code constraints while validating user interactions via Relicx.

Delivery guide

How work is evaluated

Evaluation

Evaluates the precision of structural feasibility scoring and the pass rate of Relicx workflow assertions.

Datasets

Shared data for this challenge

Review public datasets and any private uploads tied to your build.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

Egress Compliance Accuracy

Verifies that egress non-compliance is correctly detected.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

feasibility_score_mae

Mean Absolute Error between predicted feasibility score and expert ground truth • target: 5 • range: 0-100

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Construct a LangGraph agentic pipeline to extract structural constraints from building blueprints.

  • Integrate Relicx workflow assertions to test user-facing conversion feasibility reports.

  • Calculate floor plate depth and HVAC vertical shaft conversion cost penalties.

  • Achieve automated validation of residential egress compliance against regional building codes.

Resources and assets

Reference links and supporting material

Dataset notes

Synthetic dataset of 150 commercial office building floor plans with annotated perimeter depths, shaft counts, window retrofitting flags, and actual conversion cost metrics.

How this agent runs

Evaluates the precision of structural feasibility scoring and the pass rate of Relicx workflow assertions.

Challenge input

JSON containing floor plate depth, core distance, and window perimeter

LangChain

Required framework for building stateful multi-step agent reasoning chains.

Relicx

Required tool for testing end-to-end agent workflow execution and dashboard renders.

Evaluated output

JSON with feasibility_score (0-100), estimated_cost_sqft, and egress_compliant (boolean)

Checks for
  • Verifies that egress non-compliance is correctly detected.
  • Mean Absolute Error between predicted feasibility score and expert ground truth • target: 5 • range: 0-100
Proof of success
  • Benchmark: CRE Structural Feasibility Benchmark
  • Feasibility Score Mae target: 5
  • 1 public reference case
Runtime evidence
  • Python execution harness
  • Python sandbox (unavailable on Versalist)
View technical recipe

Configured tools

Action Space
  • Relicx · Required
  • Langchain · Optional
  • All Hands AI · Optional
Orchestration
  • Langchain · Optional

Evaluation contract

  • Egress Compliance Accuracy · Weight 1
  • feasibility_score_mae · Weight 1

Recipe state

This is a preview. The configuration can change before the evaluation recipe is locked.

Frequently Asked Questions about Office Conversion Feasibility Engine using LangChain and Relicx Workflow Testing