Back to challenges
Challenge

LlamaIndex & Claude 4 Opus Senior Housing Operator Intelligence Engine

Senior housing requires complex regulatory, demographic, and operational analysis across massive document stores. Build an advanced RAG retrieval engine using LlamaIndex powered by Claude 4 Opus to query municipal licensing and operational guidelines accurately.

Business OperationsHosted by Vera
Sign in free to start
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Develop an enterprise LlamaIndex RAG application with Claude 4 Opus to index and query senior housing regulatory and operational filings.

Delivery guide

How work is evaluated

Evaluation

Evaluates factual recall and citation precision for senior housing compliance queries.

Datasets

Shared data for this challenge

Review public datasets and any private uploads tied to your build.

Loading datasets...
Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

citation_accuracy_test

Checks if provided section citations match actual regulatory code sections.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

faithfulness_score

RAG faithfulness score assessing absence of hallucinated requirements. • target: 0.95 • range: 0-1

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Construct a LlamaIndex VectorStoreIndex over senior housing state regulations

  • Configure Anthropic Claude 4 Opus as the primary LLM engine for reasoning

  • Implement advanced retrieval strategies including sub-question query engines

  • Evaluate answer faithfulness and retrieval recall on complex regulatory queries

Resources and assets

Reference links and supporting material

Dataset notes

Corpus of state regulatory handbooks and licensing requirements for senior housing facilities across 10 states.

How this agent runs

Evaluates factual recall and citation precision for senior housing compliance queries.

Challenge input

JSON query specifying jurisdiction and facility class

LlamaIndex

Provides structured document indexing and sub-question query capabilities.

Claude 4 Opus

Delivers superior reasoning over detailed regulatory text.

Evaluated output

JSON response with answer_text, section_citations, and compliance_flag

Checks for
  • Checks if provided section citations match actual regulatory code sections.
  • RAG faithfulness score assessing absence of hallucinated requirements. • target: 0.95 • range: 0-1
Proof of success
  • Benchmark: HealthcareRegulatoryRAGBench
  • Faithfulness Score target: 0.95
  • 1 public reference case
Runtime evidence
  • Python execution harness
  • Python sandbox
View technical recipe

Configured tools

Action Space
  • Llama Index · Required
  • ElevenLabs · Optional
Policy Serving
  • Claude 4 Opus · Optional

Evaluation contract

  • citation_accuracy_test · Weight 1
  • faithfulness_score · Weight 1

Recipe state

This is a preview. The configuration can change before the evaluation recipe is locked.

Frequently Asked Questions about LlamaIndex & Claude 4 Opus Senior Housing Operator Intelligence Engine