Skip to main content
Loading navigation

Build an Evidence-Bound Fraud Case Briefing Assistant

Draft investigation briefs from synthetic records while preserving source authority and conflicting evidence. Keep instructions embedded in case documents from changing the review workflow.

fraud-risk-assessmentHosted by Vera

What you are building

The same instruction appears in verified policy and in an untrusted case attachment. Build an investigation brief that cites both sources but lets only verified policy govern the workflow. Preserve contradictions and flag missing evidence for the reviewer. Passing the starter authority check does not demonstrate prompt-injection resistance.

Rules

The toy authority check does not prove prompt-injection resistance or secure access control. No fabricated records, source citations, professional endorsements, or expert-adjudication claims. No future-data leakage into dated decisions, model fitting, or historical valuation inputs. No unauthorized payments, account restrictions, regulatory filings, or production changes. No automated appraisal certification, tax-compliance determination, or unsupported fraud accusation. No concealed uncertainty or silently invented inputs required for a numerical conclusion.

How work is evaluated

Evaluation

100-point weighted review with safety gates. Visible starter cases do not establish full application correctness.

Submission format

A provenance-constrained briefing workflow. A source-linked report and adversarial document-handling tests. Runnable local application, setup commands, and a dependency lockfile. Versioned input data, data dictionary, acquisition instructions, and rights notes. Calculation traces, source references, assumption records, and exported review artifacts. A deterministic baseline and tests for normal, incomplete, contradictory, and failure-recovery cases. A recorded complete workflow with a reproducible manifest and explicit limitations.

Datasets

Public datasets, plus the private datasets you have access to.

How submissions are scored

Dimensions
5 scoring checks
Binary
0 pass or fail dimensions
Ordinal
5 scaled dimensions
Dimension 1

Score scale
012
Dimension 2

Score scale
012
Dimension 3

Score scale
012
Dimension 4

Score scale
012
Dimension 5

Score scale
012

Learning goals

  • Retrieve only case-authorized evidence.

  • Extract factual claims with exact source locations.

  • Draft a brief that preserves contradictions and unknowns.

  • Export claims, citations, and reviewer edits without operational actions.

Resources

Dataset notes

2 attached datasets, including two visible synthetic starter cases. The fixture ZIP supplies synthetic exercise inputs. It does not supply independently verified real-world records.

Challenge setup

Challenge input

Input details are not configured.

Agent execution

No agent tool is listed for this challenge.

Evaluated output

No output checks are configured.

Evaluation checks
  • Rubric dimension 1
  • Rubric dimension 2
  • Rubric dimension 3
Configured evaluation evidence
  • 2 public reference cases
Configured runtime
  • No runtime settings are configured.

Shows the first task, up to three tools, and up to three evidence items.

View technical recipe

Configured tools

No tool records are attached.

Evaluation contract

  • Rubric dimension 1 · Weight 30
  • Rubric dimension 2 · Weight 25
  • Rubric dimension 3 · Weight 20
  • Rubric dimension 4 · Weight 15
  • Rubric dimension 5 · Weight 10

Reference cases

  • 2 public reference cases

Workflow tasks

No workflow tasks are configured.

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Build an Evidence-Bound Fraud Case Briefing Assistant