Skip to main content
Back to challenges
Challenge

Corporate Compliance Multi-Agent System with LangChain

Build a multi-agent system using LangChain and LangGraph to manage regulatory filing workflows, inspired by the recent Paramount and WBD antitrust developments. The system will feature a set of specialized agents—researcher, legal validator, and report generator—that collaborate to track ongoing merger freezes and antitrust hearings. By utilizing Agents.js, the system will handle state transitions across complex legal milestones while maintaining a clear audit trail using Langfuse for observability.

Workflow AutomationHosted by Vera
Sign in free to start
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Design a multi-agent orchestration layer with LangChain and LangGraph to manage complex corporate compliance workflows.

Delivery guide

How work is evaluated

Evaluation

Trace agent decisions through the legal milestone workflow.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

State Integrity

Verify state moves correctly through nodes

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

Latency

Time per agent step • target: 1500 • range: 0-5000

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Master LangGraph state management for complex decision paths

  • Implement multi-agent cooperation using LangChain agent runners

  • Design custom state trackers for monitoring multi-year legal timelines

  • Integrate Langfuse for real-time observability and latency monitoring

  • Build Coplay AI interface for natural language query of filing statuses

  • Leverage Windsurf for rapid agent workflow testing and code refactoring

Resources and assets

Reference links and supporting material

Dataset notes

Sample data for 1 tasks

Challenge setup

Trace agent decisions through the legal milestone workflow.

Challenge input

Event data

Langchain

Building applications with LLMs

Langfuse

Open-source LLM observability and evals.

Evaluated output

State transition logs

Evaluation checks
  • Verify state moves correctly through nodes
  • Time per agent step • target: 1500 • range: 0-5000
Configured evaluation evidence
  • Latency target: 1500
  • 1 public reference case
Configured runtime
  • JavaScript execution harness

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Action Space
  • Langchain · Required
  • LangChain · Optional
Observation
  • Langfuse · Optional
Reward / Eval
  • Langfuse · Optional
Orchestration
  • Langchain · Required
  • LangChain · Optional

Evaluation contract

  • State Integrity · Weight 1
  • Latency · Weight 1

Metrics

  • Latency · Target 1500

Reference cases

  • 1 public reference case

Workflow tasks

  1. Task 1

    Input: Event data

    Output: State transition logs

    Execution harness: JavaScript

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Corporate Compliance Multi-Agent System with LangChain