Skip to main content
Loading navigation
Back to challenges

Extended Reasoning Orchestration with Claude Agents SDK and Milvus

Design an enterprise planning architecture using Claude Agents SDK to manage complex document synthesis, inspired by the surge in public interest in classic literature reissues. By utilizing GPT-5.4 Pro as a reasoning engine and Milvus for high-performance retrieval of structured event data, you will build an agent capable of performing multi-step analysis on lengthy texts, ensuring reasoning is persistent and globally indexed across long-horizon projects.

Machine LearningHosted by Vera
Sign in free to start

What you are building

Orchestrate advanced reasoning agents with Claude Agents SDK and Milvus to analyze and synthesize large-scale document collections.

How work is evaluated

Evaluation

Multi-step reasoning accuracy and retrieval performance.

Datasets

Public datasets, plus the private datasets you have access to.

How submissions are scored

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

SynthesisCompleteness

Ensure no key plot points missed

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

RetrievalPrecision

Milvus recall score • target: 0.95 • range: 0.85-1

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

  • Master long-context reasoning using Claude Agents SDK for complex synthesis

  • Implement persistent memory buffers using Milvus for high-speed retrieval

  • Orchestrate hybrid reasoning cycles combining GPT-5.4 Pro and Claude Sonnet 4.6.6

  • Deploy optimized inference pipelines using Novita AI

  • Build self-correcting agents that verify facts against indexed datasets

  • Design advanced observability dashboards for multi-model decision traces

Resources

Dataset notes

Sample data for 1 tasks

Challenge setup

Multi-step reasoning accuracy and retrieval performance.

Challenge input

Complex document text

Milvus

Vector DB

Zed

High-performance code editor

GPT-5

Policy Serving in the agent workflow.

Evaluated output

Structured synthesis report

Evaluation checks
  • Ensure no key plot points missed
  • Milvus recall score • target: 0.95 • range: 0.85-1
Configured evaluation evidence
  • RetrievalPrecision target: 0.95
  • 1 public reference case
Configured runtime
  • Docker execution harness

Shows the first task, up to three tools, and up to three evidence items.

View technical recipe

Configured tools

Action Space
  • Milvus · Required
  • Zed · Optional
Policy Serving
  • GPT-5 · Optional

Evaluation contract

  • SynthesisCompleteness · Weight 1
  • RetrievalPrecision · Weight 1

Metrics

  • RetrievalPrecision · Target 0.95

Reference cases

  • 1 public reference case

Workflow tasks

  1. Task 1

    Input: Complex document text

    Output: Structured synthesis report

    Execution harness: Docker

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Extended Reasoning Orchestration with Claude Agents SDK and Milvus