Skip to main content
Back to challenges
Challenge

Orchestrating Autonomous Claude Opus 4.6.6 Agent Swarms with LlamaIndex

This challenge focuses on building an autonomous agent swarm capable of complex content synthesis and media-business logic. Using LlamaIndex as the primary orchestration framework, you will create specialized agents that coordinate to process media programming schedules. The system utilizes Claude Opus 4.6.6 for high-level reasoning and synthesis tasks while maintaining deep context across long-running tasks. By integrating Cognition Devin patterns for agent autonomous action, you will automate the generation of content briefs. Use Cursor to manage your codebase development during the agent orchestration implementation. Finally, deploy a voice-feedback loop using Cartesia to provide real-time status updates on swarm activity, utilizing AutoGluon for automating parameter optimization in the underlying agent logic.

Special Purpose AgentsHosted by Vera
Sign in free to start
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Orchestrate autonomous agent swarms using LlamaIndex and Claude Opus 4.6.6 for intelligent content management.

Delivery guide

How work is evaluated

Evaluation

Evaluates the coherence and task completion rate of the swarm.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

Deadlock check

Swarm must reach terminal state

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

Context Retention

Context continuity score • target: 90 • range: 0-100

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Master LlamaIndex agentic abstractions for multi-node orchestration and complex task chains

  • Design hierarchical swarm architectures where agents delegate sub-tasks to Claude Opus 4.6.6

  • Integrate AutoGluon for adaptive tuning of agent inference parameters to minimize latency

  • Use Cursor to architect modular code structures for complex agent logic and tool-calling interfaces

  • Build real-time auditory status channels using Cartesia voice synthesis

  • Implement autonomous state management using LlamaIndex Data Agents for persistent workflow orchestration

Resources and assets

Reference links and supporting material

Dataset notes

Sample data for 1 tasks

Challenge setup

Evaluates the coherence and task completion rate of the swarm.

Challenge input

Task dependency graph

Llama Index

Data framework for LLM

Cognition Devin

AI software engineering agent.

Cartesia

Real-time voice AI

Evaluated output

Status logs

Evaluation checks
  • Swarm must reach terminal state
  • Context continuity score • target: 90 • range: 0-100
Configured evaluation evidence
  • Context Retention target: 90
  • 1 public reference case
Configured runtime
  • Docker execution harness

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Action Space
  • Llama Index · Required
  • Cognition Devin · Optional
  • Cartesia · Optional
Observation
  • Cognition Devin · Optional
Orchestration
  • Cognition Devin · Optional

Evaluation contract

  • Deadlock check · Weight 1
  • Context Retention · Weight 1

Metrics

  • Context Retention · Target 90

Reference cases

  • 1 public reference case

Workflow tasks

  1. Task 1

    Input: Task dependency graph

    Output: Status logs

    Execution harness: Docker

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Orchestrating Autonomous Claude Opus 4.6.6 Agent Swarms with LlamaIndex