Public evaluation

Narrative Branching Eval

Assessment of narrative consistency and latency in conversational flow.

Evaluation type

task based

Challenge

Building Real-Time Interactive Narratives with OpenAI Agents SDK and DeepSeek R1

Difficulty

Intermediate

Rigor

Unspecified

Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks

Benchmarks

Criteria

Task templates

Inputs and expected outputs.

Task 1

Narrative Branching Eval

Measures logical coherence across five turn segments.

Input format

Initial narrative prompt

Output format

Character dialogue chain

Linked challenge

Building Real-Time Interactive Narratives with OpenAI Agents SDK and DeepSeek R1

Create an immersive, interactive agent system designed to generate dynamic microdramas. Using the OpenAI Agents SDK, you will develop a multi-turn conversation orchestrator that manages character persona state and narrative flow. This challenge leverages the DeepSeek R1 reasoning model to ensure that plot development remains coherent and follows complex character arcs defined by the user. Integration with Sarvam AI enables voice-native interaction, while Browserbase provides the infrastructure for agents to perform live-web actions, such as fetching real-time context to enrich the story. All traffic and model routing is managed through Vercel AI Gateway, providing enterprise-grade analytics on token usage and model performance. Google Jules serves as the core development assistant for debugging the logic flows within your agentic stack.

Open challenge