Back to evaluations
Draft evaluation

Build Real-Time Catalog Sync Agents with AI SDK and Blaxel — evaluation

Measures catalog conflict resolution latency and accuracy under high update throughput.

Evaluation type
task based
Challenge
Build Real-Time Catalog Sync Agents with AI SDK and Blaxel
Difficulty
Intermediate
Rigor
Not declared

The author has not specified a rigor level.

Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

catalog_sync_eval

Sends parallel catalog updates to the agent runtime and checks output reconciliation state.

Input format

JSON object with conflicting stock records

Output format

JSON object with resolved master stock record