Back to evaluations
Public evaluation

Streaming Intake Validation

Evaluates TypeScript AI SDK streaming pipeline speed and field extraction accuracy.

Evaluation type
task based
Challenge
Automate BPO Insurance Claims Intake with AI SDK and Cognition Devin Agent
Difficulty
Intermediate
Rigor
Unspecified
Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

Streaming Intake Validation

Streams raw text claims and measures JSON extraction precision and execution time.

Input format

Unstructured text string representing intake call report

Output format

Validated Zod JSON object with caller_name, loss_date, loss_type, estimate