Back to evaluations
Draft evaluation

Automate BPO Insurance Claims Intake with AI SDK and Cognition Devin Agent — evaluation

Evaluates TypeScript AI SDK streaming pipeline speed and field extraction accuracy.

Evaluation type
task based
Challenge
Automate BPO Insurance Claims Intake with AI SDK and Cognition Devin Agent
Difficulty
Intermediate
Rigor
Not declared

The author has not specified a rigor level.

Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

Streaming Intake Validation

Streams raw text claims and measures JSON extraction precision and execution time.

Input format

Unstructured text string representing intake call report

Output format

Validated Zod JSON object with caller_name, loss_date, loss_type, estimate