Underwriter override feedback register
Build a review tool that captures why underwriters change agent recommendations. Separate model errors from policy changes before proposing training examples.
What you are building
Build a review tool that captures why underwriters change agent recommendations. Separate model errors from policy changes before proposing training examples.
Override O1 corrects a misread roof year. O2 applies a new appetite rule issued after the original run.
Label O1 an extraction error and O2 a rule change. Do not treat O2 as a model failure.
Submit a working local tool, setup instructions, and the output for the starter case. Include a second case with incomplete or changed inputs.
Rules
Use fictional records only. Do not bind coverage, issue payments, contact customers, or present exercise rates as market prices.
How work is evaluated
Label O1 an extraction error and O2 a rule change. Do not treat O2 as a model failure.
Submit a working local tool, setup instructions, and the output for the starter case. Include a second case with incomplete or changed inputs.
Datasets
Public datasets, plus the private datasets you have access to.
Learning goals
Build a review tool that captures why underwriters change agent recommendations. Separate model errors from policy changes before proposing training examples.
Label O1 an extraction error and O2 a rule change. Do not treat O2 as a model failure.
Resources
Fictional starter case: Override O1 corrects a misread roof year. O2 applies a new appetite rule issued after the original run.
Challenge setup
Challenge input
Input details are not configured.
Agent execution
No agent tool is listed for this challenge.
Evaluated output
No output checks are configured.
- No evaluation checks are configured.
- 1 public reference case
- No runtime settings are configured.
Shows the first task, up to three tools, and up to three evidence items.
View technical recipe
Configured tools
No tool records are attached.
Evaluation contract
- No evaluation checks are configured.
Reference cases
- 1 public reference case
Workflow tasks
No workflow tasks are configured.
Recipe freeze marker
No recipe freeze time is recorded.