Dynamic Policy Generation
Evaluation will focus on the accuracy and compliance of generated policies, the efficiency of risk assessment, and the robustness of enterprise system integration.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Task templates
Inputs and expected outputs.
Dynamic Policy Generation
Generate a customized insurance policy draft for a complex client profile, incorporating specific risk factors and regulatory requirements.
{ "client_profile": { "age": "int", "location": "string", "assets": "float", "health_history": ["string"] }, "policy_type": "string", "regulatory_constraints": ["string"] }
{ "policy_draft_text": "string", "risk_score": "float", "justification": "string", "compliance_issues": ["string"] }
Enterprise System Interaction
Simulate an agent interacting with a mock enterprise CRM system to retrieve client data and update policy status.
{ "client_id": "string", "action": "string", "update_data": { "field": "value" } }
{ "status": "string", "response_data": { "field": "value" }, "tools_invoked": ["string"] }