TaxPolicyExtraction
Evaluation will assess the agent's ability to accurately extract structured information from policy documents, generate valid compliance reports, and identify non-compliance risks. Emphasis will be on output structure adherence and factual accuracy.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Task templates
Inputs and expected outputs.
TaxPolicyExtraction
Evaluates the agent's ability to extract specific tax exemption details from a provided policy document.
{'policy_text': 'string', 'query_field': 'string'}
{'extracted_info': 'dict', 'is_valid': 'bool', 'validation_errors': 'list_of_strings'}
ComplianceRecommendation
Assesses the agent's ability to provide a compliance recommendation given a business scenario and a relevant policy.
{'business_scenario': 'string', 'policy_document': 'string'}
{'compliance_status': 'string', 'recommendations': 'list_of_strings', 'relevant_clauses': 'list_of_strings'}