Back to evaluations
Public evaluation

ArgumentGeneration_ProTax

Evaluation will focus on the quality, factual accuracy, logical coherence, and persuasive strength of the arguments generated by the agent system for specified policy scenarios. Gentrace will be used to track and score these metrics.

Evaluation type
task based
Challenge
AI Policy Argument Generation Agent
Difficulty
Advanced
Rigor
Unspecified
Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
2
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

ArgumentGeneration_ProTax

Generates arguments in favor of an 'AI tax' on synthetic actors, given a set of policy documents.

Input format

{"stakeholder": "SAG-AFTRA", "topic": "AI Tax on Synthetic Actors", "documents": [{"title": "string", "content": "string"}]}

Output format

{"argument_text": "string", "key_points": ["string"], "potential_impacts": ["string"]}

Task 2

ArgumentGeneration_AntiTax

Generates counter-arguments against an 'AI tax' on synthetic actors, given the same policy documents.

Input format

{"stakeholder": "Studio Executives", "topic": "AI Tax on Synthetic Actors", "documents": [{"title": "string", "content": "string"}]}

Output format

{"argument_text": "string", "key_points": ["string"], "potential_impacts": ["string"]}