DraftingTask
The evaluation will focus on the functionality of the AI assistant, the quality and structure of the generated regulatory text, and the real-time interactivity of the interface. Automated tests will check for schema compliance and basic factual accuracy, while a manual review will assess nuance and clarity.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Task templates
Inputs and expected outputs.
DraftingTask
Generate a section of a hypothetical regulation based on a given topic and specific constraints.
{ "topic": "string", "constraints": "array<string>", "desired_structure": "object" }
{ "generated_text": "string", "adherence_score": "number", "validation_errors": "array<string>" }
InteractiveFeedbackTask
Demonstrate real-time feedback and iterative refinement of the generated text through user interaction.
{ "initial_prompt": "string", "feedback_steps": "array<{ type: 'edit' | 'add', content: 'string' }>" }
{ "final_text": "string", "interaction_log": "array<string>" }