Back to evaluations
Draft evaluation

ONDC Merchant Catalog Guardrailing with CrewAI and NVIDIA NeMo — evaluation

Evaluates catalog item processing for safety policy compliance and output schema alignment.

Evaluation type
task based
Challenge
ONDC Merchant Catalog Guardrailing with CrewAI and NVIDIA NeMo
Difficulty
Intermediate
Rigor
Not declared

The author has not specified a rigor level.

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

ondc_catalog_guardrail_eval

Processes raw merchant product entries, applies NeMo guardrails, and emits sanitized ONDC JSON.

Input format

JSON containing raw_title, description, price, and category_claim.

Output format

JSON containing ondc_title, normalized_category, safety_passed (bool), and flag_reasons list.