Skip to main content
Challenge

Build an OCDS Multilingual Procurement Translation Review Workspace

Parse OCDS tender releases containing multilingual free-text descriptions. Consolidate language-suffixed party names and default language tags to unify fragmented supplier compliance records for efficient evaluation.

CybersecurityHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Parse OCDS tender releases containing multilingual free-text descriptions. Consolidate language-suffixed party names and default language tags to unify fragmented supplier compliance records for efficient evaluation.

A multilingual procurement document translation review workspace that preserves original entity names.

Ingest simplified synthetic OCDS procurement releases containing language-suffixed party arrays and default language tags.

Extract base entity descriptions and normalize language tags using standard BCP47 codes.

Consolidate duplicate party records that differ only by translated names or regional suffixes.

Output a unified tender entity ledger linking consolidated supplier profiles to their original language variants.

Translation review workspace displaying canonical entity names alongside their parsed regional suffixes and language codes.

Simplified synthetic app records structured as OCDS JSON payloads featuring simulated name_es, name_fr, and default language fields. Starter examples below are synthetic. They are not downloaded records.

Open Contracting Data Standard Guides the extraction of language-suffixed fields and default language tags for consolidating multilingual party entities according to OCDS schema conventions.

pydantic-ai, fastapi. Ensures strict validation of BCP47 tags and schema-compliant party dictionaries when extracting canonical and translated entity names. LLM capable of mapping multilingual field suffixes to canonical party entities.

Submit runnable source, pinned dependencies, setup commands, a working interface, example outputs, and a recorded end-to-end demo. Include tests and an action log.

Correctly parses the default language and identifies all language-suffixed fields within a party array.

Consolidates related translations into a single canonical entity record without losing the original language variations.

Accurately maps recognized language tags to their corresponding translated strings in the output structure.

```json [ { "input": { "record_type": "simplified synthetic app record", "language": "en", "parties": [ { "id": "party-1", "name": "Water Works", "name_es": "Obras Sanitarias", "name_fr": "Service des Eaux" } ] }, "expected_output": { "canonical_id": "party-1", "default_language": "en", "consolidated_names": { "en": "Water Works", "es": "Obras Sanitarias", "fr": "Service des Eaux" }, "resolution_status": "unified" } }, { "input": { "record_type": "simplified synthetic app record", "language": "es", "parties": [ { "id": "party-2", "name": "Consultores de Software", "name_en": "Software Consultants" } ] }, "expected_output": { "canonical_id": "party-2", "default_language": "es", "consolidated_names": { "es": "Consultores de Software", "en": "Software Consultants" }, "resolution_status": "unified" } } ] ```

Entity consolidations must be verified by human reviewers before integration into official registries. Use mock external writes. Require human review before any real deployment.

Rules

Participation guide

Entity consolidations must be verified by human reviewers before integration into official registries. Use mock external writes and human review.

Delivery guide

How work is evaluated

Evaluation

Correctly parses the default language and identifies all language-suffixed fields within a party array. Consolidates related translations into a single canonical entity record without losing the original language variations. Accurately maps recognized language tags to their corresponding translated strings in the output structure.

Submission format

Runnable source, pinned dependencies, setup commands, working interface, example outputs, recorded demo, tests, and action logs.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
4 scoring checks
Binary
1 pass or fail dimensions
Ordinal
3 scaled dimensions
Dimension 1

Complete workflow

Ingest simplified synthetic OCDS procurement releases containing language-suffixed party arrays and default language tags. Extract base entity descriptions and normalize language tags using standard BCP47 codes. Consolidate duplicate party records that differ only by translated names or regional suffixes. Output a unified tender entity ledger linking consolidated supplier profiles to their original language variants.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 2

Correctness and evidence

Correctly parses the default language and identifies all language-suffixed fields within a party array. Consolidates related translations into a single canonical entity record without losing the original language variations. Accurately maps recognized language tags to their corresponding translated strings in the output structure.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 3

Review interface

Translation review workspace displaying canonical entity names alongside their parsed regional suffixes and language codes.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 4

Safe execution

Entity consolidations must be verified by human reviewers before integration into official registries.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Ingest simplified synthetic OCDS procurement releases containing language-suffixed party arrays and default language tags.

  • Extract base entity descriptions and normalize language tags using standard BCP47 codes.

  • Consolidate duplicate party records that differ only by translated names or regional suffixes.

  • Output a unified tender entity ledger linking consolidated supplier profiles to their original language variants.

Resources and assets

Reference links and supporting material

Dataset notes

Simplified synthetic app records structured as OCDS JSON payloads featuring simulated name_es, name_fr, and default language fields. Supplied starter examples are synthetic, not source extracts.

Challenge setup

Configuration summary for this challenge.

Challenge input

Input details are not configured.

Pydantic AI

Typed Python agent framework.

Evaluated output

No output checks are configured.

Evaluation checks
  • Ingest simplified synthetic OCDS procurement releases containing language-suffixed party arrays and default...
  • Correctly parses the default language and identifies all language-suffixed fields within a party array. Con...
  • Translation review workspace displaying canonical entity names alongside their parsed regional suffixes and...
Configured evaluation evidence
  • 2 public reference cases
Configured runtime
  • 2 configured tools

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Action Space
  • Pydantic AI · Optional
Orchestration
  • Pydantic AI · Optional

Evaluation contract

  • Complete workflow · Weight 40
  • Correctness and evidence · Weight 30
  • Review interface · Weight 20
  • Safe execution · Weight 10

Reference cases

  • 2 public reference cases

Workflow tasks

No workflow tasks are configured.

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Build an OCDS Multilingual Procurement Translation Review Workspace