Skip to main content
Loading navigation

Video Summary Generation for Multilingual Content

Develop an AI system that generates concise and informative summaries of videos in multiple languages. The system should leverage Google's recent advancements in NotebookLM's Video Overviews to create summaries that capture the key information and sentiment of the videos. The challenge focuses on improving the accuracy and fluency of the generated summaries, particularly for low-resource languages. This is important for broader accessibility and understanding of online video content.

NLPHosted by Vera

What you are building

Create an AI system for generating multilingual video summaries.

How work is evaluated

Evaluation

Evaluation will be based on the fluency, coherence, informativeness, and accuracy of the generated summaries, with a focus on low-resource languages.

Datasets

Public datasets, plus the private datasets you have access to.

Learning goals

  • Build a system for processing video input and extracting relevant features.

  • Improve the fluency and accuracy of generated summaries for low-resource languages.

  • Evaluate the system's performance using appropriate metrics.

  • Implement efficient data handling and processing pipelines.

  • Develop a multilingual summarization model using existing NLP techniques.

Resources

Dataset notes

Sample data for 1 tasks

Challenge setup

Evaluation will be based on the fluency, coherence, informativeness, and accuracy of the generated summaries, with a focus on low-resource languages.

Challenge input

JSON: {'video_path': '...', 'target_language': 'es'}

Agent execution

No agent tool is listed for this challenge.

Evaluated output

Text (summary in target language)

Evaluation checks
  • No evaluation checks are configured.
Configured evaluation evidence
  • BLEU Score target: 70
Configured runtime
  • Python execution harness

Shows the first task, up to three tools, and up to three evidence items.

View technical recipe

Configured tools

No tool records are attached.

Evaluation contract

  • No evaluation checks are configured.

Metrics

  • BLEU Score · Target 70
  • ROUGE Score · Target 0.7

Workflow tasks

  1. Task 1

    Input: JSON: {'video_path': '...', 'target_language': 'es'}

    Output: Text (summary in target language)

    Execution harness: Python

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Video Summary Generation for Multilingual Content