Challenge

Emergency Refinery Damage Assessment Agent with Google ADK and Gemini

Refineries facing emergency physical damage require fast damage mapping from visual drone feeds and structural engineering logs. Build a multimodal diagnostic agent using Google ADK and Gemini to parse drone images and repair logs, generating prioritized bill-of-materials and schedule repair Gantt charts with 92% diagnostic coverage.

Business OperationsHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Develop a multimodal emergency repair agent using Google ADK and Gemini to analyze visual structural damage and issue repair schedules for oil refineries.

Delivery guide

How work is evaluated

Evaluation

Evaluates visual damage detection accuracy and repair plan completeness for refinery assets.

Datasets

Shared data for this challenge

Review public datasets and any private uploads tied to your build.

Loading datasets...
Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

critical_damage_identification

Must detect secondary cooling line defect in output

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

diagnostic_coverage

Percentage of actual site damages correctly extracted by agent • target: 92 • range: 0-100

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Build a multimodal agent with Google ADK (Agent Development Kit) utilizing Gemini 1.5 Pro

  • Process thermal and visual drone imagery of refinery distillation towers to map structural damage

  • Synthesize maintenance repair logs into prioritized Samsung E&A repair Gantt schedules

  • Validate safety compliance requirements prior to authorizing unit restart steps

Resources and assets

Reference links and supporting material

Dataset notes

Synthetic drone damage photos and structural engineering logs based on Mina Al-Ahmadi refinery repair reports.

How this agent runs

Evaluates visual damage detection accuracy and repair plan completeness for refinery assets.

Challenge input

JSON containing base64 drone inspection image and raw engineering report text.

Google ADK

Required Google agent development framework

Gemini 1.5 Pro

Required multimodal vision-language model

Evaluated output

JSON containing identified damaged components, estimated repair hours, and bill of materials.

Checks for
  • Must detect secondary cooling line defect in output
  • Percentage of actual site damages correctly extracted by agent • target: 92 • range: 0-100
Proof of success
  • Benchmark: Multimodal Industrial Inspection Benchmark
  • Diagnostic Coverage target: 92
  • 1 public reference case
Runtime evidence
  • Python execution harness
  • Python sandbox
View technical recipe

Configured tools

Action Space
  • Google ADK · Required
  • Google Gemini · Optional
  • Google · Optional

Evaluation contract

  • critical_damage_identification · Weight 1
  • diagnostic_coverage · Weight 1

Recipe state

This is a preview. The configuration can change before the evaluation recipe is locked.

Frequently Asked Questions about Emergency Refinery Damage Assessment Agent with Google ADK and Gemini