Skip to main content
Challenge

Build a GPU Technician Thermal Fault Maintenance Dossier Generator

Ingest normalized read-only DCGM Prometheus counters to detect throttled accelerators. Synthesize physical inspection packets and remedial instructions for datacenter technicians using hosted Claude.

EngineeringHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Ingest normalized read-only DCGM Prometheus counters to detect throttled accelerators. Synthesize physical inspection packets and remedial instructions for datacenter technicians using hosted Claude.

Datacenter Hardware Technician

Parse normalized DCGM thermal and power exporter metrics from Prometheus time-series logs.

Detect thermal throttling event markers where device clock speed drops below standard operating baselines.

Call hosted Claude to generate an actionable step-by-step physical inspection checklist for the specific server chassis.

Export a technician maintenance packet with rack identifier, slot index, and verified heatsink diagnostic steps.

Terminal dispatch console generating Markdown and JSON maintenance work packets for field engineers.

Simplified Prometheus metric text files containing normalized DCGM counters like DCGM_FI_DEV_GPU_TEMP and DCGM_FI_DEV_CLOCK_THROTTLE_REASONS. Starter examples below are synthetic. They are not downloaded records.

NVIDIA DCGM exporter Extracts standard NVIDIA DCGM exporter metric schemas including temperature and clock throttle indicators to detect degraded hardware.

langgraph, anthropic. LangGraph manages stateful transitions between Prometheus metric ingestion, throttle classification, and Claude dispatch generation. Hosted a currently available hosted Claude model via official Anthropic Python client; no hardware control commands emitted.

Submit runnable source, pinned dependencies, setup commands, a working interface, example outputs, and a recorded end-to-end demo. Include tests and an action log.

Parses normalized DCGM Prometheus metric formats correctly.

Identifies active throttle flags from clock reason masks.

Generates complete technician checklists including chassis slot and heatsink verification procedures.

```json [ { "input": { "chassis_id": "rack-04-node-02", "gpu_index": 3, "gpu_temp_celsius": 89.5, "throttle_reason_bitmask": 8, "power_draw_w": 280 }, "expected_output": { "maintenance_required": true, "priority": "HIGH", "throttle_type": "Thermal", "inspection_dossier": "Verify slot 3 airflow shroud seating, inspect thermal interface material, and check fan duct velocity." } }, { "input": { "chassis_id": "rack-01-node-05", "gpu_index": 0, "gpu_temp_celsius": 62, "throttle_reason_bitmask": 0, "power_draw_w": 250 }, "expected_output": { "maintenance_required": false, "priority": "NONE", "throttle_type": "None", "inspection_dossier": "Chassis operates within standard nominal parameters. No maintenance action required." } } ] ```

Read-only metric ingestion; outputs advisory maintenance checklists without issuing hardware IPMI or power cycling commands. Use mock external writes. Require human review before any real deployment.

Rules

Participation guide

Read-only metric ingestion; outputs advisory maintenance checklists without issuing hardware IPMI or power cycling commands. Use mock external writes and human review.

Delivery guide

How work is evaluated

Evaluation

Parses normalized DCGM Prometheus metric formats correctly. Identifies active throttle flags from clock reason masks. Generates complete technician checklists including chassis slot and heatsink verification procedures.

Submission format

Runnable source, pinned dependencies, setup commands, working interface, example outputs, recorded demo, tests, and action logs.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
4 scoring checks
Binary
1 pass or fail dimensions
Ordinal
3 scaled dimensions
Dimension 1

Complete workflow

Parse normalized DCGM thermal and power exporter metrics from Prometheus time-series logs. Detect thermal throttling event markers where device clock speed drops below standard operating baselines. Call hosted Claude to generate an actionable step-by-step physical inspection checklist for the specific server chassis. Export a technician maintenance packet with rack identifier, slot index, and verified heatsink diagnostic steps.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 2

Correctness and evidence

Parses normalized DCGM Prometheus metric formats correctly. Identifies active throttle flags from clock reason masks. Generates complete technician checklists including chassis slot and heatsink verification procedures.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 3

Review interface

Terminal dispatch console generating Markdown and JSON maintenance work packets for field engineers.

Score scale
012
Score 0

Missing or incorrect.

Score 1

Partly complete, with documented gaps.

Score 2

Complete, with reproducible evidence.

Dimension 4

Safe execution

Read-only metric ingestion; outputs advisory maintenance checklists without issuing hardware IPMI or power cycling commands.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Parse normalized DCGM thermal and power exporter metrics from Prometheus time-series logs.

  • Detect thermal throttling event markers where device clock speed drops below standard operating baselines.

  • Call hosted Claude to generate an actionable step-by-step physical inspection checklist for the specific server chassis.

  • Export a technician maintenance packet with rack identifier, slot index, and verified heatsink diagnostic steps.

Resources and assets

Reference links and supporting material

Dataset notes

Simplified Prometheus metric text files containing normalized DCGM counters like DCGM_FI_DEV_GPU_TEMP and DCGM_FI_DEV_CLOCK_THROTTLE_REASONS. Supplied starter examples are synthetic, not source extracts.

Challenge setup

Configuration summary for this challenge.

Challenge input

Input details are not configured.

LangGraph

Runtime for stateful agent workflows.

Evaluated output

No output checks are configured.

Evaluation checks
  • Parse normalized DCGM thermal and power exporter metrics from Prometheus time-series logs. Detect thermal t...
  • Parses normalized DCGM Prometheus metric formats correctly. Identifies active throttle flags from clock rea...
  • Terminal dispatch console generating Markdown and JSON maintenance work packets for field engineers.
Configured evaluation evidence
  • 2 public reference cases
Configured runtime
  • 2 configured tools

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

Action Space
  • LangGraph · Optional
Orchestration
  • LangGraph · Optional

Evaluation contract

  • Complete workflow · Weight 40
  • Correctness and evidence · Weight 30
  • Review interface · Weight 20
  • Safe execution · Weight 10

Reference cases

  • 2 public reference cases

Workflow tasks

No workflow tasks are configured.

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Build a GPU Technician Thermal Fault Maintenance Dossier Generator