Back to evaluations
Public evaluation
Fault Injection Recovery Test
Evaluates dropped request rate and state recovery duration during hardware fault injection.
Evaluation type
task based
Challenge
Distributed Inference Fault Injection & Recovery Simulator with AutoGen
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
Fault Injection Recovery Test
Injects worker node failure at second 15 of a 60-second multi-node serving test.
Input format
JSON scenario configuration specifying failure type and active stream count
Output format
JSON result containing dropped_requests, recovery_duration_ms, and state_consistency_score