Back to evaluations
Draft evaluation
Distributed Inference Fault Injection & Recovery Simulator with AutoGen — evaluation
Evaluates dropped request rate and state recovery duration during hardware fault injection.
Evaluation type
task based
Challenge
Distributed Inference Fault Injection & Recovery Simulator with AutoGen
Difficulty
Advanced
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
Fault Injection Recovery Test
Injects worker node failure at second 15 of a 60-second multi-node serving test.
Input format
JSON scenario configuration specifying failure type and active stream count
Output format
JSON result containing dropped_requests, recovery_duration_ms, and state_consistency_score