Inference queue throughput

One GPU worker; alternate batch order each round. Queued latency includes waiting time. A throughput change is not a claim that FIFO accelerates model inference.

Run Engine Checkpoint Clients Rounds Sequential s Queued s Throughput change % Identical WAVs Peak queue Pass
20261025-050404-08222176 faster 0.6B-CustomVoice 4 5 77.421 79.195 -2.24 20/20 3 True
20261025-053632-9d5b8428 faster 1.7B-CustomVoice 4 5 88.723 88.070 0.74 20/20 3 True