← Workflow
Optional · Step 0 · Quick check
Continuous Batching Simulator
How batch size trades latency for throughput.
Batch sweep
| Batch | t/s | Step latency (ms) |
|---|---|---|
| 1 | 73 | 14 |
| 4 | 293 | 14 |
| 16 | 1,173 | 14 |
| 32 | 2,345 | 14 |
| 64 | 4,690 | 14 |
| 128 | 9,380 | 14 |