10 hours at what tokens per sec?

paulbjensen · 2026-08-17T14:29:23

I was using this model: https://huggingface.co/unsloth/Qwen3.8-27B-GGUF

Quantization is Q4_K_M (4-bit K-quants, medium)

From Pi, these are the up/down token counts:

Tokens: ↑147k ↓110k R26.5M

Prompt submitted at 18:52:54 BST on Sunday 16th August 2026, and finished at 04:05:27 BST on Monday 17th August 2026.

Last print out from the llama.cpp server logs:

881.42.815.480 I slot print_timing: id 2 | task 110233 | prompt eval time = 2742435.76 ms / 134911 tokens ( 20.33 ms per token, 49.19 tokens per second) 881.42.815.483 I slot print_timing: id 2 | task 110233 | eval time = 6312248.28 ms / 5804 tokens ( 1087.57 ms per token, 0.92 tokens per second) 881.42.815.483 I slot print_timing: id 2 | task 110233 | total time = 9054684.04 ms / 140715 tokens 881.42.815.484 I slot print_timing: id 2 | task 110233 | graphs reused = 114795 881.42.820.381 I slot release: id 2 | task 110233 | stop processing: n_tokens = 140714, truncated = 0