I don't see an MTP entry on Unsloth though. Maybe it's not available in a lower ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

gaigalas 28 days ago | parent | context | favorite | on: Qwen 3.8 27B

I don't see an MTP entry on Unsloth though. Maybe it's not available in a lower quant I need for my poor GPU.

greenicon 28 days ago [–]

It's included in the model gguf itself.

gaigalas 27 days ago | [–]

Maybe I'm not seeing the speed improvements because it's a dense model, and I'm comparing it to the 3.6 MoE with MTP. Likely, I'm attributing the speed I see to something else.

Honestly, if MTP is available, I don't know why it's so much slower here.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact