Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
orangecat
on April 20, 2025
|
parent
|
context
|
favorite
| on:
Gemma 3 QAT Models: Bringing AI to Consumer GPUs
ollama's `gemma3:27b` is also 4-bit quantized, you need `27b-it-q8_0` for 8 bit or `27b-it-fp16` for FP16. See
https://ollama.com/library/gemma3/tags
.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: