I run the same setup Gemma 4 26B on a 2013 Mac Pro (dual graphics cards but they're useless for this). I also get about 5 t/s. It's perfectly serviceable for some tasks!
I bought a trashcan Mac Pro on a whim last week ($120 in eBay!) and did some reading about them—it turns out people recently started using the GPUs to run models @ 20-30 tok/s.
I'm excited to get my mitts on it on Friday when it finally arrives.
Here's some of the resources I came across if you're interested in reading.
oh very exciting! Thanks for sharing these sjs382! A bummer the models can't be run on both the GPUs and CPU so you could run much larger models. A year ago I was running gpt120b as it easily fit in 128gb ram. But now I'm only running gemma 26b and wishing I had stuck with 64gb ram since 128gb gets throttled. Not regretting buying 128gb 1.5 years ago though!
I love the X3, light enough I can carry it around without noticing it. Battery lasts forever. I don't feel the need for a backlight at all, I love how simple this is.
I know people favor the X4 for the usb-c, and I'm all for universal charging cables. But in my experience the usb port is often the first component to fail in something like this. And that seems super annoying to replace. The pogo pins on the other hand are unlikely to fail. And the cable is not proprietary, you can get compatible cables on Amazon/etc.
Try the M5Stack Paper S3 instead. I am running a community build of Crosspoint Reader on mine, it actually has a touchscreen and a microSD card reader, supposedly limited to 16GB but handles my 128GB card just fine.
it's such a subtle joke as _parts_ of this sound genuinely helpful. But of course not having any terminal access and a read-only fallback are the haha parts I guess.
for people who prefer a video intro to the mess of the American healthcare system, Brian David Gilbert has an excellent video on the subject, https://www.youtube.com/watch?v=-wpHszfnJns
he manages to make it a fun and enjoyable topic to learn about which is quite a feat imo
this just speaks to the importance of detailed prompting. When would you ever just say "no"? You need to say what to do instead. A human intern might also misinterpret a txt that just reads 'no'.
This time for real. Multi-decade users of both Windoze and macOS won’t take any more shit and take action, instead of just complaining. That’s a quality I haven’t seen before.
https://theanarchistlibrary.org/library/anonymous-make-the-g...