Man what a week, We just had GLM 5.3 that came out and then we had smaller local model Qwen3.8-27B from Qwen

Just tried using Pi Agent and looks very promising

Such an interesting times we are in,

We just had amazing releases this past two months

kimi k3, glm5.3 qwen3.8 and now glm5.3

These open models are getting really good

You wrote GLM5.3 two times :)

Because it's doubly good.

An LLM so nice, they named it twice.

Sorry , It was 5.2 :)

Pi Agent has been one of my favorite harness when it comes to using with local models

I had a lot of success running it on my Mac with Qwen3.6-35B-A3B model

Same experience, sometimes using Little Coder helps make things faster because it is built on pi and strips out some functionality. Probably best to stick with pi however, adding pi-sandbox for some security. I will only run Little Coder in an Apple Container.

Haven’t heard about little corer but I’ll give it a try

I have been using Qwen3.6-35B-A3B as my daily driver as well and its been phenomenal when it comes to coding

How do you use a 72GB model as your daily driver locally?

Apple Silicon. But: there's no need to use the FP16 version. At 8-bit precision the quality loss is almost imperceptible. That cuts the footprint to 36GB. Which is great for a 64GB Mac, because you have room for plenty of context. 6-bit also works nicely at 26GB + context.

You want to use the newer quantization formats like Unsloth's UD quants or oQe, where the weights are selectively quantized using a calibration dataset so that important weights are left at/closer to full precision.

At 4 bit it easily fits in 32GB. That's what most people use.

use a quantized version. since it's MoE, what matters is that the 3b parameters that are used for every token fit in gpu vram, the rest can stay in system ram. really great if you don't have unified memory.

Let me know how it goes, feedback is always welcomed :)

Thank you, I wanted to keep it simple Tauri is fun to build with I must say

Author here,

Agreed and most people tend to go towards ECS is because they don’t have enough resources to manage EKS or Kuberenetes in general

Now Kuberenetes is really powerful in my opinion but sometimes it might be an overkill

You might even get away with EC2s but they bring extra overhead of management such as patches and os upgrades and autoscaling can be trivial

As someone who loves teaching and building this can be very useful

For example i built this https://kubernetes-made-simple.vercel.app/

Now i can add this

The reconciliation simulator goes crazy when I change the expected pods on iphone.

Its a cool site btw

same on firefox on android

This is really cool but the trace advances quite quickly I had to run through a couple of times to read all of the text.

Read the whole thing, good stuff. Would be great to expand on gateway, and maybe mention CRDs.

Awesome site.

What’s one thing most people get wrong about k8s that makes learning unnecessarily difficult?

Thinking that the range of capabilities is a setup todo list.

Particularly storage.

Woah that's brutal all the important information is wild in public

This is a great idea, but going against FIX protocol would be huge challenge as it's an industry standard and there's alot of regulation in financial industry