Hacker Newsnew | past | comments | ask | show | jobs | submit | steeve's commentslogin

https://x.com/harshagundal/status/2100044305536889015?s=20

> They were building in stealth for 2 years, I was building in stealth for 2 hours…

> Happy to open source Qwen-2.5-1B-RLCD, 5x faster on-device inference for JSON workloads that need to be type-safe.


No question OSS is amazing, but this video is a satire at best. It doesn't take much attention to see the results on right vs. left side are significantly different.

Jev is not interesting if it's not "smart", a 1B param model is most definitely not smart.


Jev has a 32k context window. I doubt it's a large model.

It can be smart and not knowledgeable, as long as all the data is in the question you really don't need much in term of general knowledge, it might be even beneficial to stay on track. It mostly depend son what you do with it. For example in the doom demo I don't think you need astra level knowledge to know "enemy = bad" and "enemy is at my left = turn gun left"

Taking their spiel at face value, it's intended as a mimic of System One in humans. System One is also not smart.

In their own demo the left and right panels almost never agree on anything. So it's X times faster but doesn't tell you if it's still right

XLA uses MLIR very much, the interface to it is StableHLO, which is a MLIR dialect.


Ah, I'm behind the times.


> Plus, no need to build XLA using Bazel either! You’re welcome.

I don't get it, Bazel is incredible.


Many people find it complicated.


It is. The question is if it's worth the complication. The cheeky answer would be to say it is, but that's not universally true.


sidenote: it is possible to use Vulkan to map GPU memory to CPU space and even map it back to CUDA: https://x.com/steeve/status/2055042304344231978?s=20


consider it done


sadly, sandboxing is something that can't be upstreamed. this way, sandboxing is kept in zml instead of patching mesa.

as for nvtop, great program, but we missed a few features (such as sandboxing)


It looks cool and I was excited to get monitoring for the NPU on my Ryzen AI 395+, unfortunately it does not show. NPU support in linux really seems to be an afterthought.


Weird, because we tried it. It doesn’t show anything?

We use the amdsmi to get metrics. I’ll investigate.


hi, i'm the founder of https://github.com/zml/zml, very happy with Zig


Misleading title. It's about using their AI service, not the editor.


we (ZML) have been back to following Zig master since std.Io was introduced. It's not that bad tbh. Also most changes really feel like actual improvements to the language on a day to day basis.


ZML


What is even that? Not bothering to Google for it, which shows how irrelevant it is.


Good call, for bad reasons.

> At ZML, we are creating exciting AI produ[...]


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: