In the comments it reads like bonsei falls apart on longer running tasks.
txrx0000 27 minutes ago [-]
Not really. The largest IQ4_XS quant here is still worth it because Bonsai doesn't offer larger quants. They could beat it if they made a quaternary variant though, I don't know why they're stopping at ternary.
Rendered at 06:39:38 GMT+0000 (Coordinated Universal Time) with Vercel.
Disclarer: I'm unsing Vulkan on an AMD GC.
https://news.ycombinator.com/item?id=49746618