NHacker Next
  • new
  • past
  • show
  • ask
  • show
  • jobs
  • submit
Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs (prismml.com)
syntaxing 17 minutes ago [-]
Super interesting, building their llama cpp fork on my Jetson Orin Nano to test this out.
yodon 38 minutes ago [-]
Is Bonsai 1 Bit or 1.58 Bit?
woadwarrior01 36 minutes ago [-]
1-bit g128 with a shared 16-bit scale for every group. So, effectively 1.125 bit.
stogot 29 minutes ago [-]
What is the value of a 1 bit? For those that do not kno
jacquesm 25 minutes ago [-]
That you can process many operations with a single instruction.
SwellJoe 24 minutes ago [-]
0 or 1
trebligdivad 26 minutes ago [-]
Speed and density.
2 hours ago [-]
simian1983 34 minutes ago [-]
[dead]
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
Rendered at 23:16:47 GMT+0000 (Coordinated Universal Time) with Vercel.