NHacker Next
  • new
  • past
  • show
  • ask
  • show
  • jobs
  • submit
▲Show HN: Shoehorn – Quantize any model down to run on your machine (notactuallytreyanastasio.github.io)
25 points by rhgraysonii 3 hours ago | 2 comments
hmokiguess 2 hours ago [-]
Reminds me of https://github.com/AlexsJones/llmfit
mbuchel-hn 2 hours ago [-]
does this work similar to airllm? i am wondering how it would handle something like quantizing kimi k3 on a budget of 8 gbs, or is that something you are not attempting to solve yet?
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
Rendered at 17:31:59 GMT+0000 (Coordinated Universal Time) with Vercel.