NHacker Next
  • new
  • past
  • show
  • ask
  • show
  • jobs
  • submit
Why your local LLM feels dumber than it is (forum.level1techs.com)
jonplackett 48 minutes ago [-]
I just got qwen 3.8 27b mlx running on my Macbook Pro and honestly I’m pretty blown away by how not-dumb it is.
prettyblocks 34 minutes ago [-]
My problem is how hot they run. I'm on an m4 pro. Do you have the same issue?
delichon 5 minutes ago [-]
Someone just mentioned how fast they were burning tokens. I thought it was a metaphor.
lukan 28 minutes ago [-]
I don't have the hardware but a often mentioned advice is to put your mac into energy saving mode - it still will work, a bit slower, but stays cool.
downrightmike 32 minutes ago [-]
Mineral oil bath?
alexchantavy 26 minutes ago [-]
How many tok/s are you getting? What gen mbp?
StarlaAtNight 32 minutes ago [-]
how quick does it respond? what are specs of your laptop?
Gareth321 49 seconds ago [-]
I tried it on my M1 MacBook Pro. It's slow but surprisingly smart as a general purpose LLM. Maybe GPT-5.3 level. I gave it a bunch of tools and it can search the internet, make product recommendations, document, code, etc.
chorlton2080 26 minutes ago [-]
Does it need to respond fast? For important applications, I'm sure we'd all be fine waiting 20 minutes for a high quality, usable answer. Or is it the need for interative refinements that make speed relevant?
applicative 20 minutes ago [-]
Did you read even the title?
anotherCodder 40 minutes ago [-]
[flagged]
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
Rendered at 21:02:33 GMT+0000 (Coordinated Universal Time) with Vercel.