When 32GB NVIDIA cards seem to start at around $4000 that's a big enough gap to be motivating for a bunch of applications.
giancarlostoro 19 minutes ago [-]
Intel GPU prices have stayed fine, but I do wonder if they are viable for Inference if they will wind up like Nvidia GPUs, severely overpriced.
qingcharles 25 minutes ago [-]
I think the B65 is priced at $650. Both supported by llamacpp I believe. With that power draw you could run two of them.
vessenes 6 minutes ago [-]
Not sure why you'd want this over an apple setup. M4 max is 545GB/s of memory bandwidth - $2k for an entire Mac Studio with 48GB of RAM vs 32 for the B70.
nickthegreek 12 minutes ago [-]
Both have 32gb vram. Could be a pretty compelling choice.
WarmWash 45 minutes ago [-]
Wake me when they wake up and release a middling card with 128GB memory.
Rendered at 16:17:10 GMT+0000 (Coordinated Universal Time) with Vercel.
~$1000 for the Pro B70, if Microcenter is to be believed:
https://www.microcenter.com/product/709007/intel-arc-pro-b70...
https://www.microcenter.com/product/708790/asrock-intel-arc-...
https://www.bhphotovideo.com/c/product/1959142-REG/intel_33p...
When 32GB NVIDIA cards seem to start at around $4000 that's a big enough gap to be motivating for a bunch of applications.