Wtf. Are we actually seeing a push towards being 100percent dependent on the cloud?
Sovereign AI has never been more important.
Controlling AI is so much more powerful and impactful than controlling search or social algorithms.
Centralized AI a 10x on social control over everything we have seen before, and there is no way that a free and open society survives contact with centralised, high capability AI if the system is manipulated towards guiding outcomes. It’s essentially mind control, as people will offload an even greater share of their cognition to AI than they do with search and social.
Build and maintain sovereign AI while you still can.
InsidiousWombat 28 minutes ago [-]
NVIDIA probably already figured out that local will be massive part and are preparing to do DRM for AI.
Pay up for license to unlock full capacity, pay up for license to use encrypted models from AI moguls, paid per billion tokens processed or just operations in GPU
sva_ 11 minutes ago [-]
It wouldn't work on windows either, if that were the case. It sounds more like it hasn't been properly implemented yet
hhh 19 minutes ago [-]
There is already DRM for AI. check out nvidia’s docs around hosting proprietary models with encrypted weights
jleask 16 minutes ago [-]
Nvidia doing what Nvidia has always done; proprietary closed drivers. Weird choice to cryptographically protect the power settings. Key problem is that we've allowed a company that's always been this way to form a monopoly. Other brands exist, perhaps it is now worth the effort to migrate and rebuild elsewhere.
impossiblefork 6 minutes ago [-]
Unrelated to this slowdown, I could imagine this sort of thing being the right application for things like Taalas, although I'm not quite sure whether it can actually offer what I imagine that it can (i.e. ability to make a cheap, physically small card that can run a large model).
A laptop can't run the latest big models, because memory is too expensive. This thing probably can't run models larger than Mistral Small 4. But it'd be a completely different thing to have a hardcoded Mistral Large 4, than a choice of tiny models.
schaefer 45 minutes ago [-]
The article is about the RTX Spark, not the DGX Spark. The title should be changed.
sampo 27 minutes ago [-]
Looks like the site has fixed the title.
fxwin 41 minutes ago [-]
> A hands-on look at dual-booting Linux on the Nvidia RTX Spark laptop, the GPU clock throttling bug found, and why WSL still wins.
Man it really is exhausting to read a title that sparks my interest, just to be greeted with the most basic Claude-isms in the subheading.
aa-jv 36 minutes ago [-]
> sparks my interest
I see what you did there. ;)
barrkel 34 minutes ago [-]
I remain puzzled why anyone would want to do inference on a laptop if they have a home internet connection and a phone.
If you really want to do DIY inference, plug it in at home and set up tailscale so you can access it on the go.
No huge battery drain or toasty hot laptop required. Lower cost laptop. Lighter laptop. Longer battery life laptop. Win win win win.
solyin 19 minutes ago [-]
Not everyone grew up in a situation where home was a stable dependable place. Not everyone has a home to go to. If you have it with you, they can't mess with it or take it away from you when you're not there. If you grew up in a broken home, you would understand.
pixelpoet 18 minutes ago [-]
I have been saying this for years, and the answer hits a nerve that gets you downvoted into oblivion: people prefer the aesthetics of laptops, simple as that. They will absolutely go to the grave arguing that they need the mobility etc, then just leave it plugged in. They simply prefer how laptops look, and they absolutely hate it when someone dares say it.
hypfer 46 minutes ago [-]
Why does the title say DGX spark when the link is the RTX Spark laptop?
Those are very different things as far as I understand, and the whole "doesn't work well with linux" really only makes sense on the RTX Spark laptop I think?
Isn't the DGX spark linux by default?
novaRom 5 minutes ago [-]
Good point, fixed, thanks.
sva_ 23 minutes ago [-]
It should be possible to reverse engineer this, if it works on windows?
> The laptops also support unified memory configurations up to 128GB, shared between CPU and GPU, which is unusual for a laptop and central to why they’re being marketed at AI developers in the first place.
This isn't rare on laptops, pretty default on AMD with iGPU
jcarrano 4 minutes ago [-]
I though the same, reverse engineer with AI. Even run the AI on the laptop and have it reverse-engineer itself.
aa-jv 38 minutes ago [-]
As a DGX Spark user, this article title gave me conniptions.
But, on the other hand, having my DGX Spark stack at hand, I know the solution:
/btw reverse engineer the Nvidia Platform Controllers and Framework component and build a Linux version
"AI views proprietary components as damage and routes around them."
K0balt 27 minutes ago [-]
The attack on reverse engineering of games is a precursor to universal computing lockdown. When you need AI to keep up with programming, the entity controlling the AI controls what software is possible to create. It’s a bid for centralised control and thought censorship at a scale and depth much more ambitious than anything we have ever seen before.
Sovereign AI has never been more important.
u1hcw9nx 33 minutes ago [-]
Do you know that 1 + 1 = 10 in binary?
aa-jv 7 minutes ago [-]
I know that, because I read the article, but if all I'd read was the title, I'd not know that.
TobiasJacob 11 minutes ago [-]
Wtf is Nvidia doing?! I was considering buying one, but now?
rich_sasha 49 minutes ago [-]
This one is allegedly/hopefully a bug but just waiting for it to become a revenue stream / paywall. Uh oh, you want to run locally your dangerous illegal foreign open models, not licensed by Nvidia? Can’t work with you paying for a special security feature unlock on your GPU.
Or maybe just not at all - shell out for OAI tokens and send us all your data - your privacy is very valuable to us and we will make sure to be the only ones to monetize it.
You could say, Nvidia is selling pickaxes and has no business gatekeeping what rocks you hit with it, but I guess it depends on their relationships with major mining companies, and ultimately what pays more.
chandradey 19 minutes ago [-]
[flagged]
happybox2016 35 minutes ago [-]
[flagged]
Rendered at 10:36:19 GMT+0000 (Coordinated Universal Time) with Vercel.
Sovereign AI has never been more important.
Controlling AI is so much more powerful and impactful than controlling search or social algorithms.
Centralized AI a 10x on social control over everything we have seen before, and there is no way that a free and open society survives contact with centralised, high capability AI if the system is manipulated towards guiding outcomes. It’s essentially mind control, as people will offload an even greater share of their cognition to AI than they do with search and social.
Build and maintain sovereign AI while you still can.
Pay up for license to unlock full capacity, pay up for license to use encrypted models from AI moguls, paid per billion tokens processed or just operations in GPU
A laptop can't run the latest big models, because memory is too expensive. This thing probably can't run models larger than Mistral Small 4. But it'd be a completely different thing to have a hardcoded Mistral Large 4, than a choice of tiny models.
Man it really is exhausting to read a title that sparks my interest, just to be greeted with the most basic Claude-isms in the subheading.
I see what you did there. ;)
If you really want to do DIY inference, plug it in at home and set up tailscale so you can access it on the go.
No huge battery drain or toasty hot laptop required. Lower cost laptop. Lighter laptop. Longer battery life laptop. Win win win win.
Those are very different things as far as I understand, and the whole "doesn't work well with linux" really only makes sense on the RTX Spark laptop I think? Isn't the DGX spark linux by default?
> The laptops also support unified memory configurations up to 128GB, shared between CPU and GPU, which is unusual for a laptop and central to why they’re being marketed at AI developers in the first place.
This isn't rare on laptops, pretty default on AMD with iGPU
But, on the other hand, having my DGX Spark stack at hand, I know the solution:
"AI views proprietary components as damage and routes around them."Sovereign AI has never been more important.
Or maybe just not at all - shell out for OAI tokens and send us all your data - your privacy is very valuable to us and we will make sure to be the only ones to monetize it.
You could say, Nvidia is selling pickaxes and has no business gatekeeping what rocks you hit with it, but I guess it depends on their relationships with major mining companies, and ultimately what pays more.