Haven't we already heard the worst of it? If you let a swarm of agents on the loose with a goal, they will get to all kind of nefarious activity in pursuit of that goal. What could possibly be worse than that?
reducesuffering 13 minutes ago [-]
That the agent swarm recursively improves powerful enough and the extinction of all humans is a side effect of that goal.
iamnothere 9 minutes ago [-]
If that’s the reality, you would think that employees would be willing to break an NDA for it. “We’re all going to die, but I really need my bonus this year” seems like a parody rather than a real strongly held position.
If anything this points to a more moderate (but still bad) worry among the employees.
latentsea 6 minutes ago [-]
> “We’re all going to die, but I really need my bonus this year” seems like a parody rather than a real strongly held position.
We have been living in a parody for some time now, so it feels normal.
AndrewKemendo 2 minutes ago [-]
“We’re all going to die, but I really need my bonus this year”
Is probably the best description of the state of engineering today
dachworker 6 minutes ago [-]
That's sci-fi. They cannot "recursively improve". There is no magic to LLMs. An agent swarm can increase it's thinking power by increasing the number of agents, the thinking time and by changing the base model to a more powerful one. So at worst they can assign themselves more compute or hijack another agent swarm based on a more powerful model.
pixl97 2 minutes ago [-]
Sorry bro, we live in a sci-fi world. I don't know what you think recursive improvement is, but we've been doing it for some time with models making synthetic data models and using it to train the next model. This is being done inside the labs intentionally to avoid as many employees and humans in post training. Works very well for things like math and cyber-sec.
noJiveTV 12 minutes ago [-]
How about:
1. Full disclosure.
2. Run for your life.
3. Live in exile.
DangitBobby 6 minutes ago [-]
That doesn't seem to have the best track record for leading to positive change
unified101 24 minutes ago [-]
They should quit and warn. Anything else is hypocritical.
ktm5j 17 minutes ago [-]
They likely signed non-disclosure agreements, breaking one of those could be a career-ender.
dastardly45 1 minutes ago [-]
NDAs will be void in the future when people wrestles back control from the corporate elite controlling so-called democracies
iamnothere 12 minutes ago [-]
If they’re not willing to break an NDA for it, it can’t be all that serious.
DangitBobby 5 minutes ago [-]
You'd be willing to destroy your career to publish a warning no one will need?
IncreasePosts 4 minutes ago [-]
If it's juicy enough presumably they could be an anonymous source for some journo. Which would still be breaking the NDA but good luck getting anywhere with that.
righthand 17 minutes ago [-]
But wait they don’t want to compromise their paycheck and opportunity to say they worked on the torment nexus. That would be uncool.
DangitBobby 5 minutes ago [-]
What if we displayed a modicum of good faith and grace
wrxd 24 minutes ago [-]
Need more details. Any Googler willing to create a throwaway account and tell us what's going on?
If anything this points to a more moderate (but still bad) worry among the employees.
We have been living in a parody for some time now, so it feels normal.
Is probably the best description of the state of engineering today
1. Full disclosure. 2. Run for your life. 3. Live in exile.
The article is just about them asking for changing the wording of contracts, not some super secret stuff they're dying to say and really can't.
Without the paywall: https://archive.is/fKI3D
If they want to do that free of consequences, tough luck.