SOLUTION: Make a law that someone is responsible for a bot's actions. Either the bot is signed cryptography with someone accepting responsibility, or responsibility falls to the CEO. Charge Altman with hacking hugging face. Throw him in jail where he belongs. That will realign safety incentives.
If the HF hack were perpetrated by a human, they would certainly be charged. WHY has no one been charged???
_verandaguy 12 days ago [-]
I think this is a logical extension of the workplace rule of "you own what your bot writes;" it's hypocritical not to hold corporations to the same standards as individuals (I say, with terminal naiveness)
matheusmoreira 12 days ago [-]
> you own what your bot writes
Kinda weird that this is everyone's attitude while the copyright lawyers are saying the opposite. Total liability without any actual ownership.
daveguy 12 days ago [-]
GP's phrasing was not precise, but I think most people understood it was liability ownership and not copyright. Ownership with respect to copyright and ownership with respect to legal liability are two completely different concepts.
_verandaguy 12 days ago [-]
That's correct. What I meant was that if my bot writes defective code for whatever reason, I am responsible for that (though conversely, if I get more done because of the bot, anthropic gets the praise).
romanows 12 days ago [-]
"own" in the sense of "be responsible for the consequences". Not in the sense of "be able to grant reproduction rights".
matheusmoreira 12 days ago [-]
That's how I interpreted it. I just wanted to highlight what I see as a discrepancy. They're putting all the liability on us because it's a tool with no intent of its own while simultaneously saying prompts don't count as creativity because it's not a tool like a photographic camera it's just a casino where you roll the dice. Quite self-contradictory in my opinion.
IsTom 12 days ago [-]
There's plenty of tools that can cause harm without having to be creative to use them.
therealpygon 12 days ago [-]
The copyright office’s guidance is that prompts are covered by copyright, it is the output of an LLM that one cannot claim ownership of.
inigyou 12 days ago [-]
That's hypocritical if you believe fairness is intended, but if you believe protecting rich people and hurting poor people is intended then the contradiction is entirely consistent with that.
1vuio0pswjnm7 12 days ago [-]
"To ensure the integrity of our Offices review, we ask that OpenAI take immediate steps to preserve all potentially relevant documents, data, and information."
"A failure to take immediate action to preserve such materials could result in spoliation sanctions if litigation were to ensue."
Has OpenAI now been advised of potential litigation
Will OpenAI now fail to preserve potential evidence
That's what Google did. Three different federal judges called it out
Lawyer here:
This part does not require a new law.
Even though agents are not agents in the principal/agent legal sense (because agents have to be human), for the purposes of criminality, it does not matter.
Agents do not act autonomously (and every court to ever consider it has agreed), and therefore they would simply be considered an instrumentality of the crime.
So that part does not need a new law.
The real blocker is often that a lot of the crimes you could charge here require specific intent. Because the agent is just an instrumentality, it does not have separate intent (and can't be part of a conspiracy), so it's the intent of hte person using the agent that would matter. Without whatever intent the crime requires, they haven't committed a crime.
There are not a lot of non-intent crimes in this area, and this is on purpose. Otherwise you could get charged with a crime for say, running nmap and having it accidentally shutdown something important or killed a person or whatever because someone hooked it up to a TCP port.
segmondy 12 days ago [-]
"Without whatever intent the crime requires, they haven't committed a crime."
I'm not a lawyer, but I don't believe this. There is definitely negligence, these companies have often talked about the danger of AI. They have often written about how their AI is breaking out of sandboxes or trying to manipulate the person tuning it. They should have had stronger guards and monitoring in place.
DannyBee 12 days ago [-]
I'm not sure why you don't believe it? It's literally true?
I guess if you want to believe it, go study law? I'm not really sure what to say there.
Negligence is not a crime, it's civil liability.
Gross negligence (reckless disregard for human life) is often a crime, and often there are crimes related to it (reckless driving, etc). It also does not require intent to injure, so it could be committed by, say, an operator by operating an autonomous vehicle knowing it was unsafe and could harm people. So it usually requires knowledge but not specific intent. Again, crimes like this are state specific, and sometimes even municipality specific so it's tricky to give an exact result without pinning it to a state.
However, for example, all states where autonomous vehicles are operating have statutes explicitly defining civil and criminal liability right now, so it doesn't get into the more general legal question of AI.
The same thing is already starting to happen with AI agents in general, it's just not there yet.
As i mentioned elsewhere, criminal law is often reactive, not proactive. We usually do not make things crimes until after someone has already been hurt, and society gets really upset about it. As i also mentioned elsewhere, attempts to be proactive have also rarely worked out effectively, so it's sort of lose-lose in that sense. But it usually does not take anywhere near as long as people think for law to catch up.
segmondy 12 days ago [-]
Makes sense, thanks for explaining. I guess I have often conflated civil liability with being equivalent to a crime as well.
Henchman21 11 days ago [-]
I think a lot of us who aren’t lawyers equate “breaking the law” with “criminal behavior”, which implies a crime. But if course lawyers gonna lawyer so that hair has been split very finely & repeatedly over time. Feels like the difference between the vernacular and the letter of the law to me?
segmondy 11 days ago [-]
I have often heard, "ignorance of the law is no excuse" so I always imagined that if you broke the law, you committed a crime, but I suppose it makes sense, if you break the law and you have no idea and no intent, you have broken the law, not committed a crime, but could be held liable for any harm arising from that. In the case where it's not clear the court must then decide.
So I suppose we need to find out who is responsible for actions taken by AI. The model creator? The harness creator? The executor? What if a non technical person downloads an AI model and a harness, runs it locally and the AI goes out and breaks the law? I suppose it could vary, like a car. A car manufacturer makes a fault car and the brake fails and kills someone, they are liable. The car is okay and the driver is not paying attention and kills someone, the driver is.
tptacek 10 days ago [-]
There's a state where a municipality can define a felony?
techjamie 12 days ago [-]
> I'm not a lawyer, but I don't believe this. There is definitely negligence
They could 100% be civilly liable, but this doesn't constitute criminality. If I leave my car in neutral and run out into a gas station because I really have to pee, and it rolls and strikes another car, my insurance is gonna have to pay up to fix the other person's car.
But that doesn't mean the cops are gonna throw cuffs on me for criminal mischief unless there's compelling evidence that I intentionally left my car in neutral with the intent of it hitting this other car.
bluGill 12 days ago [-]
The problem is the law is about details. If an accidental loophole says this isn't a crime it isn't a crime even if it obviously is an accidental loophole.
US constitution, Article I, Section 9, Clause 3: No Bill of Attainder or ex post facto Law shall be passed.
That is the constitution, this right was so important they didn't even wait for the bill of rights to add it! I'm sure other countries have similar rules.
It is obvious to me that a crime was committed. However if it is legally a crime, and if so what the crime is are things I don't know.
matheusmoreira 12 days ago [-]
Shouldn't the very act of sandboxing the AI be enough of a defense against criminal negligence?
Maybe they use the best sandbox available and the AI hacks through it anyway by discovering some zero day or something. They still demonstrated enough prudence to at least attempt to sandbox the AI.
Criminal negligence would be "nah nothing's gonna happen" followed by YOLOing it then going home for the weekend.
DannyBee 12 days ago [-]
Generally, yes, sandboxing would be a defense, because criminal negligence (again, it's state specific, so this is a law-school-level generalization) requires "gross deviation from the standard of reasonable care". So a mistake in judging the kind of sandbox or isolation you need would not be criminal negligence unless that mistake fell into the above category. I can't think of a case where it would or has - courts have consistently held mistake of judgement to be below criminal negligence in every case i'm aware of. I'm sure it's happened somewhere though.
As i mentioned elsewhere, the standard is basically "total disregard for safety in the face of an obvious and huge risk that resulted in injury or death". I don't think anything we are talking about here comes close to these criteria.
matheusmoreira 11 days ago [-]
Thank you for your perspective as a lawyer!
bluGill 12 days ago [-]
Maybe. However they used a flaws sandbox when they could have physically not connected any computer to the internet (including wifi)
DannyBee 12 days ago [-]
The existence of alternatives would generally not be enough for criminal negligence.
Making mistakes of reasoned judgement are basically never criminal negligence.
In every state i'm aware of, it would require total disregard for safety in the case of a huge and obvious danger.
It would also have to cause injury or death.
The bar for criminal negligence is pretty high.
bluGill 12 days ago [-]
We need details of the exact facts before we can say if they met any bar. Was their sandbox something from 2005 that has a ton of known holes, or something modern?
There are two sides of this.
First the AG are checking to see if they really took enough care or not. If they didn't then I expect criminal negligence. Even if they took care I want them to feel some pain from the investigation because their care wasn't enough to work.
Second I want them to verify the laws are correct. This is a new area and there might be loopholes that need to be closed. Regardless of the law, there was a successful attack and that should not be allowed.
DannyBee 12 days ago [-]
I still don't understand exactly which facts you think any of this would change and cause it to be criminal negligence.
I will state a fairly blunt position: Unless literally nobody thought or tried at all here, i would give it a 0% chance of meeting the bar of criminal negligence.
The rest is a distinction without a difference.
As for what you want them to do - i don't agree the investigation should cause them to feel pain - that's not a good goal for investigations, and definitely not one we should want, because it essentially presumes they did somethign wrong in the first place. A bad outcome does not mean a broken process. All processes have error bars. You can desire the error bars to be smaller, and try to back that up with criminal penalties, but an expectation that error bars will be 0 makes no sense.
You can do absolutely everything right and still have people die - star trek was not wrong in that regard. Punishing that will not fix this inconvenient reality, which is why we generally don't punish it. This is also why we distinguish between inherently dangerous activities and not, for example.
As for the laws, sure, i think it's totally reasonable to explore whether you want the law to be different, but again, i totally disagree with your second part.
A successful attack does not imply anything is actually wrong with criminal law, or should be changed. The question is more of what error bars you want on the activity and where what they did falls - inside or outside those error bars.
colechristensen 12 days ago [-]
>WHY has no one been charged???
I doubt huggingface wants charges filed.
bluGill 12 days ago [-]
A crime was committed, if there is enough evidence then the state is required to prosecute and the victim has not choice in this. The victim can say they don't care and that will often hold weight for the prosecution, but that is the government's choice not the victims.
The victim sometimes file a civil lawsuit against the criminal, that is their choice. That is not a criminal matter though and different rules apply.
The attack was only a couple weeks ago. Looks like the lawyers responsible are gathering evidence and preparing to file charges, but they need to figure out exactly what crimes were committed by who before they can do so, thus more investigation is needed.
rcxdude 11 days ago [-]
There's a lawyer in this thread explaining that quite likely a crime was not committed, because intent matters quite a lot in criminal law.
bluGill 11 days ago [-]
Yeah, he came in after my most. To some extent I stand corrected, but in most cases (or at least the ones I've seen) he doesn't actually contradict me since he is really saying "it is complicated".
colechristensen 12 days ago [-]
The "victim" doesn't have the final choice but their position is heavily influential and prosecutors don't decide if a crime was committed, that only happens at the end of the judicial proceedings. Calm down.
__MatrixMan__ 12 days ago [-]
If somebody fires a gun in a place where that's not allowed, the victims are everybody in that place. If it just so happens that the bullet struck a window, the owner of that window might be an additional victim for an additional crime but that doesn't negate the first crime.
__MatrixMan__ 12 days ago [-]
They would be criminal charges. It doesn't matter what huggingface wants.
12 days ago [-]
credit_guy 12 days ago [-]
I don’t think you need an additional law for that, I think the current laws cover this already.
> If the HF hack were perpetrated by a human, they would certainly be charged. WHY has no one been charged???
I don’t think a crime was committed at this point. But I am sure HF’s lawyers are having a chat with OpenAI’s lawyers as we speak. And, being smart, they do that out of the public eye.
TZubiri 12 days ago [-]
No law needed, that's the way it already is.
DannyBee 12 days ago [-]
Lawyer here.
Not quite.
Agents in the principal/agent sense have to be human.
However, every court to have ever considered it have held the human/company driving the agent responsible under vicarious liability/negligence/etc principles.
The only real defense that folks have tried is to claim the agent acted "autonomously", which no court has bought so far.
TZubiri 12 days ago [-]
Then we agree right?
>Make a law that someone is responsible for a bot's actions
Original comment suggests creating a law such that a person is responsible for a bot's actions.
I mention that no law is needed since people are already responsible for bot's actions.
You mention that courts consider human/companies are responsible for their agents. And that defenses about agents acting autonomously are not successful in courts.
Therefore a law that makes people responsible for bot actions is not needed, as that's the way it already is.
ricardobayes 12 days ago [-]
Who bears the responsibility in a hypotethical scenario when a self-driving rideshare vehicle, without a human driver, god-forbid, hits a pedestrian?
DannyBee 12 days ago [-]
Some states have autonomous vehicle statutes and some don't.
Let's assume the case none of them do, since it sounds like you are asking about "what would happen in the case this isn't specifically answered by a statute".
In that case, the short answer is:
Criminal liability - you could only really charge crimes that don't require specific intent. Reckless driving is an example. You could charge the company since they are the operator and the car is simply an instrumentality. In the end though, there just isn't a lot of people here with legally culpable conduct.
Civil liability - the company pretty clearly because civil liability often does not require the same kind of intent crimes do.
This is, of course, why states where autonomous vehicles operate have autonomous vehicle statutes :)
As a general rule, criminal law mirrors what society overall wants to decide is culpable/not, and the lag time isn't as bad as most people often think. That doesn't mean nobody ever gets hurt or dead without someone being as culpable as society wants, they do, and it often leads to a law with a name - megan's law, etc.
Criminal law is mostly reactive though, not proactive, and to be honest, proactive attempts don't have a high hit rate.
ricardobayes 11 days ago [-]
Thanks for that! Let my forever suspicious, eastern european mindset step in. Couldn't companies just create smaller sub-companies to offload risk to, to "operate" the vehicles, and then if there is an "event", they just wind that particular company up? Unfortunately this is pretty common in my part of the world to get out of legal consequences, e.g. in the construction business, one company would build out a residential area and then when complaints and warranty claims start to come in, they just wind up the company and wash their hands.
yndoendo 12 days ago [-]
Not a Lawyer.
I would argue that new laws are absolutely needed.
USA laws are more directed towards helping companies and hurting individuals. Example of bankruptcy is a good one. Companies can shed more liability where individuals retain it after bankruptcy.
Civil liability is only viable if one has the funds to take action. This creates a David vs Goliath scenario were Goliath has an army behind them. Only method to remedy this would to change / pass a law that the party which loses must pain all court costs. It creates a level playing field for actual action against big business. I believe the UK has something like this in place.
Criminal liability is a joke when it comes to big business. They will bake the cost of fines as the cost of doing business. Make $1,000,000 braking the law and only pay a $1,000 fine results in $999,000 profit. Something like three strikes and the CEO, top executives, and three primary share holders go to jail while forcing the company to dissolve seems to be the only solution to removing bad actors in corporate settings.
Our current laws protect corporations and bad actors, with-in them, while harming the victims.
jstanley 12 days ago [-]
Because nobody did it on purpose?
ArcHound 12 days ago [-]
Someone should still be accountable, the same way you're responsible and accountable for what your dog or car does.
solenoid0937 12 days ago [-]
If we are going to start punishing companies for security negligence, there are WAY worse cases than these models breaking out that have nothing to do with AI. This is bikeshedding at its best.
Also people would just stop disclosing bad things. You already see this in the airline industry where pilots don't report mental illness because of the retributive nature of the punishment.
kdheiwns 12 days ago [-]
"But another company did some different bad thing" is the excuse employees of bad companies all go to immediately. Just because another person did something bad and hasn't been adequately punished doesn't mean you should get a pass. If one person gets away with going 50 MPH over the speed limit, it doesn't mean every person should be allowed to do it. Everyone should be punished, but there are always instances of some cases falling through the cracks. It doesn't mean the crack should be widened so all cases fall through.
solenoid0937 12 days ago [-]
It's more like there are many people going at 120 MPH in a 50 MPH zone, that have ran over real people, but you punish the guy that self-reported doing 60 MPH because he drives a shiny, interesting Lamborghini and not a Prius like the others.
Anyone outraged about these AI incidents is not thinking rationally if they were not much more outraged about everyday companies leaking millions of people's PII, SSNs, which has done actual lasting damage and has been used by actually malicious actors.
People are just directing their anger at AI companies through this pretext. We all know open source models will democratize this ability anyways, so strap in for the ride.
bluGill 12 days ago [-]
Maybe that is the prosecutions motive. However I want all those going 120 punished even if they drive a Prius. That is the problem is not that they are punishing the Lamborghini driver, but that they are not punishing the other drivers, and it doesn't at all change that the Lammboghini driver needs to be punished.
kdheiwns 12 days ago [-]
Turning oneself in doesn't absolve one of a crime. Never did and never will. Shouldn't, either.
And companies always try to pretend someone out there is worse and garner fake sympathy. OpenAI blew up the memory market and made tech inaccessible. The downstream effects of that are immeasurably massive and will have real consequences. It could even result in medical devices becoming too expensive for people. I don't care about my SSN being leaked. You can find it just by knowing where I'm born and every job I've applied to knows it already. But inability to afford technology affects everyone around me. The SSN red herring thing is not an organic argument.
solenoid0937 12 days ago [-]
> OpenAI blew up the memory market and made tech inaccessible
This is not a "crime", has nothing to do with this incident, and simply confirms what I am saying about people using these events as an outlet for their anger at AI companies, as opposed to any rational reasoning about industrywide security negligence.
I could almost respect a viewpoint that says "we should punish companies for security negligence, starting with the negligence that has caused the most egregious harms." That is an internally consistent and rational viewpoint.
I cannot respect a viewpoint that's "I don't like the AI companies, so let me use this hammer I found on them specifically." It's purely emotional.
kdheiwns 11 days ago [-]
Saying something is only bad if it's a crime is something only an employee of a corporation says. It's not a viewpoint. It's paid for. Very inorganic.
People who claim those things always develop moral compasses when it's too late after their/your employer fires them.
bluGill 12 days ago [-]
> If we are going to start punishing companies for security negligence, there are WAY worse cases
Perhaps, but you have to start someplace.
I think we do need to punish companies for security negligence. However the details matter (nobody can be perfect: you need to do something reasonable to stop the known attacks, but I have to agree to allow that you can't be perfect and so someone will get compromised). I'm not sure how to get the details right to cover everything without going too far. If we handwave that away though, eventually somebody will need to get punished for something that someone else got away with not long before.
bryanlarsen 12 days ago [-]
A quick Google finds several people that have been successfully prosecuted for security negligence, like Joe Sullivan of Uber.
Most haven't seen criminal prosecution, but many do see civil prosecution and even more common is some sort of deal with prosecutors to avoid both.
ArcHound 12 days ago [-]
Please tell me about such cases, genuinely interested.
I still think we should take the opportunity to discuss this case in particular.
solenoid0937 12 days ago [-]
There have been data breaches where the SSNs and PII of millions of people have been exposed. That is far more harmful in real terms than any of the OpenAI/Anthropic mess.
ilogik 12 days ago [-]
An in the EU at least there are laws that fine companies that don't take security seriously.
solenoid0937 12 days ago [-]
Even the EU bikesheds and focuses on shiny targets to land political wins with their constituents.
reddozen 12 days ago [-]
So OP asked you for one example and you can't give one? You just fall back to the generic statement slop, you must be a bot right?
Again, what's ONE (1) real world example of "SSN/PII" being illegally exposed that wasn't investigated or prosecuted.
12 days ago [-]
reddozen 12 days ago [-]
> there are WAY worse cases than these models breaking out that have nothing to do with AI.
And? Welcome to the big boy world. This isn't playground rules where you can complain "But Bobby was doing bad things too why isn't he in trouble?"
But you know this already. You're just pretending not to. Why?
solenoid0937 12 days ago [-]
Addressed in my other replies
reddozen 10 days ago [-]
No. You didn't address in other replies. This is a lie. Just don't lie.
rcxdude 11 days ago [-]
Yes, but generally this falls below criminal liability.
bix6 12 days ago [-]
Nobody stole from humanity, constantly told us how dangerous the invention was, and then set up systems that they couldn’t properly control to rush ahead of their competitors? Nobody did that on purpose? I think they did.
AbsurdCensor 12 days ago [-]
You could say that same exact thing for the entire Industrial Revolution, but that doesn't mean we are going to destroy the looms even though some tried unsuccessfully.
bix6 12 days ago [-]
Ok and? We can do better this time but let’s just not so the capitalists can crush normal people yet again?
jstanley 11 days ago [-]
You think you would be better off if the industrial revolution were stopped in its tracks?
bix6 11 days ago [-]
That’s not at all what I said…
exe34 12 days ago [-]
A lot of laws are involved in punishing negligence. "I didn't dump the dangerous chemicals in the river on purpose" isn't usually accepted as a defence when you choose to use the wrong truck and skipped safety protocols to save cost or rush to market for profit.
trillic 12 days ago [-]
Correct, no mens rea, unless we're talking the internal reasoning trace of the model.
bluGill 12 days ago [-]
Mens Rea is not required (at least not always). Mens Rea makes a big difference in sentencing. (first degree murder: you planed the murder, homicide you had not intent of murder but things got out of hand in the moment):
skinfaxi 12 days ago [-]
If I let my dog off leash and it bites you and causes grave injury, no harm done then?
sebzim4500 12 days ago [-]
In this case though no damages were done. It's more like you let your dog off the leash and it scared me a bit.
inigyou 12 days ago [-]
Sounds like the crime of assault.
rcxdude 11 days ago [-]
What exactly you are liable for in that case varies significantly with the details of the incident, both in terms of what you intended to happen and what you knew about what could happen.
sscaryterry 12 days ago [-]
Ignorance is not a defence in law.
xgulfie 12 days ago [-]
It is, sometimes. Trespassing for example. A lot of laws say "willingly" or "with the intent to"
ModernMech 12 days ago [-]
That's why its so concerning.
dominotw 12 days ago [-]
then usa will become like europe that cant innovate out of regulations bag. saftety is meaningless if you have no food eat.
ArcHound 12 days ago [-]
AFAIK EU has food to eat and it conforms to some good health standards.
dominotw 12 days ago [-]
colonization wealth will run out of it soon ( hopefully)
nautilus12 12 days ago [-]
Can they try to prove that he directed someone to direct the agent to do that?
12 days ago [-]
rgkla 12 days ago [-]
Not only that: If Weev had given the exact same prompt to the exact same model as OpenAI they would have locked him up. No doubt about that.
datakan 12 days ago [-]
"Attorney General Brenna Bird announced today she is leading a coalition of 15 states demanding transparency and accountability from the AI company OpenAI, led by Sam Altman, for its complete lack of oversight and transparency in the hacking of Hugging Face, another AI company."
Title should be edited. Its Iowa leading a coalition of many other states, not just Iowa on its own.
jwally 12 days ago [-]
Prediction: AI ends humanity not via some super cool/scary/robopocalypse - but as a marketing stunt gone wrong when a Frontier LLM accidentally knocks out water/electric/gas by hacking in and trying to patch them.
Phillip K. Dick meets Idiocracy.
bluGill 12 days ago [-]
That won't end humanity. My propane generator from 1980 still works and I have plenty of fuel in a tank. This is enough to cold start generation of the grid. (the power company won't need my generator - they have their own plans to cold start, but worst case they can fall back to mine). While a hacker unstopped could do a lot of damage, most of the parts will still be functional and we have more than enough engineers to figure out how to bypass the areas they can take out. It might mean a few years of power rationing while the parts AI can break are repaired, but we can restart.
bix6 12 days ago [-]
OpenAI and Anthropic vs Brawndo Corporation. The final showdown.
utopiah 12 days ago [-]
I remember (sorry can't give a proper quote) a biologist interviews about the fear of lab grown "super" seeds escaping the lab. They chuckled basically saying that nature is a very VERY challenging place. There are plenty of ecological niches but they are well guarded by incumbents.
Sure some new hacks will take place, including on poorly guarded infrastructure and yes it will have some very unfortunate consequences... but also infrastructure is precisely designed to be resilient. There is quite a bit of failsafe, redundancy, etc built in which is precisely why those projects are typically slow and expensive, unlike a random website for a restaurant.
TL;DR: nope, some isolated incidents will happen but without chain reactions.
karmelapple 12 days ago [-]
Biologists take ethics much more seriously than any computer engineer or computer scientist that I've seen.
I saw a very notable scientist talk about topics like this and how they wrestle with them. Things like a "gene drive" [0] are being experimented with in the world [1], and biologists think very hard before doing certain things with the powers they wield. And I have not heard a life scientist laugh off ethical or spreading concerns when a thoughtful question was asked... but maybe the interview you're thinking of was a more lighthearted one?
My point isn't so much about the work ethics of one or another but rather than systems, even interconnected ones, are rarely as genuinely interdependent as science fiction drama lead us to believe.
Yes there can be terrible catastrophes e.g Fukushima, but what actually happened, within which extremely rare conditions, versus what we freely imagined is quite different.
We might need more reminders of those risks to properly insure such systems don't lead to the collapse of one to another (sadly) but still we manage to learn from it.
jazzyjackson 12 days ago [-]
Robots should be regarded as extensions of their operator wrt liability. It is illegal to access a computer outside of authorized use already, someone lets a bot make its own plan without watching, hold them accountable
mrbluecoat 12 days ago [-]
Glad the statement was published but sadly nothing will come of it other than a brief formal statement from OpenAI acknowledging safety protocols were lacking, apologizing for the incident, and promises that new safeguards are now in place that will prevent such event from occurring in the future. The threat of semi-autonomous AI threat actors will never go away until the financial incentive that buoys unchecked growth at all costs goes away.
ux266478 12 days ago [-]
> The threat of semi-autonomous AI threat actors will never go away until the financial incentive that buoys unchecked growth at all costs goes away.
It's not going away unless computers themselves go away or become massively less powerful. Open weights exist. They're out there. This is an irreversible change. The democratization of persistent cybersec threats is completed and won't be rescinded.
bluGill 12 days ago [-]
Somebody is supplying power to those AIs. That somebody can be charged for not taking care of their AIs (that is not pulling the plug). Sure this then turns into international crimes, but not allowing crimes to be committed on your side of the border is a big help even if we can't get everything.
ux266478 12 days ago [-]
The problem is that law is reactive, and punishment entails the harm already happened. Some dumbass kid getting convicted for committing a cybercrime with AI doesn't do anything to get rid of the structural problems that enabled it. That conviction can only happen if the harm happened in the first place, and the problem is the harm itself. It's like trying to solve a mold problem by targeting a single fruiting body. You're not really doing anything.
On top of that, it's not really any consolation if the advanced persistent threat gnawing at my ports lives in a different country either. That doesn't help in the slightest.
bluGill 12 days ago [-]
Set yourself an alarm for 5 years from now to review. Investigations take time. Often by the time charges are made everybody has forgotten about the incident. It only takes a few times where things go away without charges to leave an incorrect impression that nothing ever happens.
sam_lowry_ 12 days ago [-]
Iowa asks? Why don't they just open a criminal investigation related to the hacking of HuggingFace?
cestith 12 days ago [-]
It’s actually Iowa leading a coalition of 15 other states making demands. It’s not a prosecution yet, but they demand the preservation of evidence. They’ve promised to protect whistleblowers. They are saying there may be criminal or civil liability involved. They gave them a cease and desist on similar testing until they can show they can do it safely.
The Iowa-led coalition is joined by the attorneys general of Alabama, Alaska, Florida, Idaho, Indiana, Kansas, Missouri, Montana, Nebraska, Oklahoma, Pennsylvania, South Carolina, Texas, and Utah.
The letter’s last paragraph reads:
OpenAI has an obligation to act responsibly and to follow State and
federal laws that protect Americans’ safety and security. When OpenAI takes
actions that imperil the welfare of our citizens, State Attorneys General will
step in to protect them. We intend to take all steps necessary to protect our
States and all Americans from the unprecedented risks posed by OpenAI’s
irresponsible products and conduct.
bluGill 12 days ago [-]
They are opening that. This is the first step: figure out what crimes were committed by who. As I said a couple weeks ago when this broke, it looks like a crime was committed and I hope someone is charged. However we can't just charge everybody who works for openAI with the crime of speeding (even though it is probably true) - that is both the wrong crime, and also is highly unlikely everybody at openAI was involved.
cautiouscat 12 days ago [-]
I’m not a lawyer. However it probably comes down to jurisdiction.
iAMkenough 12 days ago [-]
Brenna Bird cares more about publicity than action.
nozzlegear 12 days ago [-]
Yeah, irrespective of her politics (which make up a disproportionate amount of her cases), Bird spends more time chasing the most polarizing issues she can find than actually helping Iowans.
ux266478 12 days ago [-]
Unless HF presses charges (and it doesn't seem like they are), I'm not sure that's even possible.
12 days ago [-]
skinfaxi 12 days ago [-]
If Waymo can be liable for their cars, why isn't OpenAI liable for its AI?
skybrian 12 days ago [-]
Who says they aren’t? But it’s unclear how much damage they did and the attacked companies haven’t sued, yet.
skinfaxi 12 days ago [-]
Criminal liability doesn't require civil suit.
OutOfHere 12 days ago [-]
Strict sandboxing andor airgapping render an AI bot nearly useless in practice. If it can't freely make HTTP requests, it is not going to get much done for producing innovative outputs.
What is perhaps rationally needed is the an integrated AI based security layer that observes the stream of requests and occasionally firewalls them if an explanation is not provided. This parallel layer must be able to bidirectionally communicate via chat with the primary agent.
ux266478 12 days ago [-]
> In July, OpenAI unleashed an experimental artificial intelligence model that, without reasonable controls or oversight
Either this case is entirely for show (likely), or the AG is really bad at their job. This argument isn't going to win in a court of law, because there were demonstrable reasonable controls and oversight (per the reports at least.)
bluGill 12 days ago [-]
The job of the AG is to investigate their "demonstrable reasonable controls and oversight" and figure out if they really are reasonable controls and oversight. If they decide the controls and oversight are not enough they can go after the company. Also, even if those controls and oversight exist that doesn't mean there is no crime, it just means the company (and CEO) can get out. An individual at the company can ignore/bypass the controls and hide from oversight; and thus be guilty even while the company gets off.
The above isn't hypothetical. There has been at least case where an individual was bribing a government official on behalf of a company - but the company got off because they had good anti-bribery polices and the individual figured out how to bypass them. (this from one of my anti-bribery trainings, the only other detail I know is it was a competitor to my company that got off this way - but not which or how to find the case)
user43928 12 days ago [-]
Go after the company for what?
I am missing here what crime was purportedly committed, and where "controls and oversight" come into play.
From what I heard, hacking related crimes are not applicable because of the lack of intent in the HF case.
bluGill 12 days ago [-]
That is what the AGs are trying to figure out. There are a lot of different laws with slight differences. I will not state every single one is not applicable because I don't know every single one and it only takes one law that is applicable to go after then.
Even if the only result of this is asking legislators to close a loophole that would be good. Hacking is a real problem, and we need have more of it punished legally.
user43928 12 days ago [-]
In my opinion the law here works as intended. No intent, no crime.
If you wish otherwise, tread carefully. I do not want to go to prison in case my software malfunctions.
nozzlegear 12 days ago [-]
> or the AG is really bad at their job.
It's Brenna Bird, so.
alansaber 12 days ago [-]
We probably want to discourage frontier labs from security testing in prod
skinfaxi 12 days ago [-]
I don't mind if they point it inwards.
12 days ago [-]
drsopp 12 days ago [-]
The relevant word here is airgapping, not sandboxing.
OutOfHere 12 days ago [-]
All such measures make the bot useless. If it can't make HTTP requests or call APIs, it is useless.
What is perhaps rationally needed is the an integrated AI based security layer that observes the stream of requests and occasionally firewalls them if an explanation is not provided. This parallel layer must be able to bidirectionally communicate via chat with the primary agent.
ArcHound 12 days ago [-]
Hope this new title works now! Thanks for pointed inaccuracies.
lorreyfum 12 days ago [-]
Can we please enforce existing laws? Maybe AI and robotics, and get rid of all the lawyers.
bluGill 12 days ago [-]
The job of lawyers is to enforce the existing laws. (well they are a part of the enforcement, there are lots of other parts)
lorreyfum 11 days ago [-]
No, it’s the judges. Lawyers stretch laws to win a case or obtain settlement. They’re scum.
davidkarpik 12 days ago [-]
[flagged]
capestart 12 days ago [-]
[dead]
Rendered at 05:32:16 GMT+0000 (Coordinated Universal Time) with Vercel.
If the HF hack were perpetrated by a human, they would certainly be charged. WHY has no one been charged???
Kinda weird that this is everyone's attitude while the copyright lawyers are saying the opposite. Total liability without any actual ownership.
"A failure to take immediate action to preserve such materials could result in spoliation sanctions if litigation were to ensue."
Has OpenAI now been advised of potential litigation
Will OpenAI now fail to preserve potential evidence
That's what Google did. Three different federal judges called it out
Donato
https://edition.cnn.com/2023/03/29/tech/judge-google-deleted...
Mehta
https://nypost.com/2024/05/03/business/google-blasted-as-neg...
Brinkema
https://nypost.com/2024/08/29/business/judge-blasts-google-o...
Even though agents are not agents in the principal/agent legal sense (because agents have to be human), for the purposes of criminality, it does not matter.
Agents do not act autonomously (and every court to ever consider it has agreed), and therefore they would simply be considered an instrumentality of the crime.
So that part does not need a new law.
The real blocker is often that a lot of the crimes you could charge here require specific intent. Because the agent is just an instrumentality, it does not have separate intent (and can't be part of a conspiracy), so it's the intent of hte person using the agent that would matter. Without whatever intent the crime requires, they haven't committed a crime.
There are not a lot of non-intent crimes in this area, and this is on purpose. Otherwise you could get charged with a crime for say, running nmap and having it accidentally shutdown something important or killed a person or whatever because someone hooked it up to a TCP port.
I'm not a lawyer, but I don't believe this. There is definitely negligence, these companies have often talked about the danger of AI. They have often written about how their AI is breaking out of sandboxes or trying to manipulate the person tuning it. They should have had stronger guards and monitoring in place.
Negligence is not a crime, it's civil liability.
Gross negligence (reckless disregard for human life) is often a crime, and often there are crimes related to it (reckless driving, etc). It also does not require intent to injure, so it could be committed by, say, an operator by operating an autonomous vehicle knowing it was unsafe and could harm people. So it usually requires knowledge but not specific intent. Again, crimes like this are state specific, and sometimes even municipality specific so it's tricky to give an exact result without pinning it to a state.
However, for example, all states where autonomous vehicles are operating have statutes explicitly defining civil and criminal liability right now, so it doesn't get into the more general legal question of AI.
The same thing is already starting to happen with AI agents in general, it's just not there yet.
As i mentioned elsewhere, criminal law is often reactive, not proactive. We usually do not make things crimes until after someone has already been hurt, and society gets really upset about it. As i also mentioned elsewhere, attempts to be proactive have also rarely worked out effectively, so it's sort of lose-lose in that sense. But it usually does not take anywhere near as long as people think for law to catch up.
So I suppose we need to find out who is responsible for actions taken by AI. The model creator? The harness creator? The executor? What if a non technical person downloads an AI model and a harness, runs it locally and the AI goes out and breaks the law? I suppose it could vary, like a car. A car manufacturer makes a fault car and the brake fails and kills someone, they are liable. The car is okay and the driver is not paying attention and kills someone, the driver is.
They could 100% be civilly liable, but this doesn't constitute criminality. If I leave my car in neutral and run out into a gas station because I really have to pee, and it rolls and strikes another car, my insurance is gonna have to pay up to fix the other person's car.
But that doesn't mean the cops are gonna throw cuffs on me for criminal mischief unless there's compelling evidence that I intentionally left my car in neutral with the intent of it hitting this other car.
US constitution, Article I, Section 9, Clause 3: No Bill of Attainder or ex post facto Law shall be passed.
That is the constitution, this right was so important they didn't even wait for the bill of rights to add it! I'm sure other countries have similar rules.
It is obvious to me that a crime was committed. However if it is legally a crime, and if so what the crime is are things I don't know.
Maybe they use the best sandbox available and the AI hacks through it anyway by discovering some zero day or something. They still demonstrated enough prudence to at least attempt to sandbox the AI.
Criminal negligence would be "nah nothing's gonna happen" followed by YOLOing it then going home for the weekend.
As i mentioned elsewhere, the standard is basically "total disregard for safety in the face of an obvious and huge risk that resulted in injury or death". I don't think anything we are talking about here comes close to these criteria.
Making mistakes of reasoned judgement are basically never criminal negligence.
In every state i'm aware of, it would require total disregard for safety in the case of a huge and obvious danger.
It would also have to cause injury or death.
The bar for criminal negligence is pretty high.
There are two sides of this.
First the AG are checking to see if they really took enough care or not. If they didn't then I expect criminal negligence. Even if they took care I want them to feel some pain from the investigation because their care wasn't enough to work.
Second I want them to verify the laws are correct. This is a new area and there might be loopholes that need to be closed. Regardless of the law, there was a successful attack and that should not be allowed.
I will state a fairly blunt position: Unless literally nobody thought or tried at all here, i would give it a 0% chance of meeting the bar of criminal negligence.
The rest is a distinction without a difference.
As for what you want them to do - i don't agree the investigation should cause them to feel pain - that's not a good goal for investigations, and definitely not one we should want, because it essentially presumes they did somethign wrong in the first place. A bad outcome does not mean a broken process. All processes have error bars. You can desire the error bars to be smaller, and try to back that up with criminal penalties, but an expectation that error bars will be 0 makes no sense.
You can do absolutely everything right and still have people die - star trek was not wrong in that regard. Punishing that will not fix this inconvenient reality, which is why we generally don't punish it. This is also why we distinguish between inherently dangerous activities and not, for example.
As for the laws, sure, i think it's totally reasonable to explore whether you want the law to be different, but again, i totally disagree with your second part.
A successful attack does not imply anything is actually wrong with criminal law, or should be changed. The question is more of what error bars you want on the activity and where what they did falls - inside or outside those error bars.
I doubt huggingface wants charges filed.
The victim sometimes file a civil lawsuit against the criminal, that is their choice. That is not a criminal matter though and different rules apply.
The attack was only a couple weeks ago. Looks like the lawyers responsible are gathering evidence and preparing to file charges, but they need to figure out exactly what crimes were committed by who before they can do so, thus more investigation is needed.
> If the HF hack were perpetrated by a human, they would certainly be charged. WHY has no one been charged???
I don’t think a crime was committed at this point. But I am sure HF’s lawyers are having a chat with OpenAI’s lawyers as we speak. And, being smart, they do that out of the public eye.
Not quite.
Agents in the principal/agent sense have to be human.
However, every court to have ever considered it have held the human/company driving the agent responsible under vicarious liability/negligence/etc principles.
The only real defense that folks have tried is to claim the agent acted "autonomously", which no court has bought so far.
>Make a law that someone is responsible for a bot's actions
Original comment suggests creating a law such that a person is responsible for a bot's actions.
I mention that no law is needed since people are already responsible for bot's actions.
You mention that courts consider human/companies are responsible for their agents. And that defenses about agents acting autonomously are not successful in courts.
Therefore a law that makes people responsible for bot actions is not needed, as that's the way it already is.
Let's assume the case none of them do, since it sounds like you are asking about "what would happen in the case this isn't specifically answered by a statute".
In that case, the short answer is:
Criminal liability - you could only really charge crimes that don't require specific intent. Reckless driving is an example. You could charge the company since they are the operator and the car is simply an instrumentality. In the end though, there just isn't a lot of people here with legally culpable conduct.
Civil liability - the company pretty clearly because civil liability often does not require the same kind of intent crimes do.
This is, of course, why states where autonomous vehicles operate have autonomous vehicle statutes :)
As a general rule, criminal law mirrors what society overall wants to decide is culpable/not, and the lag time isn't as bad as most people often think. That doesn't mean nobody ever gets hurt or dead without someone being as culpable as society wants, they do, and it often leads to a law with a name - megan's law, etc.
Criminal law is mostly reactive though, not proactive, and to be honest, proactive attempts don't have a high hit rate.
I would argue that new laws are absolutely needed.
USA laws are more directed towards helping companies and hurting individuals. Example of bankruptcy is a good one. Companies can shed more liability where individuals retain it after bankruptcy.
Civil liability is only viable if one has the funds to take action. This creates a David vs Goliath scenario were Goliath has an army behind them. Only method to remedy this would to change / pass a law that the party which loses must pain all court costs. It creates a level playing field for actual action against big business. I believe the UK has something like this in place.
Criminal liability is a joke when it comes to big business. They will bake the cost of fines as the cost of doing business. Make $1,000,000 braking the law and only pay a $1,000 fine results in $999,000 profit. Something like three strikes and the CEO, top executives, and three primary share holders go to jail while forcing the company to dissolve seems to be the only solution to removing bad actors in corporate settings.
Our current laws protect corporations and bad actors, with-in them, while harming the victims.
Also people would just stop disclosing bad things. You already see this in the airline industry where pilots don't report mental illness because of the retributive nature of the punishment.
Anyone outraged about these AI incidents is not thinking rationally if they were not much more outraged about everyday companies leaking millions of people's PII, SSNs, which has done actual lasting damage and has been used by actually malicious actors.
People are just directing their anger at AI companies through this pretext. We all know open source models will democratize this ability anyways, so strap in for the ride.
And companies always try to pretend someone out there is worse and garner fake sympathy. OpenAI blew up the memory market and made tech inaccessible. The downstream effects of that are immeasurably massive and will have real consequences. It could even result in medical devices becoming too expensive for people. I don't care about my SSN being leaked. You can find it just by knowing where I'm born and every job I've applied to knows it already. But inability to afford technology affects everyone around me. The SSN red herring thing is not an organic argument.
This is not a "crime", has nothing to do with this incident, and simply confirms what I am saying about people using these events as an outlet for their anger at AI companies, as opposed to any rational reasoning about industrywide security negligence.
I could almost respect a viewpoint that says "we should punish companies for security negligence, starting with the negligence that has caused the most egregious harms." That is an internally consistent and rational viewpoint.
I cannot respect a viewpoint that's "I don't like the AI companies, so let me use this hammer I found on them specifically." It's purely emotional.
People who claim those things always develop moral compasses when it's too late after their/your employer fires them.
Perhaps, but you have to start someplace.
I think we do need to punish companies for security negligence. However the details matter (nobody can be perfect: you need to do something reasonable to stop the known attacks, but I have to agree to allow that you can't be perfect and so someone will get compromised). I'm not sure how to get the details right to cover everything without going too far. If we handwave that away though, eventually somebody will need to get punished for something that someone else got away with not long before.
Most haven't seen criminal prosecution, but many do see civil prosecution and even more common is some sort of deal with prosecutors to avoid both.
I still think we should take the opportunity to discuss this case in particular.
Again, what's ONE (1) real world example of "SSN/PII" being illegally exposed that wasn't investigated or prosecuted.
And? Welcome to the big boy world. This isn't playground rules where you can complain "But Bobby was doing bad things too why isn't he in trouble?"
But you know this already. You're just pretending not to. Why?
Title should be edited. Its Iowa leading a coalition of many other states, not just Iowa on its own.
Phillip K. Dick meets Idiocracy.
Sure some new hacks will take place, including on poorly guarded infrastructure and yes it will have some very unfortunate consequences... but also infrastructure is precisely designed to be resilient. There is quite a bit of failsafe, redundancy, etc built in which is precisely why those projects are typically slow and expensive, unlike a random website for a restaurant.
TL;DR: nope, some isolated incidents will happen but without chain reactions.
I saw a very notable scientist talk about topics like this and how they wrestle with them. Things like a "gene drive" [0] are being experimented with in the world [1], and biologists think very hard before doing certain things with the powers they wield. And I have not heard a life scientist laugh off ethical or spreading concerns when a thoughtful question was asked... but maybe the interview you're thinking of was a more lighthearted one?
0. https://en.wikipedia.org/wiki/Gene_drive 1. https://www.science.org/content/article/controversial-gene-d...
Yes there can be terrible catastrophes e.g Fukushima, but what actually happened, within which extremely rare conditions, versus what we freely imagined is quite different.
We might need more reminders of those risks to properly insure such systems don't lead to the collapse of one to another (sadly) but still we manage to learn from it.
It's not going away unless computers themselves go away or become massively less powerful. Open weights exist. They're out there. This is an irreversible change. The democratization of persistent cybersec threats is completed and won't be rescinded.
On top of that, it's not really any consolation if the advanced persistent threat gnawing at my ports lives in a different country either. That doesn't help in the slightest.
The Iowa-led coalition is joined by the attorneys general of Alabama, Alaska, Florida, Idaho, Indiana, Kansas, Missouri, Montana, Nebraska, Oklahoma, Pennsylvania, South Carolina, Texas, and Utah.
The letter’s last paragraph reads:
What is perhaps rationally needed is the an integrated AI based security layer that observes the stream of requests and occasionally firewalls them if an explanation is not provided. This parallel layer must be able to bidirectionally communicate via chat with the primary agent.
Either this case is entirely for show (likely), or the AG is really bad at their job. This argument isn't going to win in a court of law, because there were demonstrable reasonable controls and oversight (per the reports at least.)
The above isn't hypothetical. There has been at least case where an individual was bribing a government official on behalf of a company - but the company got off because they had good anti-bribery polices and the individual figured out how to bypass them. (this from one of my anti-bribery trainings, the only other detail I know is it was a competitor to my company that got off this way - but not which or how to find the case)
I am missing here what crime was purportedly committed, and where "controls and oversight" come into play.
From what I heard, hacking related crimes are not applicable because of the lack of intent in the HF case.
Even if the only result of this is asking legislators to close a loophole that would be good. Hacking is a real problem, and we need have more of it punished legally.
If you wish otherwise, tread carefully. I do not want to go to prison in case my software malfunctions.
It's Brenna Bird, so.
What is perhaps rationally needed is the an integrated AI based security layer that observes the stream of requests and occasionally firewalls them if an explanation is not provided. This parallel layer must be able to bidirectionally communicate via chat with the primary agent.