When the idea of self-driving cars first started becoming mainstream, I remember a lot of debate about liability. If an accident occurs, who would be at fault? I think a lot of those questions are still unanswered.
Fast forward and now we have software like ChatGPT. I assume they’ll only become more capable (and connected) over time.
Which makes it strange I haven’t really heard any similar discussion around liability. What happens when it makes mistakes or causes damage?
Maybe in people’s minds it doesn’t matter, because AI is either something that helps with homework questions, or something that’s taking over humanity. Reality is probably in between those two, with much more mundane mistakes or damages done.
What happens when the first ransomware is deployed by AI, on behalf of a user who just wanted tips on how to make more side income?
Completely speculating, because I don’t know many courts that have been willing to decide either way, but maybe:
If it causes harm in a way that was reasonably foreseeable, the person who turned it on might be generally liable on a theory of negligence (but not always).
If the harm was unpredictable, it might be on the manufacturer and the retailer under a theory of products liability (but not always).
Or it could be treated as “ferae naturae,” where owners are liable for their ‘dangerous animal’ pets because they knew the pets were dangerous and still decided to keep them (but not always).
If it’s an AI not associated with a physical device, maybe the programmer who “authored” the lines of code could be criminally liable for criminal “speech” (writing an AI) that incites and enables crime, even as a conspirator – that’s reeeaaally doubtful on Due Process grounds, but it would definitely light a fire under every developer’s chair to make sure their algorithms are explicitly trained against criminal behavior. (but still not always.)
I mostly agree, with the exception of the last paragraph. The software world today is built on open source software that is distributed without guarantees and this is an amazing thing. If a liability like that is applied to AI, it would be easily generalized to any piece of software that might be used in malicious ways the author did not intend or predict. It would be akin to punishing a knife manufacturer for a stabbing.
It is ridiculously easy to write a genuinely well intentioned script that encrypts your files and a minor modification can turn that into a ransomware.
What happens when the first ransomware is deployed by AI, on behalf of a user who just wanted tips on how to make more side income?
that’s not how it works… at all.
It isn’t how it works today. I’m talking about sometime in the distant (or near) future. Surely at some point AI will have the capabilities on par with at least a low level hacker.
Or, if you still think that’s a stretch, just imagine all the ways perfectly legitimate software can cost companies money. Not through malicious design, but just by mistakes.
It isn’t how it works today. I’m talking about sometime in the distant (or near) future.
that would be very distant future. what we have today is machine learning. it is a powerful tool, but it is not in any way intelligent. it is not going to realize itself and start war with humanity. we wouldn’t know how to create something like that if we wanted.
if person uses that tool to generate some code that will cause damage, the consequences will be same as if that person writes that code entirely by hand. but it is not going to miraculously “go wild” and create some ethical dilemma where we wouldn’t know who is responsible.
I would be a lot more worried about an AI that does that on purpose.
What happens when the first ransomware is deployed by AI, on behalf of a user who just wanted tips on how to make more side income?
