Roko’s Basilisk: the idea that the emergence of super-AI is inevitable and that it will kill everyone that hindered or didn’t support its development in revenge. If both those premises hold, it makes sense to aid its development for self-preservation.
I don’t think either premise holds, personally, but these people evidently do.
That human beings are logical and that they do anything with intention. For the vast majority of people, this is patently false.
That a super intelligence sees revenge as an efficient use of scarce resources, which given both that revenge is nonsensical without the prerequisite biological need for it, and the conclusion of ‘1’, is nonsensical.
That even if 1 and 2 were real, that there’s some inherent timeframe in which the AI thinks it should have been created.
The only real bodily danger of AI is inherent in the the humans who control it.
Roko’s Basilisk: the idea that the emergence of super-AI is inevitable and that it will kill everyone that hindered or didn’t support its development in revenge. If both those premises hold, it makes sense to aid its development for self-preservation.
I don’t think either premise holds, personally, but these people evidently do.
Roko’s Basilisk is stupid.
It presumes three things.
That human beings are logical and that they do anything with intention. For the vast majority of people, this is patently false.
That a super intelligence sees revenge as an efficient use of scarce resources, which given both that revenge is nonsensical without the prerequisite biological need for it, and the conclusion of ‘1’, is nonsensical.
That even if 1 and 2 were real, that there’s some inherent timeframe in which the AI thinks it should have been created.
The only real bodily danger of AI is inherent in the the humans who control it.
You’re just doing Pascal’s Wager For Computers.
I once saw someone call the Singularity the Rapture but for nerds, and I thought that was spot on.