You can’t type “How do I make a pathogen to wipe out a city” into a book. A sufficiently advanced and aligned AI will, however, answer that question with a detailed list of production steps, resource requirements and timeline.
this requires special materials like enzymes and such. It would much easier to restrict access to those. Now true this godlike ai could go back to show you how to make all the base stuff but you need equipment for this like centrifuges and you will need special media. Its like the ai telling you how to make a nuke really. Yeah it could star you off with bronze age metal smithing and you could work your way up to the modern materials you would need but realistically you won’t be able to do it (assuming again you restrict certain materials)
You can’t type “How do I make a pathogen to wipe out a city” into a book. A sufficiently advanced and aligned AI will, however, answer that question with a detailed list of production steps, resource requirements and timeline.
Oog, what if by making this fire, it burns down the forest?
Well that did happen to be fair.
Right. So, the actual danger here is… Search engines?
Have you heard about this thing called the internet?
this requires special materials like enzymes and such. It would much easier to restrict access to those. Now true this godlike ai could go back to show you how to make all the base stuff but you need equipment for this like centrifuges and you will need special media. Its like the ai telling you how to make a nuke really. Yeah it could star you off with bronze age metal smithing and you could work your way up to the modern materials you would need but realistically you won’t be able to do it (assuming again you restrict certain materials)