AI Risk #3 - How Might it Go Rogue?
How would an AI/superintelligence go rogue/take over the world? Nick Bostrom predicts several ways this would happen in Superintelligence . Think of these possible scenarios, to get a hang of what could happen, not as a necessarily accurate description. If the AI concludes we humans would get in the way, it may bide its time to develop a killer strike capability before it acts on its ultimate goal. If that weapon uses self-replicating tech, then only a few units would suffice – it won’t need to wait to create a massive stockpile, he warns. Or the superintelligence may attain power by: “… hijacking political processes, subtly manipulating financial markets, biasing information flows, or hacking into human made weapons systems.” When I read those lines in 2013, it sounded very far-fetched. Today, it doesn’t. It’s not necessary the AI would target us humans. If it doesn’t feel we are a threat, it may let us be. Or we may become collateral damage – unint...