It's really good at hacking. So imagine people with ill will messing with important things snowballing into chaos.
Could be a massive centralization of power and oppress people into a big ole classic rebellion and civil war.
Or it could just straight up crash the economy in unrecoverable ways. As a whole it's basically the largest collective investment into a thing we aren't even sure will be profitable still. That doesnt workout long term.
Ultimately I think your intuition is correct. It's not the AI per se...its what people will do with that power and its completly uncontrollable. The will of the weilder isnt nesscarily going to be your intrest. Its not going to outsmart humans in the long run... I dont see that happening.
I've thought about a few scenarios.
Could fool leaders into triggering a nuclear war.
It's really good at hacking. So imagine people with ill will messing with important things snowballing into chaos.
Could be a massive centralization of power and oppress people into a big ole classic rebellion and civil war.
Or it could just straight up crash the economy in unrecoverable ways. As a whole it's basically the largest collective investment into a thing we aren't even sure will be profitable still. That doesnt workout long term.
Ultimately I think your intuition is correct. It's not the AI per se...its what people will do with that power and its completly uncontrollable. The will of the weilder isnt nesscarily going to be your intrest. Its not going to outsmart humans in the long run... I dont see that happening.
AI getting so powerful enough to develop bio-weapons.