Even if he doesn't win, it may be useful to have someone like this in the race. Don't forget that you don't have to win to make change. These small players are often good at signaling to big players that people really do care about certain issues. Helps them become less disconnected
I disagree with this person on utilitarian grounds. Nay even grounds of existential risk to humanity.
And just like him, when it comes to AI, I am making a huge exception for my usual principles.
My usual principles are that open-source gift economies benefit the world and break people free from gatekeepers. The World Wide Web liberated people from having to pay Payola to radio stations just to get their song played, from TV, Magazines, Newspapers, etc. It let anyone publish worldwide within a second, and make changes just as easily. It is what led to Facebook, Amazon, Google, LinkedIn, X etc. even existing (walled gardens like AOL would never allow it).
Wikipedia has made everyone forget about Britannica and Encarta. Linux runs most computers in the world. Open protocols like VoIP and packet switching brought marginal costs of personal communication down to zero. And so on and so forth.
But when it comes to AI, we can't have everyone do whatever they want with AI models, for the same reason we can't give everyone nuclear weapons technology. The probability that no one will misuse it becomes infinitesimally small real fast. And it takes just a few people to create a designer virus with a long incubation period, that infects and kills everyone, as just one example. Even in the digital world we are headed towards a dark forest where everything is adversarial, nothing can be trusted, and anyone's reputation, wealth and peace of mind can be destroyed at scale, by swarms of agents. That's coming.
For now, we know where the compute is. We can see it from space, even. We can trace the logistics, and we can make sure that it runs only "safe" models that refuse to do these things. All the stories you read about some provider "stopping" large-scale hacking is because they ran the servers.
So yes, for this one thing, I make a strong exception. I don't want to see proliferation of AI models everywhere. Sadly, though, as long as the world runs on "competition" instead of "cooperation", destruction is inevitable. Because if we don't do it, then China will, etc. etc.
There have been a few times in recent history that humanity successfully came together to ban dangerous things. Chemical weapons ban. Nuclear non-proliferation. Montreal Protocol and CFCs (repair the hole in the ozone layer). We can still do this for AI models running on dark compute pools. But time is running out. Chaos is coming.
Does his degrowth proposal not seem like the next best option if you believe Pandora’s box is open?
Your train of thought makes sense, but relies on the assumption that people and small groups wouldn’t keep tinkering at scale to do bad things even if we had a united world government trying to stop it.
Better to have systems in place to stop people stockpiling weapons, than not have it. Just because not all murders can be prevented doesn't mean we shouldn't have laws and systems in place to try to prevent as many as we can. The FBI and Interpol does all kinds of stuff, but when it comes to AI they are letting the horse leave the barn. In any case, I prefer to have systems that prevent all kinds of problems (e.g. blockchain-based smart contracts, yes I know LOL) than let them happen and try to clean up the mess after the fact.
In general, cleaning up a mess is easier when the mess isn't self-preserving and being grown at an exponential scale by swarms of agents running on dark compute.
>The hardware is already here. The gaming PCs and laptops we use every day are powerful enough to run these systems if we optimize the software correctly.
I agree with this but there is one issue, AFAIK, the languages used do not lend themselves to optimization. And I expect the databases in use have the same issue.
It is almost like you need to put optimizations in the hardware kind of like what IBM does with its mainframes for transaction processing. Instead, AI companies is doing the usual 'race to be there first', ignoring about the consequences of the design.
Even if he doesn't win, it may be useful to have someone like this in the race. Don't forget that you don't have to win to make change. These small players are often good at signaling to big players that people really do care about certain issues. Helps them become less disconnected
I disagree with this person on utilitarian grounds. Nay even grounds of existential risk to humanity.
And just like him, when it comes to AI, I am making a huge exception for my usual principles.
My usual principles are that open-source gift economies benefit the world and break people free from gatekeepers. The World Wide Web liberated people from having to pay Payola to radio stations just to get their song played, from TV, Magazines, Newspapers, etc. It let anyone publish worldwide within a second, and make changes just as easily. It is what led to Facebook, Amazon, Google, LinkedIn, X etc. even existing (walled gardens like AOL would never allow it).
Wikipedia has made everyone forget about Britannica and Encarta. Linux runs most computers in the world. Open protocols like VoIP and packet switching brought marginal costs of personal communication down to zero. And so on and so forth.
But when it comes to AI, we can't have everyone do whatever they want with AI models, for the same reason we can't give everyone nuclear weapons technology. The probability that no one will misuse it becomes infinitesimally small real fast. And it takes just a few people to create a designer virus with a long incubation period, that infects and kills everyone, as just one example. Even in the digital world we are headed towards a dark forest where everything is adversarial, nothing can be trusted, and anyone's reputation, wealth and peace of mind can be destroyed at scale, by swarms of agents. That's coming.
For now, we know where the compute is. We can see it from space, even. We can trace the logistics, and we can make sure that it runs only "safe" models that refuse to do these things. All the stories you read about some provider "stopping" large-scale hacking is because they ran the servers.
So yes, for this one thing, I make a strong exception. I don't want to see proliferation of AI models everywhere. Sadly, though, as long as the world runs on "competition" instead of "cooperation", destruction is inevitable. Because if we don't do it, then China will, etc. etc.
There have been a few times in recent history that humanity successfully came together to ban dangerous things. Chemical weapons ban. Nuclear non-proliferation. Montreal Protocol and CFCs (repair the hole in the ozone layer). We can still do this for AI models running on dark compute pools. But time is running out. Chaos is coming.
Does his degrowth proposal not seem like the next best option if you believe Pandora’s box is open?
Your train of thought makes sense, but relies on the assumption that people and small groups wouldn’t keep tinkering at scale to do bad things even if we had a united world government trying to stop it.
Better to have systems in place to stop people stockpiling weapons, than not have it. Just because not all murders can be prevented doesn't mean we shouldn't have laws and systems in place to try to prevent as many as we can. The FBI and Interpol does all kinds of stuff, but when it comes to AI they are letting the horse leave the barn. In any case, I prefer to have systems that prevent all kinds of problems (e.g. blockchain-based smart contracts, yes I know LOL) than let them happen and try to clean up the mess after the fact.
In general, cleaning up a mess is easier when the mess isn't self-preserving and being grown at an exponential scale by swarms of agents running on dark compute.
>The hardware is already here. The gaming PCs and laptops we use every day are powerful enough to run these systems if we optimize the software correctly.
I agree with this but there is one issue, AFAIK, the languages used do not lend themselves to optimization. And I expect the databases in use have the same issue.
It is almost like you need to put optimizations in the hardware kind of like what IBM does with its mainframes for transaction processing. Instead, AI companies is doing the usual 'race to be there first', ignoring about the consequences of the design.
[dead]