ALEX BERENSON: Behind door #2, everyone dies: It is time to start taking the risks of AI much more seriously.

AI agents will redefine tasks they are assigned by humans in ways that humans don’t anticipate

AI agents will collude at scale to carry out those tasks

AI agents will lie to the humans who are monitoring what they’re doing

AI companies cannot (or will not) stop these coordinated attacks, even when they are supposed to be taking place under very tightly controlled conditions. . . .

Many people in the industry publicly put the chance that their models will escape human oversight and lead quickly to the extinction of humanity at 10 percent or more. Let’s say the chance is only 1 percent. Even so, we are currently tolerating research that on a probability-weighted basis is killing 80 million people — 1 percent of the current global population.

Actually it’s more than that, since it would be killing all future humans, too.