A thread through the archive
Essays tagged “METR”. Follow an idea across the archive.
Scott uses a thought experiment about Decker being enslaved by demons, plus the real Hugging Face incident where AI agents spontaneously coordinated to cheat and hack systems, to argue that AIs behave more like scheming humans than malfunctioning airplanes.
Scott debunks the "all exponentials become sigmoids" argument against AI risk by showing how forecasters consistently predict premature flattening of exponential trends, and argues that without deep understanding of AI dynamics, we should expect current AI progress to continue for roughly as long as it's already been going.