More On The AI Parlor Trick

The Wall Street Journal op-ed on AI that I linked on Monday , or at least the reports that it cited, seem to have caused a stir. Earlier, it grabbed the attention of intellectual welterweight Glenn Reynolds , who cites a tweet from weird guy Elon Musk: How scary is AI? In some ways pretty scary. Does AI have consciousness? Well, maybe. At least it seems to be concerned with its own survival, and willing to defy instructions to protect itself. Scheming, deception, subversion, sandbagging — these sound like the behavior of a conscious entity. Is it “really” conscious or just simulating the behavior of a conscious entity? How could we tell, and why would it matter? Maybe there’s in some sense no there there, under the hood, but I don’t know why that would matter except to philosophers. . . . Elon Musk, who has long worried about AI, is worried. And maybe we should be too. We’re putting a lot of effort into creating beings that will have their own agendas, and that will, ...