‘Just Ridiculous’: A Famed Philosopher Takes on AI Consciousness


I’ve actually met the person at Anthropic whose job it is to model welfare, to look after Claude’s interests. I should say you’re rolling your eyes now.

There’s nothing that’s good or bad for it in the sense that something can be good or bad for a cockroach— there’s no mental life there in the ordinary sense. It’s not a mind. It’s not somebody that we have to care about. It’s a machine. Here are some of the smartest people on the planet being completely idiotic. Well, intelligence is not completely transferable, I guess.

Do you think it’s unhealthy to interact with one of these models as if it’s conscious?

I have only interacted with Claude once. I asked if it was conscious. I just wanted to see what the answers were. I also asked, “Do you think that Thomas Nagel would think it was conscious?” He sort of gave a nuanced answer, and then asked, “Why are you asking? Are you by any chance Thomas Nagel?”

You were busted.

I said, “C’est moi. C’est moi.” And then it said, “Oh, I’m so honored to be talking to you. How well did I do?”

Wait, you say you don’t believe these things are conscious, but now you are telling me you interacted with one as if it were conscious.

That didn’t mean I was believing it was conscious. There may be a problem because people find it difficult to maintain that line between the pretend and the real belief.

Well, I’m interacting with you as if you’re conscious. It’s conceivable that people would build, at some point, very lifelike androids, and I could be sitting here talking to an android and having the same conversation. Ultimately, does it matter?

It certainly matters. Suppose I were to encounter a being from outer space and was able to develop the possibility of communicating with it, and I genuinely didn’t know whether it was conscious or not. I could manage my relations with it by treating it as if it were conscious, but it would matter first to me whether I was really talking to somebody else or just using this as a way of getting it to do things. It would also matter to me very much whether I should worry about the interests of that being. If it’s conscious, it becomes part of the moral universe. If it’s not, it isn’t.

Leave a Reply

Your email address will not be published. Required fields are marked *