I was just thinking about the difference between an LLMs capacity for theory of mind and a human's capacity for theory of mind, and I realize it gets at the heart of what differentiates an LLM from human, and that's the method of how we gather information. LLMs are based on objective data, e.g. text, numbers, pixels, etc. Whereas we as humans, use subjective information, e.g., feelings, sensations, experiences; as well as objective data. Within cognitive science, this would be described as affective empathy vs cognitive empathy. Or in other words, LLMs simply possess a cognitive theory of mind, whereas we have both a cognitive *and* affective theory of mind. The problem I have with figures like Hinton, who claim that AI is already conscious, is that his whole framework is based on the idea...