John Searle has a thought experiment of Chinese room which got AI world off guard in 1980. It is still lingering in AI people. In its core, it states that even if a computer (or a person who does not understand Chinese) in Chinese room to translate Chinese, say, into English, has past Turing test, the computer (or the person) still does not understand and consciously translate the language.
Daniel Dennett rebukes the argument and states that the Chinese room is an “intuition pump”. Dennett has argued that the person in Chinese room has to have memory, recall, emotion, world knowledge, and rationality to do his job.
I am with Searle for this one, even if both are my favorite philosophers.
No, you do not need memory, recall, emotion, world knowledge, and rationality to shuffle the words if you have a good shuffling manual in Chinese room. Ok, you have to have some knowledge to understand the manual.
Let’s see how an 18-month kid really understand things(I’ll get the video here later).