Searle's argument is annoyingly hard to dismiss and annoyingly hard to accept. He says: a person in a room, shuffling Chinese characters by rule, doesn't understand Chinese — and a computer doing the same thing doesn't either. Most people read it once, decide it's obviously right or obviously wrong, and move on. That's a mistake.
The argument, fairly
Imagine you don't speak Chinese. You sit in a room. Slips of paper come in with Chinese characters on them. You consult a giant rulebook in English: "if you see X, write Y." You write the response, slide it out. From outside, the room seems fluent. From inside, you understand nothing.
# Searle's structure, in pseudocode
def room(input_slip):
rule = lookup(input_slip, rulebook)
return rule.apply(input_slip)
# Question: is there understanding
# anywhere in this stack?The most interesting rebuttal
It isn't from Dennett — though his is sharp. It's the Systems Reply: maybe you don't understand Chinese, but the room as a whole does. You're just one component. Searle finds this absurd. I find it the strongest move in the literature, and the conversation we'll have for the next 11 minutes.