The problem with intelligence "arising" from mechanical operations
In the comments on this post , rob argues that a bunch or "circuits" (or neurons, I guess) behaving according to deterministic, mechanical laws is exactly what "gives rise" to intelligence, in humans or computers. The problem with this view is Occam's razor . Let us consider a door lock. If the lock is set, one can't open the door without a key (at least without breaking it). We can see why this is so on simple, mechanical principles. Now, it just could be that the door "knows" when it is supposed to let people in who don't have the key, and when it shouldn't. But generally we reject any such hypothesis as superfluous: once we understand how the door mechanically does its job, we simply don't need to posit any "knowing": it won't "do any work" in our explanation of when we can get in the house and when we can't. Now let's say we add some biometric feature to the door: the owner can still get in by f...