Indeed, I also think consciousness cannot be reduced to computation.
Here is one more thing to consider. All consciousness we can currently observe is embodied; all humans have a body and identity. We can interact with separate people corresponding to separate consciousnesses.
But if computation is producing consciousness, how is its identity determined? Is the identity of the consciousness based on the set of chips doing the computation? It is based on the algorithms used (i.e., running the same algorithm anywhere animates the same consciousness)?
In your example, if we say that consciousness somehow arises from the computation the man performs itself, then a question arises: what exactly is conscious in this situation? And what are the boundaries of that consciousness? Is the set of rocks as a whole? Is it the computation they are performing itself? Does the consciousness has a demarcation in space and time?
There are no satisfying answers to these questions if we assume mere computation can produce consciousness.
There are indeed no good answers, but that doesn't imply that the premise is wrong - it can just as well be that we assume that notions like "identity" are fundamental when it is in fact a property that we ascribe based on factors not directly related to consciousness (i.e. things like bodies), simply because our day-to-day experience always includes those factors and places them front and center.
Even with humans there are cases where this breaks down to some extent. E.g. in the case of multiple personality disorder, how many distinct streams of consciousness are there, and should we consider them distinct identities?
Just wanted to point out that I absolutely share your view here. I would like to add that the concept of virtualization and the required representation of computation makes substrate-independent consciousness rather absurd.
To me the only explanation for consciousness I find appealing is panprotopsychism.
Here is one more thing to consider. All consciousness we can currently observe is embodied; all humans have a body and identity. We can interact with separate people corresponding to separate consciousnesses.
But if computation is producing consciousness, how is its identity determined? Is the identity of the consciousness based on the set of chips doing the computation? It is based on the algorithms used (i.e., running the same algorithm anywhere animates the same consciousness)?
In your example, if we say that consciousness somehow arises from the computation the man performs itself, then a question arises: what exactly is conscious in this situation? And what are the boundaries of that consciousness? Is the set of rocks as a whole? Is it the computation they are performing itself? Does the consciousness has a demarcation in space and time?
There are no satisfying answers to these questions if we assume mere computation can produce consciousness.