It is true that a Mac running Safari is just a glorified boolean circuit. It is also true that a human being is just a glorified bunch of subatomic particles. It's not a useful way to understand what's going on. There is a higher-level structure built out of the lower-level pieces, and it is the higher-level structure that is important and not the lower-level pieces.
It would be possible to make a web browser out of a different type of logic circuit. It's the higher-level structure of the browser that matters, and not the fact that it is built out of boolean logic.
Similarly, with ChatGPT, it is the higher-level structures (whatever they may be) that matter, and not the low-level details of the neural network. The higher-level structures could be far too complex for us to understand.
It would be possible to make a web browser out of a different type of logic circuit. It's the higher-level structure of the browser that matters, and not the fact that it is built out of boolean logic.
Similarly, with ChatGPT, it is the higher-level structures (whatever they may be) that matter, and not the low-level details of the neural network. The higher-level structures could be far too complex for us to understand.