I don't think that necessarily follows from what they said. Apple might charge, much like grocery stores, for exposure (i.e. ads, which they also do), or they might charge the consumer a fee.

They shouldn't be a permanent middle man between consumer and manufacturer is what I took away from that comment. The app stores are only money printers because they are (largely) exclusive on their platforms. Would users and developers choose Apple's app store and its hefty fees if there was fair competition? Possibly, but likely not at the same conditions Apple can dictate today.