What exactly would that be?

I feel like the middle ground your talking about could be just a feed?

A feed is: a server that consumes the firehose and decided on whether to store posts, when loaded in the app it returns some post to create a feed

So essentially you only store references to part of the network rather than storing the whole thing