Rare things are not automatically valuable. I still have "dragon dice" and an original deck of cards from an old lord of the rings game. Basically worthless.

Yes, baseball cards would become incredibly valuable (at least the rare ones).

This only would be the case if people continued to care about baseball. In reality, fewer people would care less and less over time. For example, there is not great value in jousting paraphenelia.