Although, if the goal is to switch entirely off of plastic, I don't think modern glass baby bottles will do that, because the ones I've seen still use plastic caps.

BTW, we just bought some glass bottles (with plastic caps) today. We'll see how they go.