Not at all. This is actually part of why telephoto lenses use a lot of plastic, you can get a plastic to have ~0 thermal expansion, but that's impossible for a metal, meaning better IQ.