Land value tax didn't destroy the British Liberal Party in the early 1900s. The flawed neoclassical economic consensus (capital vs labor) did. The Labour Party absorbed most of the ex-Liberal voters and then became the Conservatives' main rival.

Then the wide adoption of technology like the automobile (which made it possible for many to simply commute to and from the city instead of be there all the time) eroded the political necessity to tackle difficult urban land issues for decades. "Drive until you can afford to live" only gets you so far though and we're hitting the limits of that in many places now.