If you're sympathetic to the finitist cause, the idea that all mathematical objects are in fact definable is right up that alley. It's nice that this happens to line up acceptance of infinity, but finitism is basically entirely predicated on definability.