The thing is that you could also use this kind of logic to show that there are more natural numbers than there are natural numbers. For example, you could associate 1 with all of the numbers from 1 to one million, and still have enough numnbers 'left' to associate each of 2,3,... with distinct natural numbers above one million.