How about putting a cap on the maximum number of people one delegate can represent. It probably wouldn't entirely prevent it but it might discourage it by at least making it a less productive venture.

"No one person can represent more than 20% of the total voters" or something like that. That way you have at least 5 big fish in the pond.