Alternatively, you can create a second gmail account to 'archive' your least used contacts, and your primary account for your most used. I do this for archived email as well, for example.