I think 'do not disturb' has an option for only allow people from your contacts? and there are crowdsourced blacklist apps for scammer/harassment phone numbers.