Sugar alcohols are abundant in nature and have been a part of our diets for pretty much all recorded history. They are well-understood and probably don't warrant the kind of intensive inquiry that is appropriate for a completely novel synthetic compound, such as aspartame.
There are more papers on aspartame than on potatoes, but that's not a reason not to avoid the latter, right?
According to whom? If people are suspectful of the must studied food substances, why would they trust something that's less studied?