It would be nice if links you flagged would be removed from your view. It's sort of strange to have flagged something, come back the next day, and see an upvote arrow with the "Unflag" verb next to it.