Probably observing them longer and verifying if the predictions from earlier evaluation match their future behaviors.

Something like "she seems sad" and 5 minutes later "yup, she's crying now"