I think that's conflating "stress" with "challenge". One makes you and grow, while the other is just an incentive not to die.

There are challenging things which are not stressful, and stressful things which are not challenging. (Especially if they hinge on something beyond your control.)