Well I think that's a big part of why the focus lately is moving to sugars over fats. But the other point is that they're not very rich in nutrients.

Unsaturated fats are essential for brain function & health. Increased consumption has been linked to a reduced risk of dementia and Alzheimers.

It's saturated fats and trans fats in particular that everybody is warning you off, not lipids altogether.