IMO this is more a Google problem than a Pinterest problem. Google does the same thing with text search (returning results that have few if any of your search terms), possibly over relying on opengraph tags and other such metadata.
...and yet whenever Google deprioritizes over emphasis on SEO, Pinterest never seems to go away... Is it some sort of partnership they have that keeps Pinterest so prevalent? Or did Google one day just decide to promote Pinterest more, I'm sure they promote Facebook and other social media site results too.
I concur. It's such a pain to go back and requote random words in my query on every search because Google decided it knew what I wanted better than I do.