One time about a year and a half ago I Googled the correct temperature to ensure chicken has been thoroughly cooked and the highlight card at the top of the search results showed a number in big bold text that was wildly incorrect, pulled from some AI-generated spam blog about cooking.

So this sort of thing can already happen.