It's even worse because LLM providers don't even need to be doing anything malicious for the conclusions to be garbage.
The vast majority of information that the LLM "reads" about any given product is going to come from listicles and other poorly researched "reviews", ad placements, astroturfed comments, and marketing material. They launder all of this together, "summarize" it and present it as rigorous market research. Garbage in, garbage out.
The vast majority of information that the LLM "reads" about any given product is going to come from listicles and other poorly researched "reviews", ad placements, astroturfed comments, and marketing material. They launder all of this together, "summarize" it and present it as rigorous market research. Garbage in, garbage out.