In my experience the data and statistics that you want to know here are typically proprietary and the knowledge is internal and in "human brains" as well - not out there on the internet. So for these cases, since its not a matter of crawling but having access to the data or human experts. I'd be interested to know how your incorporating all that and what benefits you get from LLMs.
There are two elements we can't do, the traditional primary research sources like surveys, focus groups and interviews, and proprietary data that sits behind a wall. The premise of MarqtAI is that we compensate this by collecting much more data, from more sources, to give a balanced average instead. In our testing we reached at least a 90% match to what you expect from research firms.
Having said that, it's not always possible to get information about f.e. market shares. MarqtAI is much more about ensuring you don't need the expertise, time and money to do the research or buy it from a firm.
You are welcome to do a test, it's free, no credit card needed and without obligation: https://app.marqtai.com
