If I ask you what is the best restaurant in town, will you answer that it's your mommas house because there you always eat for free?
Cost has nothing to do with determining the quality of a search result, and search engines shouldn't discriminate against paywalled content. But I think it's a good idea to let users like you check a box to hide paywalled results.
There are millions of websites out there that are free for anyone to read, including this one! Restaurants that serve free meals are not the norm, so this analogy doesn't make a lot of sense. If every website was paywalled and required a subscription, like cable TV channels, then you might have a point.
People use search engines professionally and not only for entertainment. There is an icebergs worth of important and valuable information online behind paywalls, not only articles or news. Information workers use a search engine to find the information they need, pay the cost if it's paywalled, and then cancel any subscription after getting what they needed.
Long gone are the days of "surfing the web", when most of us spent our time online just randomly browsing around.
I don't see why there couldn't also be a professional search engine. Academics have Google Scholar which is an amazing resource for them. A search engine that brought up high quality resources for professionals would seem to be pretty useful. It could potentially even have a single subscription to unlock all of the sites in a network, rather than individual paywalls at every site.
We already have professional search engines, since they don't discriminate against paywalls. No need to change that. And there are so many fields of professionals, that you'd need a ton of different specialized search engines for that.
I've come to learn that many people on hacker news have an ethos of never paying for digital content or services. Most people here make an hourly salary of $20 or more in my estimate, yet they will spend days and days of their time to avoid paying $5 for something. So you spend $100-$200 of your time to save $5. What's the rationale?
It reminds me of my travels around the world, where I'd hang out with backpackers that would spend a long time in the supermarket looking for the cheapest noodles, instead of spending their time enjoying the exotic location they were in. Or spent half the day walking along the highway to a bus stop instead of taking a taxi that would cost $5.
I think it is fair that a search engine by default should be unbiased and look for the best result for the query, and not account for price or such.
No, I won't answer my mommas house because you can't just show up and eat there as a restauraunt. It doesn't fit the search criteria you asked for.
If you ask what the best restauraunt in town is, I'll give you a restauraunt.
If you ask what the best restauruant in town is, I won't send you to a place where you can buy a "best restauraunts in town guide" for 5 bucks, because that's not what you're asking for.
Cost has nothing to do with determining the quality of a search result, and search engines shouldn't discriminate against paywalled content. But I think it's a good idea to let users like you check a box to hide paywalled results.