Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Did they start fighting scrapers, too? I cannot see the contents of the link it asks me to log in.


I think bluesky posts have always been private, at least while they are in invite-only mode. Here's what the linked skeet says:

> Our systems are currently experiencing some degraded performance as a result of record-high traffic. You may notice some slowness in-app as a result. Our team is working to resolve this issue.

> You can view our system performance status here: status.bsky.app


Posts are not private according to the FAQ: https://blueskyweb.xyz/blog/5-19-2023-user-faq


Sorry, you're right, private is the wrong word. I instead mean that the public web UI does not display them if you are not logged in.


By LinkedIn vs. HiQ -- if two things are both true then scraping is illegal:

1) The ToS has clauses in it against scraping

2) There is a login wall that enforces agreeing to the ToS before seeing any content.

#2 is true for now, I can't verify #1.


TOS ≠ law


Contractual agreements are enforceable at law. That's what makes them contracts.


You also can't put illegal stuff into a contract to make it legal.

Also, I didn't sign anything.


> Also, I didn't sign anything.

It's hard to take this generously. What do you mean by this, specifically? Are you saying "I didn't take out a pen and sign a physical piece of paper"? Or are you saying "I didn't click anything that says "I agree to the ToS"?

What actions are you intending which you feel are enabled by not signing anything?


Well, feel free to refer to the case law of LinkedIn vs. HiQ, as I said in the comment you replied to. That is law.


I did, thanks. In that case, it looks like the scraper prevailed: "The Ninth Circuit's declaration that selectively banning potential competitors from accessing and using data that is publicly available can be considered unfair competition under California law may have large implication for antitrust law."


I think you need to look deeper. The case went back to trial multiple times after that and in the last case, HiQ was found to be in the wrong.

The court ruled for hiQ and the right to do web scraping. However, the Supreme Court, based on its Van Buren v. United States decision, vacated the decision and remanded the case for further review in June 2021. In a second ruling in April 2022 the Ninth Circuit affirmed its decision. In a November 2022 ruling the Ninth Circuit ruled that hiQ had breached LinkedIn's User Agreement and a settlement agreement was reached between the two parties.[0]

Practically speaking, though, the dispute had essentially reached its logical end with the last court ruling in November – hiQ had prevailed on the Computer Fraud and Abuse Act (CFAA) “unauthorized access” issue related to public website data but was facing a ruling that it had breached LinkedIn’s User Agreement due to its scraping and creation of fake accounts (subject to its equitable defenses).[1]

So basically, it’s not criminal under the CFAA. Thank god. But that’s just one specific law that doesn’t apply. It still is a breach of contract and various forms of damages and injunctive relief can be found against scrapers. If the two conditions are met that I wrote several posts ago, any business based on scraping sites that have the money and motivation to find relief through the courts will be untenable. That business would find that it cannot sustain itself against repeated court actions taken against it.

ToS != law, only in the very strictest naive sense. There are plenty of laws which deal with what happens once you agree to a contract and then breach the contract. Once you agree to the ToS, you have to deal with the legal framework of business law as it applies to contracts.

If, for example, OpenAI wants to scrape Twitter in violation of the ToS, Twitter could find relief in the form of “specific performance” where the court requires OpenAI to remove all that information from its training dataset and retrain ChatGPT again. Twitter could also get damages for the times that ChatGPT served customers with the infringing model. If OpenAI didn’t fully remove the data, it would be exposed to escalating damages in the form of contempt of court remedies.

0: https://en.m.wikipedia.org/wiki/HiQ_Labs_v._LinkedIn

1: https://www.natlawreview.com/article/hiq-and-linkedin-reach-...




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: