Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I wish the Internet Archive had an embargo feature, where you could push data in and while it wouldn't be served, it would be stored until a later date when copyright issues could be worked out.


This is an interesting idea.

It would work kind of like an escrow, right? Where the "release/publish clause" could be tied to copyright expiration or other legal events like you say.

The problem I see is, how do you filter/reject the amount of stuff you would have to store without even being public? AFAIK, the IA has issues storing so much of the already-public data, so storing "dark" (non-public/unpublished) stuff would potentially mean lots of cruft and garbage so to speak.

However it does sound very interesting. I hope we can some day achieve truly permanent data storage systems were we could just dump all of this and not worry much about it again.

Edit: Thinking about it a bit more, how feasible does the following sound:

Anyone interested in helping the IA could buy a sort of Drobo/NAS that is able to store only IA stuff (ala Freenet). Everything is encrypted of course, and then only way to access the files is when the escrow trigger fires off, the private key is released at the IA archive and then every owner of the IA-box will have access to that particular part of the archive (as well as regular IA users through web).

It's kind of like an HDD preloaded full of torrents, and then the differences or new additions can be streamed to your local IA-box as needed. You could even filter what kind of stuff would you like to help the IA archive. For example, I'm a big fan of movies so I prioritize that category (up to a certain % so that no one category is forgotten).

Does anyone know if anything resembles this? I mean, I could very well leave a low-powered NAS to help the IA serve their content, store it for later use, etc. And I imagine (hope) that a lot of other people would too. It would be a way of donating electricity, space to a worthy cause.


Would tape storage, a la Amazon Glacier, be an efficient way to archive these, since they don't need to be accessed except with an offline process?


I certainly would hope so. However I'm not sure who is going to survive the longest: an organization focused on that specific goal, or a company that might change focus or go bankrupt altogether. Even though AWS is a pretty big part of Amazon (I'm guesstimating here, might be wrong), I would hope the IA would last for longer or have specific strategies to address different catastrophic scenarios that would overall make it more efficient/safe than AWS.


I recall some article that said that AWS was about 3% of Amazons income, but it was basically pure profit.


Well not pure profit because the servers cost money. The customer base is so large now that they have way more capacity than they would need for themselves.

The matching of Google's prices when they released was a good indicator of how much was profit though.


Tape needs to be taken care of just like anything else via re-tensioning and the like. There is no write and forget media as far as I can tell.

Ninja edit: That is not super price prohibitive.


> There is no write and forget media as far as I can tell.

Sure there is, you just micro-engrave it onto a nickel disc with a laser... http://blog.longnow.org/02009/05/21/what-13500-pages-micro-e...

Edit: Also paper. Low-acid paper in dry cabinets keeps a long, long time.


also the m-disc is a dvd/blueray that lasts 1000 years


.. supposedly lasts ..


> Does anyone know if anything resembles this? I mean, I could very well leave a low-powered NAS to help the IA serve their content, store it for later use, etc. And I imagine (hope) that a lot of other people would too. It would be a way of donating electricity, space to a worthy cause.

The Internet Archive serves torrent files for every object they store, so in theory, anyone could have a NAS that would crawl those torrent files and then join the swarm/seed for all of those objects.

That would be a hell of an open source project. The Internet Archive would then be a metadata repository and seeder of last resort. #shutUpAndTakeMyMoney


Isn't that already the case? I heard that they already download well-tagged music from private trackers like what.cd which could be published if its copyright expires eventually. There's a page on archive.org with "what_cd" in it's url and no public items: https://archive.org/details/what_cd


They have such a feature, they call it "darking".


Would be more interesting if copyright on anything created after Mickey Mouse would ever expire -- and unfortunately it doesn't look like it ever will.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: