Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
sirsar
on Nov 28, 2013
|
parent
|
context
|
favorite
| on:
102TB of New Crawl Data Available
We have switched the metadata files from JSON to WAT files. The JSON format did not allow specifying the multiple offsets to files necessary for the WARC upgrade and WAT files provide more detail.
Where can I read more about this?
ldng
on Nov 28, 2013
[–]
Section "Resources" of the post you haven't read ?
sirsar
on Nov 29, 2013
|
parent
[–]
No, I mean the difference between the filetypes.
Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
Where can I read more about this?