Thanks, but wikipedia_en_all_nopic_2023-12.zim is still 56 GB, whereas the BZ2-c... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		peterburkimsher on Jan 8, 2024 \| parent \| context \| favorite \| on: I made an app that runs Mistral 7B 0.2 LLM locally... Thanks, but wikipedia_en_all_nopic_2023-12.zim is still 56 GB, whereas the BZ2-compressed Wiki2Touch archives are only about 14 GB for the latest (and only 8 GB for an archive from 2012 which I'm using).

TN1ck on Jan 8, 2024 [–]

I was wondering if that's why you are doing this, impressive how much smaller Wiki2Touch is. Very cool project of yours, hope you succeed!

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact