0.2% really isn't free. If you have a data set of 10 TB (one small-ish HDD right... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Sesse__ on March 6, 2023 \| parent \| context \| favorite \| on: Show HN: Faster FastAPI with simdjson and io_uring... 0.2% really isn't free. If you have a data set of 10 TB (one small-ish HDD right now, or one large SSD), that's ~20 GiB in page tables alone. If you can use 2MB pages, then sure, but I would assume that also limits your page-in granularity.

loeg on March 6, 2023 [–]

Oh, you're right. I wasn't remembering we needed PTEs to cover the data not paged in as well as the data in RAM. Sorry.

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact