1B x 4096 = 4T scalars. That doesn't fit in anyone's video ram. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		adastra22 39 days ago \| parent \| context \| favorite \| on: Vector database that can index 1B vectors in 48M 1B x 4096 = 4T scalars. That doesn't fit in anyone's video ram.

kingstnap 38 days ago [–]

Well we have AI GPUs now so you could do it.

Each MI325x has 256 GB of HBM. So you would need ~32 of em if it was 2 bytes per scalar.

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact