it's very common to run local models in 8 bit int. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		fzzzy on July 18, 2024 \| parent \| context \| favorite \| on: Mistral NeMo it's very common to run local models in 8 bit int.

qwertox on July 18, 2024 [–]

Yes, but it's not common for the original model to be 8 bit int. The community can downgrade any model to 8 bit int, but it's always linked to quality loss.

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact