0.1% is within margin of error. Depending on the performance boost, it might be ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

sheepscreek 23 days ago | parent | context | favorite | on: KVarN: Native vLLM backend for KV-cache quantizati...

0.1% is within margin of error. Depending on the performance boost, it might be worthwhile taking a minuscule quality hit.

qeternity 21 days ago [–]

I think it very much is worth it!

But the point was that quality didn't magically increase.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact