Cost is basically time here. "How much compute we can afford" is really "how lon... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		kazinator on May 31, 2024 \| parent \| context \| favorite \| on: “Imprecise” language models are smaller, speedier,... Cost is basically time here. "How much compute we can afford" is really "how long we are willing to wait for the result".

trashtester on May 31, 2024 [–]

Then again, time * size_of_cluster = cost.

If you train on a cluster that costs >$1M/day to operate, the wait time is likely to be a smaller concern than the financial cost, unless you're REALLY in a hurry to beat some competitor.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact