Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

10x year over year, not 1000x, right? The 1000x is from this 10x observation having held for 3 years.


I believe the 1000x number I pulled is from SemiAnalysis or similar, using MMLU as the baseline benchmark and the cost per token from a year ago to today at the same score. Model improvements, hardware improvements and software improvements all make a massive difference when combined to make much greater than 10x gains in terms to intelligence/$




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: