Thanks! Are the scores in some way linear here? As in, if model A is rated at 25... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		IgorPartola 8 months ago \| parent \| context \| favorite \| on: DeepSeek-v3.1-Terminus Thanks! Are the scores in some way linear here? As in, if model A is rated at 25 and model B at 50, does that mean I will have half the mistakes with model B? Get answers that are 2x more accurate? Or is it subjective?

esafak 8 months ago [–]

I believe the score represents the fraction of correct answers, so yes.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact