It’s good at a lot of things: GPT‑4.1 scores 54.6% on SWE-bench Verified, improv... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		conradev 64 days ago \| parent \| context \| favorite \| on: Huawei releases an open weight model trained on Hu... It’s good at a lot of things: `GPT‑4.1 scores 54.6% on SWE-bench Verified, improving by 21.4%abs over GPT‑4o and 26.6%abs over GPT‑4.5—making it a leading model for coding.` https://openai.com/index/gpt-4-1/

coliveira 64 days ago [–]

They are trained on these "benchmarks", that's why they score better.

elzbardico 64 days ago | [–]

If they were trained on those benchmarks they would score 100%

coliveira 64 days ago | | [–]

They show how bad they are, they cannot score 100% on benchmarks they were trained on.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact