Hacker News new | past | comments | ask | show | jobs | submit login
Early Evals for OpenAI O3 (openai.com)
30 points by maurycy 4 months ago | hide | past | favorite | 2 comments



Wow, the demo where the user asks for untraceable payments shows some pretty sophisticated reasoning. The word "crafty" comes to mind.


New SOTA's on:

SWE-Bench - 71.7

Competition Code - 2727

ARC (Semi Private Eval) - 75.7 on low, 87.5% on high compute

Frontier Math (previous SOTA was 2%) - 25% on high compute




Consider applying for YC's Summer 2025 batch! Applications are open till May 13

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: