That's interesting. I think there's been some pretty significant improvements in the rate of hallucinations and accuracy of the models, especially when it comes to rule following. Perhaps the biggest improvement though is in the size of context windows which are huge compared to this time last year.

Maybe progress over the last 2-3 months is hard to see, but progress over the last 6 is very clear.