If this is correct, I wonder if a model finetuned on buggy code would become more self-conscious and more clumsy or "noob"-like.