> I am curious to know more about the limitations / perils of using LLMs to train/evaluate other LLMs.

At the extreme, there is this paper on ‘inbred LLMs’: https://www.nature.com/articles/s41586-024-07566-y