Since we're all just speculating to the wind here, I can see multiple ways LLMs can be used. Maybe it'll help simplify TA triage, maybe it'll just be a Discord bot. Maybe a classifier will sample from multiple models.
I think if anyone can give this idea a fair shot it's Andrew Karpathy, an ML expert and a person known to be passionate about education.