My heuristic: the more you're solving a solved problem that is just tedious work and memory intensive take a crack at using AI. It will probably one shot your solution with minimal tweaks required.

The more you deviate from that, the more you have to step in.

But given that I constantly forget how to open a file in Python, I still have a use for it. It basically supplanted Stackoverflow.