How do you reconcile the fact that LLMs can be pretty fair-weather? Meaning, while they can serve as a sounding board and often raise perspectives you might not have thought of, they don't have much conviction and will change their tune if you push them in the other direction enough.
My approach is to compliment the LLM on something I've not thought of and ask it to sell me on the approach, expound on its position, and ask probing questions. If I get a feeling something's off I just go do independent research like normal.
