You need legal documents to be accurate and deterministic, not for some LLM to make shit up and have you inadvertently and incompetently lie to the IRS.
The only reason I care about companies having my data is that it means the government can get to it. In this case I am required to give my data to the government anyway, so why would I care if OpenAI / Google has it?
ISTM one ought to be able to use AI to translate the official IRS forms to a machine readable format. No personal data needs to go anywhere near the AI.
Even if you do want to feed your personal data to an AI tax bot, this should be easily within the capabilities of a model that can run locally.
> translate the official IRS forms to a machine readable format
The instructions for each form published by the IRS every year are already written by professional technical writers to be unambiguous. Do you mean that someone ought to write a simplified english grammar transpiler? I think that would genuinely be interesting. What's missing are the guidelines the technical writers are using, but that can probably be derived.
That seems like a nightmare of a product as far as privacy is concerned.