the quality of the prompt does not look that good from my experience reaching flexible structured output based on a schema
There are other questionable decisions and a valuable use of engineering time is indeed to evaluate candidate abstractions and think about the long-term cost of adopting them. In this case, it does not seem like it saves that much effort and in the long run means a lot of important LLM knobs are out of your control. Not a good tradeoff
Sure, your engineers could implement it themselves, but don’t they have better things to do?