How does that work? If you can be sure it was owner initiated, then you allow, outside of some corner cases (which work here too), people to fraud merchants. That makes people happy?
Edit; I know there are more reasons for chargeback and those you can get across the line here too, however, 'frivolous' chargebacks are not good for anyone but they are easy in the US.
You are assuming that people only do chargeback in the case of some kind of fraud where other people stole your card details and spent your money. That is not the case. There are many other reasons to do a chargeback, far more reasons in fact.
Edit; I know there are more reasons for chargeback and those you can get across the line here too, however, 'frivolous' chargebacks are not good for anyone but they are easy in the US.