Interchange goes to issuing banks, not Visa/Mastercard, and that's a big part of why the system is so stable as any competing scheme with a lower interchange will not be offered to customers because it won't be as profitable for the issuers. And, if needed, they can use the whole interchange amount for marketing and cashbacks to make any new scheme uncompetitive, because if it has lower interchange, then it can't match that without losing money.
One way or another every fee must be absorbed by someone that pays.