Precisely. Holding an official currency gives you the ability to stop the government from putting you in prison for nonpayment of taxes. This is a real tangible value that is a sort of baseline value store for official currencies that does not exist for other currencies.
Power doesn't come from the gun, but from public legitimacy. In the same manner that it would be considered legitimate for someone to defend themselves with a gun.
