If we give it to Americans, then we just also rely on brown people making minimum wage or less - undocumented Americans.
The reality is our entire economy is more or less fake - it's propped up like a dead body by hyper-consumerism. We rely on buying way more shit than we should, and that, in turn, requires warm bodies who can't live off their wages. This is in high contrast to the economy of the early to mid 20th century.
We can rip that bandaid off, but things would suck for a while, maybe a long time. That's a hard sell - especially since we (not underpaid) get nothing.