I thought agreements like that weren't binding if the person signing them didn't realize they were entering that agreement.

You don't remember that checkbox you clicked when registering for your account affirming that you definitely 100% read, understood, and agreed to be bound by Google's Terms and Conditions and Privacy Policy?

In many jurisdictions arbitration clauses for consumers cannot be binding and can neither prevent them to sue in court.

Check your local laws.