The list of places I'm willing to solicit is shrinking, since I only do business with people who accept cash as an option, even if I don't happen to be paying with cash at the time.

Merchants are free to make their choices, as are consumers. The problems really start when the government steps in and removes your freedom at the point of a gun.