A note, if you don't want to dry your skin out by removing your own body oils (after you've cleaned the offending substance off, of course!)... use a hair dryer.

Same result, without having to get wet. Can spot-kick the "too hot" -> remove the itch phenomenon any time, any place.