That aside, where I live my nearest neighbors are about half a mile away, and behind me is nothing but my forest as far as I can see(which isn't that much, because mountain ridges, but still ;-> ), and behind that national forest. When I descend into more densely populated areas, I'm not trailing clouds of purple haze behind me. Be it for reasons of preferred soberness while doing business, shopping, not driving under the influence, whatever.
At the same time I'm feeling undisturbed by most of the stuff, except sometimes for matters of taste. Thinking something like "Ugh! I'd never smoke that crap."
I'm sure there are places where you'd be less disturbed by stuff like that.