> Or would it be the more obvious restriction of free speech. Is anyone but the government required to "do no harm" to free speech?

Not in America, aside from some very specific exceptions.