That's completely irrelevant. The problem is that he wore a shirt that sexualises women in a televised major scientific event. Millions of people saw the video, and the image he projected was that he's more interested in sex than in making women feel welcome and valued in science. Which is incidentally the same image you're portraying.
"the image he projected was that he's more interested in sex than in making women feel welcome and valued in science. "
Was the shirt professionally appropriate? No.
Was he "projecting that he was more interested in sex than women in science"? No.
Overstating the case is probably the worst sin in political discussions. It might feel all good to do it, but all it does is make it easy for you to be dismissed entirely.
In fact some of his female colleagues came to his defense on Twitter.