I think that's a gross oversimplification and Pence is getting a lot of unfair hatred because he's part of the Trump administration rather than having the situation judged on its merits. I know of a person who went on a business trip with a person of the opposite gender and they had to get separate rooms because of the fact. If they had shared the same room but slept in separate beds would that have been appropriate even though it was purely business and non sexual? People have their own boundaries and if Pence doesn't want to put himself in a position where he is having dinner with a female associate on his own then he should be allowed to.
Bigots will be heavily scrutinized. Don't waste time crying for him.