The people making the argument in trying to shame those rejoicing that Colin was fired*** (left)*** are the same sorts of people that keep trying to spin the narrative back into the offending sides favor in such situations, heavily relying on the victim card as if its more important that a guy spouting unapologetically sexist misogynistic nonsense be protected than those that such rhetoric condemns. Perpetuating institutional ideals about people like that "joke" was, has symbolic and tangible effects in shaping the way we as culture think about concepts of race, gender, sexuality, etc... Which is why I always get frustrated when its dismissed as someone simply being offended. Beyond being offended is the actual harm this shit brings about, as innocuous as that joke may seem to people. If this were an isolated case with Colin it might be easier to look past or hell, even if he showed a bit of remorse (although it shouldn't be). If either were the case, Colin likely would have been able to stay on the show and it wouldn't have been as big of an issue.
But lets stop pretending he is the victim here. No one forced him to continuously poke at the groups of people he did; he did that alone through conscious decision making and when pushed doubled down and is now aligning himself with a bunch of additional alt righters. Whether or not you like him as a journalist is really besides the point, its 2017 and time to move past the antiquated ideals of generations past which only serve to further their own ends, even with something as simple as a joke.