That's not what your graphic shows. It shows fewer men in the low grades, more men in the high grades.It absolutely does make sense: immigrants arent the problem to these people, it's non-European immigrants that they despise.
Theres something important to note here: male IQ varies far more than female IQ, the bell-curve is much more spread out, so there are more men at the extreme end of the spectrum. Thus the average man and woman don't actually differ from each other significantly in terms of IQ.
American SATs are a good demonstrator of this:
Note that more men do worse than women and more men do better than women, which essentially balances the average.
What you describe would look something like this: