Not quite. The military is like that but the government itself has no problem with aliens. Palpatine just doesn't care what policies the military follows so long as they keep control. In the old canon, the Empire was explicitly xenophobic, but the new canon has made it more nuanced, with multiple aliens serving the Empire like Amedda, Thrawn, Kreel, the Inquisitors, etc. The Empire is most popular in the Core, which is wealthy and largely human outside of metropoles like Coruscant, so the most zealous adherents and the people who tend to sign up for the cause are humans.
The Empire isn't speciesist, but it's #1 with speciesists. Again, Servants of the Empire covers this pretty well.
Here's Pablo though.
http://i.imgur.com/IlscvKX.jpg[img][/quote]
Yeah, until they show alien Imperial/First Order officers in the movies though (or at least non-white ones) then they still seem to give off the "space racist" vibe.
Again, you look at the rebellion as represented in Rogue One - a female-led multicultural resistance fighting against evil white men - and it's hard not to come to a specific conclusion about the Empire.