Likely because he became skeptical of what the word "bigot" is used for due to the lifelong twitter crusade some of his critics have gone through to paint him as one. He brought on the Dilbert guy and gave no ground on the topic of Trump, which was the only time he had an alt-right guest on his show.
That being said, him leaving patreon is disappointing. Though it might be a situation where he feels there are people with enough pull (reza or glen) to try to push a patreon boycott of his show, claiming his podcast can cause radicalization or somesuch, and he would rather avoid the politics of what constitutes "agreeable" content according to the money exchanger.