KuwabaraTheMan said:He sent every person loyal to him away, he surrounded himself with people who disagreed with everything he did and never listened to them or met them halfway, and then he publicly announced that he was running off to break his oaths and asked who would join him.
As opposed to keep all the people loyal to him around and having rebellions sprout everywhere else where he didn't have any influence. He explained repeatedly what he was doing and why, which was common sense. Taking in the wildlings was the only reasonable option he had and he went to great lengths to make sure that the wildlings were under control as well. Then at the end he announced that he was going out to deal with an army that was coming North to essentially kill them all and as he stated nobody had to come with him on this.