I used to think like you, then I embraced the Cooter protocol and the rest is history.
I'd completely failed to lose decent weight for quite a few weeks and was getting properly depressed about the situation. Just spinning my wheels. Then I started having massive cheat days and being strict the rest of the week (actually no more strict then I was being already, but I'd say my intake was higher because of the cheat days).
This is what happened to my weight...
Obviously you can see a ton of weight gained on the weekend, but by the end of the week it was all gone and more. No question in my mind that I'll be doing it again when I'm cutting.
(Though I'd note, I wouldn't do it if you're really quite fat... but based on what you're saying, I don't think you are.)