yep, iTunes sucks and iOS has its own problems, the inability to downgrade being chief among them.
Can't you just restore previous firmware, iTunes dumps old versions in your recycle bin. Then you just force it to use that file. Downloading old versions is the problem if you delete them I imagine.