I do wish they'd fix the speaker. Motherfucker is awful for every purpose, including phone calls. I use the wired headset approximately all of the time.
It's weird that no one ever seems to namedrop the speaker as a problem. Not only is it not anywhere near loud enough, but the quality is horrible. My two-year-old brother uses it for music (he can't figure out headphones and they'd be dangerous anyway) and it sounds like distorted death at even the lowest audible volume, a problem I don't think is really that significant in comparable high-end phones. If I remember correctly, even my LG Chocolate from a couple years ago had significantly louder, clearer calls, and borderline usable music playback.
I mean, in a public place, using the speaker for a phone call just ain't happening. And the speakerphone feature is totally useless. I don't think I could hear that shit clearly in a damn library. Is this Apple's way of encouraging headset use, gimping one feature to encourage another? That'd be dumb.