Nah, not really.
This is the same as how there is a free Wikipedia app and a paid one, the only difference being that the free one in the case of podcast downloading is made by Apple. If someone bought the paid Wikipedia app, and later found there was a different one that was free, they'd just kick themselves for buying the paid one.
How is Apple liable for that? It's not an outrage, it's pretty simple - if third parties wish to make an application that was completely within Apple's guidelines, and charge money for it, they should not be rejected just because Apple themselves are making something similar.
Or put it more simply, why are third parties allowed to compete against each other but not against Apple? That doesn't sound anti-competitive to you?