I don't know that there's really viability in starting from the ground up as far as fashion is concerned. I mean look at how the pieces he's done so far are received. His white t-shirt thing sold well but it was also clowned by a bunch of people. Meanwhile high fashion companies do that kind of thing all day and are by and large above criticism for it.
I mean if Kanye had created a clothing line all his own.. bought and set up his own factories, sourced the materials, done all the designs.. and put out stuff that looks like the stuff he's wearing.. how successful do you really think it would be? A lot of his own fans would laugh at the designs AND the prices.
Even looking at stuff that starts from a similar place (The Hundreds, 10xDeep, etc..) they pretty much have to stick with "Streetwear" styles to make money and can only dabble in experimental stuff (which usually doesn't sell well). Of course that's the risk that you take creating something from the ground up but if Ye bankrupted himself doing it, I bet a lot of people would say "he should've liscensed his shit through a high end label if that's what he wanted to do" after the fact.
Of course the criticism that Devo presented in Ye making it out to be a larger social issue rather than a personal issue is valid in any case.