Well that's a pretty typical blame others response. You didn't mention anything about personal responsibility and that's why I mentioned it. You fill in the blanks (with beliefs about me/society/the world) to make your world view seem to make sense.
No one growing up in poverty and violence has a high likelihood of succeeding in life (define success however you will). Though, having unprotected sex with numerous people and having children with no means to raise them is about personal responsibility. Growing up in a poor neighborhood and deciding that because I don't have something (a car, money, whatever), doesn't give me the right to take it by force from someone else (commit a crime). That is about personal responsibility. Knowing that idle time is the devil's plaything is a very real concept, and is even more important, when there are more forces at will looking to distract your child into negative behaviors. Whose job is it to teach these things? Whose job is it to monitor the kids growing up? This job falls primarily on the parents.
I guess what I'm saying is that if you wantt neighborhoods/homes to improve, expecting the government to step in will leave you pretty disappointed. As cliche as it sounds, it all starts in the home. And this doesn't have much to do about race as you'll see the same type of dysfunctional families living in poverty and violence.