I left NYC for Orange County...Florida.
But just be clear of a few things, cost of living is HIGHER in California's Orange County than New York City.
1) Taxes are higher
2) Gasoline is more expensive
3) You absolutely NEED a car.
4) Real estate is a tick higher than NYC in many areas, so $2000 is a doable budget, but just be aware that you won't be saving money living in a nice area in OC. You may find yourself spending a tad bit more.
Otherwise, good luck and do A LOT of research. There are a TON of really shitty areas in Orange County - I'd generally avoid anything near downtown Los Angeles, for example. Places like Long Beach and Comtpon are also the obvious no-nos you want to stay far from.