Check slick deals occasionally for Desktop deals. You'd be amazed at what you can get pre-built. Or just use as a launching point. You can get a PC that's competitive with consoles and has the scalibility of being a modular open platform for not too much more than a console. Look into refurbished ones too and basically strip the components and put into a new case/build. There's just so many deals you can find to make it an easier transition.
To go really cheap you have to be a bit of a tinkerer, only as far as putting together a PC which if you just watch a video and follow along you'll be fine. But it's worth it. Especially if you're not someone who resells games alot. I honestly can't say I'd even have a console if I couldn't resell the games. That's the only real caveat for me about PC gaming. But the deals are good, and honestly who to say how much longer we'll have physical media to resell anyway. Any chance the industry gets to do away with it, they probably will.