I've definitely come to the conclusion that distance from the camera is the main factor in tracking. Even with sunlight lighting up my room, having the camera propped up on the PSVR box on top of my coffee table ~4 feet away from me gives me nearly flawless tracking.
I think I'm going to do what someone on Reddit did and cable tie the camera to a microphone stand like this:
Then you can move the camera around freely to anywhere you want in a room, set it to the perfect height whether you're standing or sitting, and put it all away in the corner somewhere when you're not using it.