I can help you learn about the more popular low end setups, the crazy $500 high end stuff is way out of my league.
Affordable High End - Saitek X52 -
$120 Supposedly the best you can get at a reasonable price. David Braben himself plays the game with this setup.
Lower End - Thrustmaster Hotas X Joystick + Throttle -
$45 The cheapest all in one solution, never used it myself but I've seen some sick dogfighters on youtube who use this and have endorsed it with high praise. Probably doesn't compare to the X52 in build quality or responsiveness.
Thrustmaster T.16000m Joystick -
$47 - This is the stick that I currently use, highly recommended by the community. It's an extremely responsive stick that will help A LOT with mobility and combat but not much else. The stick itself is great but the button setup on the base is terrible. I find that the best way to use this stick is with one hand on the stick, and the other on the keyboard. This works out perfectly since the flexibility of the keyboard gives you thrust control and complete control of all of ship's systems at any given time.
There's tons of other joysticks out there, but these are the ones that I'm seeing most commonly recommended for new players.