That still means only the wealthy are buying houses >$500k. They don't need government subsidy.
Tell that to people that actually do it though and see what they say. Without that subsidy, many more people would potentially lose their homes, or be unable to purchase at all, leaving home buying to the truly wealthy in some areas
If you live in a major expensive city, you are paying close to 500k for a basic home. You probably seem rich to those that live in other areas, but in that area you have greater expense for practically everything: food, gas, real estate, etc.
These solutions are tough because they never take into account different cost of living per state.