This assumes that many intelligent but unremarkable people are largely responsible for our easy lives. As someone who's not a genius but goes to school with them and who has easy access to Wikipedia, I'm certain that's not the case.
Also, note how many are financial burdens on their states (no, not all public universities, but, say, California's). I wonder why that's irrelevant. Dartmouth pays its way through.