It wasn't just the texture filtering that made N64 games look good. The polygons themselves looked ROCK solid, as much as polygons on modern consoles really. The N64 really, really excelled there.
And I'm not sure I agree about the "higher polygonal rates" of PSX games. I know some games did, but Metal Gear Solid was one of the best-looking games on PSX, and it just looks like a total and utter complete shit of a mess compared to something like Ocarina of Time.