OP, you said the N64 controller was 'awkward to hold', now did you hold the controller like this?
This is how I always held the N64 controller. It's the only correct way to hold it as well. All of the "official" suggested ways to hold the controller are trash in comparison.