The 320.18 drivers are definitely screwy, and I wouldn't be surprised if a lot of the little hitches are ironed out with the next release. They again, I wouldn't be surprised if they weren't.Since upgrading to my 770 4GB last night and the 320.18 driver, Bioshock Infinite has been slightly buggy to at one time graphically glitchy as hell for me.
Yesterday, I played a couple of hours and I just noticed pop-in was a little worse and an overlay in the Escape menu wasn't taking up the whole screen.
Today I was playing and the floors and walls started to disappear, and enemies appeared as these giant balls of silver and red spikes. Things were absolutely fucked until I restarted the game.
I think something's just up with the 320.18 driver. Maybe Nvidia hasn't released an official driver for the 770 yet or something, maybe the 320.18 driver just sucks, or maybe it's my card or my install.
Nonetheless, I haven't experienced any of the graphical issues on Bioshock Infinite that you have, but I will play a bit more tonight and keep an eye out for anything odd.