When it comes to horror games (and movies, and comics, and books, and people doing sudden loud noises around, and...) I'm a huge coward, but I managed to play and complete AW.
There's a lot of tension, yes, as the game often pushes you to run through entire areas to avoid enemies, and of course constantly running away is more tense than fighting, but all in all I appreciated this change of pace.
And most importantly, the game has some very well designed and placed relief moments that help us cowards to keep our sanity.
Most of the jump scares happens in the cutscenes, and are something like a scary-ish image that flashes for a couple of frames and that's it.
Jump scares in game are, as Dusk and Bob correctly said, or telegraphed by a slo-mo animation, or when you hit something unexpected and self-scare yourself.
Enemies aren't scary at all, on the contrary, I found their good sense advices quite funny.
This said, I dunno if I'd play it with headphones on.
EDIT: as Anteater said: I've found the first Bioshock to be much much scarier, to the point that I've abandon it quickly and I've never played the second.
Infinite isn't scary at all, but it's a bad game
