It's pretty weird that we got no videos showing exploration. Wasn't like that when Bio1 or 2's release was near.
Hope they didn't turn it down for the sake of action ...
Not sure if you'd consider it exploration, but that Gamespot plays Bioshock Infinite video had a good amount of gameplay that wasn't in combat. Be warned though, it's pretty spoilery.
EDIT: Beaten, heh.