I feel the same. It took me a while to figure out why the superhero sets almost never interest me, because I generally like the movies they're based on (never been a comic reader though), but it eventually hit me: I'm drawn to impressive or iconic building design. The superhero sets are almost always a handful of minifigs that people really want, and then a bland jeep or truck or something that, separate from the figs, doesn't really look like anything. I like minifigures as much as the next guy, but I'm not buying anything over 20 bucks just for minifigs. I'm sure they're great sets for playing with, but they generally aren't interesting build-wise or display-wise IMO.
The only superhero set I've ever bought, actually, was the hulkbuster last year. That thing was cool. And I was tempted by the Avengers Tower for obvious reasons but even it didn't sway me into a purchase.