I assume this bothers you with Iron Man, Hulk and Thor to an extent as well.
It kind of does actually, i tend to dislike a movie when it over uses cgi as most cgi comes off as looking extremely fake and unrealistic to me. I wasn't the biggest fan of the original Iron Man (storyline issue particularly when it came to the final battle... but then most Marvel movies seem to be bad in that regard).
The cgi in The Avengers took me out of the film and was one key reason why i did not enjoy it (as well as script and pace issues). When it was cgi with cgi it looked ok (particularly when Hulk was battling other cgi elements) but when the cgi meshed with human elements it looked unrealistic. My eyesight is fine by the way.
There was one sequence in Spider-man 2 that looked super realistic and was convinced that they filmed it as is with stunt doubles and such. I saw a making of the movie special AND the scene in question was green screened with only the actors the "real" elements, i was shocked and disappointed.
It saddens me that when a film resorts to using cgi as it can quite often remove realism from the film.