I agree that the Starks have pretty much been disregarded in terms of relevance to the overall events of the world, which will turn some people off (especially newcomers who were introduced to the series by the show imo). They're either dead, presumed dead, or in exile. It's fair to point out the house caused their own destruction but I can understand people being upset.
The lack of the 5 year gap has hurt the Starks moreso than anyone else imo. Instead of jumping 5 years and seeing a fully trained assassin Arya, a druid king Bran, a crowned Sansa, we've been stuck watching their slow progress as the rest of the world surpasses them. Are we to believe Arya will magically be a badass assassin after less than a year of training, or Bran becomes a powerful magic wielder in less than a few months? If Arya or Bran leave their training early, that makes a lot of their previous progression seem like a waste to a degree. And interestingly, most people want both of them to leave their training in some form.
That being said, I like where things are going. There are plenty of fascinating characters left, many of whom were indeed around in the first books (Jon, Tyrion, Cersei, Jaime, Stannis, Davos, etc). I would argue the story was never solely about the Starks. We've seen multiple houses propped up - first the Starks, then the Lannisters, now the Tyrells to a certain extent.