Yes and No. Just to clarify this a bit, Kinect was initially an add-on, people willfully went out and purchased it because of hit games like Dance Central and Kinect Sports. Dance Central 1&2 were pretty great games actually. It was a fad where motion was all the rage at the time and some neat stuff came out of it, along with shovelware, mostly shovelware. The platform didn't have to hurt any more than the Guitar Hero and Rockband fad going away because they're mutually exclusive platforms.
Everything was fine, until....
They forced it into Xbox One and you had no choice but to buy the damn thing if you wanted to buy an Xbox, adding $100 to the bill, and to exacerbate the issue further, there were some decisions that went into the design of Xbox One that made it cost more to make than a PS4 while at the same time being less powerful. They needed to guarantee that the system had 8GB of ram to run the ambitious OS, there was no route to 8GB of GDDR5 at the time (If you look up the timeline, Samsung had not released a chip with the density to fit it on the board in a 256-bit design) so you either had to stick with 4GB of GDDR5 or 8GB of DDR3 and MS went with the latter while Sony stuck with 4GB of GDDR5... whelp the stars were aligned for Sony and production was right on time that allowed the use of 8GB where Sony upped the system from 4GB to 8GB of GDDR5 which made fans go on a frenzee. The Xbox One having gone with 8GB of DDR3 meant they had to add ESRAM to the die, which made the GPU die actually more expensive and the design more complicated for developers, but also left little room for compute units, ultimately leaving a die with 14CUs vs Sony 20CUs (respectively 12 and 18 active).
All of the above is to say that you have one system that's $100 more expensive and less powerful, it just did not make sense to gamers, but it didn't end there, now here comes what imo made things a horrible start for Xbox, the "Always On, always online" policy where games had to do a check against the server or you would get a message that you needed to connect to the internet for the game disc that you purchased would work... W... T... F!? people started going bananas, there were even YouTube videos showing games suddenly stop working because of this check, it happened with Killer Insticnt during a tournament, and although it was ultimately reversed with a day one patch, severe damage was already done, the news spread like wildfire and gamers refused to touch an Xbox even with a 10 foot pole, the momentum that Xbox 360 had built over the PS3 was completely wiped clean and it is now Xbox One doing the walk of shame like the PS3 $599 fiasco of 2005, a complete reversal where MS is still picking up the pieces.