There's two ways that I can think of to address your question.
Controls:
I know it probably dates me, but I like my camera controls inverted. Every so often, I'll play a game that doesn't let me play that way. If I really want to play the game, whatever, I'll deal with it. If the game isn't amazing, I toss it aside pretty quickly. The same is true of weird button configs. I'm looking at you, PS2 version of Devil May Cry. I put up with it, but, boy was that ever ill concieved. I guess there's also games that are just akward to control as well. Something like Metroid Prime Hunters, for me, was just all around annoying (same with the Wii Prime Trilogy). Again, I dealt with it because the games were good.
Gameplay:
Some games need you to conform in other ways. For example, I think a lot of the trouble people had with Sekiro was that, unlike Dark Souls and Bloodborne, it gives you comparitively few ways to play it. Sekiro needs you to conform to certain styles of play in order to be successful. Really, most games do this, but what Sekiro asked of the player was, well, hard and there were few ways to sidestep that difficulty. That said, the game was great and I conformed to it. Another game that forced me to play it the way it wanted was the original Gran Turismo for the PSone. Before Gran Turismo, I'd only ever played arcade-style racing games. The driving simulator was a very new genre and I kind of instantly loved and hated it. I had to learn how to conform to a new type of driving game.
Conversely, there are games like Rare's collectathons. I just ... man, I just don't care. There's nothing that I find engaging about that.
Bonus Round: No More Heroes.... Controls and Gameplay that are just awful. And yet I conformed beacuse I love the weirdness of it all.