It doesn't even affect the game in any way.  It only happens when there's like a crazy amount of breakable objects on screen at once and those usually happen during those cinematic slap scenes where you're breaking an entire building in a slap or when you're zooming around in the map (dock mode only).  99% of gameplay is super smooth.  I really thought it would affect me but nope, game looks crisp, plays well, looks great.  I mean if they ever even it out over time I wouldn't COMPLAIN but I would be firmly against lowering settings to try and get a smoother framerate for that 1% of moments that don't/haven't mattered to me one bit.  This is just a product of having a game that has dynamic environments that you can crush into thousands of pieces.  I feel like even PS5/Series X would have frame rate issues at their respective resolutions with that type of dynamism.