But Nintendo said the speakers are exactly the same, only the shape of the speaker holes have changed.
Lol. I don't know why you think that.
Look at the last Iwata asks. They are new rectanglular speakers, unique to the XL. Look at the transparent XL in the article to see them. They were a risk taken to keep the form factor they wanted for the console, and it hasn't paid off.