Can't comment on Xbox One controllers specifically but the 360 controllers are NOTORIOUS for stick drift like that. Wouldn't be surprised if One controllers have a similar construction for the analog sticks that causes that issue to persist.
Ah thank you. Would be a shame if it was a problem with it but it'd give me an excuse to get an Elite controller.