Buy a Brook converter. It's like 35 and allows you to use 360 periphrials (including fightsticks) on Xbox One. Have one that's Xbox 360/Xbox One to PS4 that I use to play Street Fighter V with my 360 stick that works flawless with 0 input lag.
I'd post a link but their site is down for maintenance.
But a driver patch would be 0

You're probably right though.