The Village Idiots gets to choose the direction of the swapping, as in, not swapping at all isn't a potential action, right?
The vanilla version of the village idiot is allowed to do no swapping at all. I recommended that we force them to do a swap. Retro has last call on that and I'm sure he will have the final description in the opening post of ONUW 4.
Edit: If they even made it into this one. I believe he was going to RNG the list.