Removing Nvidia-related permissions isn't going to protect against a decision to have the keys revoked. The heavy lifting would rest on Microsoft, and even if Nvidia can revoke keys itself, any accounts it couldn't access would just be handballed to Microsoft.