No, there goes so much beyond voice acting not including voice subtleties and the way we present language. There are a lot of differences in language that accentuate that fact. You can be a horrendous voice actor, but speak the language perfectly, it ain't about that shit.
A voice actor needs to be able to act with their voice. Giving life to the character and making him feel real is what a good voice actor does. A voice actor is not a linguistic expert, they are actors first and foremost.
And even then, there are just times where even with all that said, you can tell when an actor is just hamming it up and reading lines, or times when a character does not have the right voice, or times when the actor has just a bad voice in general.
People can tell when there's a good actor in a chinese kung fu flick, go look at Jackie Chan's performances in his older roles, and tell me that he wasn't an incredibly charming actor for his roles. Voice acting works in a very similar manner that real acting does, just with animation instead of the person moving his body.