I don't see what's wrong here. He looks at Chappelle, sees that he's looking away, then goes for the other handshake instead since he's looking at him. Chappelle turns away afterwards, so there's no hand to shake. It only looks bad because he has sunglasses on and you can't read explicit eye movements.