No.
Fucking.
Way.
When my mum came over to visit from the UK recently she brought me a bar of Marmite chocolate. It was pretty nice. Just a subtle taste of Marmite, and after a couple of bites, you could barely taste anything other than chocolate.
The Vegemite chocolate will taste like filth, obviously, because it's got Vegemite in it.