I never took the implication that its "heavy" just that people can't pick it up. Which is why he can lay it on Loki's chest and not turn him into a pancake or when he drops it in the forrest from like 100 feet up and it doesn't make a crater. I just wish it wouldn't bounce when he did, would look much cooler