Honestly question, if someone wants to sleep with you because you are famous/talented or they think it will help them advance their career, are you to blame for doing it? Whedon isn't exactly Mick Jagger but I don't doubt he legitimately had people interested in him just for being himself or for being in charge of so many projects, no "grooming" required.
Like, telling an actress they have to sleep with you or they won't get a part is one thing, but what if it's initiated by the "less powerful" party? Is it the more powerful's responsibility to deny regardless of circumstance because of the dynamic?