It's really him or Serena. At least in recent memory anyway.
I don't follow tennis, but from what I see on sports sites, he and Serena are definitely the worst. Djokovic is an arrogant pissy dude with zero personality. Nadal is the emotional fun guy. Federer is the quiet leader. Put three of them in a room watching sports and if their favourite team lost that night, Djokovic would the one smacking his beer can against the wall. He's also the one who could constantly tell people his team has won the most championships, so if you talk sports with him and your team won, and his team lost, he's the guy who would bring up "yeah, but my team has won 10 cups, your team 4". Nadal would be happy talking about both team's historical success, and Roger looks like the guy who wouldn't even care or know which team has won more trophies.
Serena is a ghetto loudmouth whose a sore loser. You'd think someone brought up on tennis would be a prim and proper kind of attitude, but she talks like someone from the hood sometimes. Odd.
Amazingly, McEnroe back in the day had huge yelling matches causing a scene. But I don't think people hated him much for it. People seemed to like it. You could tell later in his career he was playing off it more for fun, but in his early years he seemed genuinely hot headed. But (I think) people still accepted it.