There were legendary bar fight stories with him and non-wrestlers. Once, he got into it with Harley Race, who himself was a legendary tough guy. Mulligan ended up on top of Race in a hotel room as they were on the floor between twin beds and Race couldnt get Mulligan off him. Flair, Race, McDaniel and Mulligan were traveling partners that night, and Flair noted that he was scared to death Race would try and get retribution later, but it never happened. Mulligan knocked out Ole Anderson, who himself was a noted tough guy, at least twice, although Anderson claimed they were sucker punches. He pounded Sheik Adnan El-Kaissie, who was a world-class amateur wrestler.
On December 29, 1987, the Observer reported that Probably the best match on recent independent cards took place in the dressing room at Miami Marine Stadium. Blackjack Mulligan saw Bob Roop (who represented the U.S. in Greco-Roman Wrestling in the 1968 Olympics) in the dressing room and pummeled on Roop so badly that Roop needed medical help. Apparently there were some problems going back to when Roop booked Florida.
But his most famous fight, or fights, were incidences with Andre the Giant. In one, Andre threw him into a wall in a hotel or motel so hard that Mulligan went through the wall and into the next room which was occupied by people.
