Why limit yourself to the closest proximity? They didn't even begin football until 97, and have always been a lower-rung team in lower-tier conferences. If you were interested in big time college athletics, there are better schools in Florida (and outside of it). I'm not suggesting that you find a bandwagon now, but I find it dubious that in however many years you've been a sports fan, you haven't developed other rooting interests, or it never dawned on you that USF wasn't one of the big boys.
Being from just outside of Greensboro, NC (now living in Charlotte), there are several colleges and universities in the city, and other than alumni (and I am one, UNC Greensboro), nobody has more than a passing interest in those athletic programs, and even those that do have larger rooting interests in power programs, mostly one of the "Big 4" in state ACC schools. We grew up rooting for Duke, Carolina, NC State, or Wake. We went to school at UNC Greensboro or NC A&T (although talk to an A&T grad about Aggie Pride, it's serious business). It's just the way of life. Maybe it doesn't translate to you, I don't know, but it seems fairly normal around here.
Another example, UNC Charlotte began football this year, and will move up to FBS in a couple of years. I guarantee you that every person sitting in the new stadium on Saturdays this season, even the students, went home and either checked the highlight (or watched the game, if it was later) of their actual favorite team.