Technically, you never lost your team, and the Ravens are an expansion team. Per Wikipedia, source of all things facts:
"On February 9, 1996, the NFL announced that the Browns would be 'deactivated' for three years, and that a new stadium would be built for a new Browns team, as either an expansion team or a team moved from another city, that would begin play in 1999. Modell would in turn then be granted a new franchise (the 31st NFL franchise), for Baltimore, retaining the current contracts of players and personnel. There would be a reactivated team for Cleveland, where the Browns' name, colors, history, records, awards and archives would remain in Cleveland"