Err... In explorer, i think it's Tools > Options > View > Hide extensions of known filetypes (uncheck it).
Then rightclick on the file, select rename, and add the extension to each file. You could also open a command window and do them all with that, but it's probably easier for you to rename them individually.