Yeah, I just use HDLoader, obviously it's more convenient. I think the network adapter used to go for a higher price but not anymore, ebay's flooded with them if you don't mind a used item.
I think the only fiddly bit I remember was getting a PS1 game and memory card and injecting something into it to run a newer version of HDLoader for better compatibility. But other than that, if all your games work, it's easy enough to just stick with the self-booting disc you can buy.