I realise this and again I've been doing this since launch and have had no issues.
I will start making sure it's turned off properly though. They should include a software button to switch it completely off rather than just setting it to always completely turn off. The amount of time it takes to turn on from a cold boot is ridiculously long...
Go to settings-power settings- and change "Instant On" to "Energy Saver". What you are doing now is unplugging the system while it is running and it is not shutting down. This can potentially screw up a lot of things, updates being installed, downloads, saves, and of course the hardware itself.
What you are doing is very bad for the system. It would be like yanking the cord on a PC while it is in sleep mode.
Mine is in energy saver because I like my electronics to be off when I'm not using them and when I go to sleep my power strips go off. It may take a minute or so to boot up but that is the trade off.