I used to buy mainly from psyshop but I recently changed to saiko sounds because they are faster to deliver (usually a day or 2)
I usually buy most of my CDs though from physical shops. Tower records for new stuff. Also Recofan which has to be my favourite shop ever, they have lots of 2nd hand stuff usually in great condition for really cheap