Enjoying something which is not generally held in high regard, while at the same time feeling a bit guilty about it, is called a guilty pleasure.