Sometimes those quests that can't be abandoned are the bonus quests where you have to enter a story area. And since I have already completed the main quest there I can't get back into that story area, and as a consequence unable to complete the bonus quests even if I wanted to. Those are the most irritating ones. For all of the rest, I agree with you. I just go back and finish those.