For me, Oblivion was just too non-linear, too open-world. I just lost track of everything; not only the main plot, but the world itself, as well. I wasn't a part of the story, because there's just SO MUCH STORY.
Linearity is something that should be balanced carefully. Not too much, and not too little.