I absolutely fail to see what's fun about garrison... its just like the mop farm: you do it cause it grants gold/mats not because you want to (its not fun)
I'm sorry but managing minion is not fun specially not in this manner. Every game that had minion managing is a fire and forget till you get loots and is boring. If I wanted to manage stuff I'd play sim city or the likes. And its not like pet battles; pet battles are crappy but not mandatory. Garrison will be mandatory because the whole expansion is about it.