Speaking up at oral arguments indicates an actual interest in getting answers, or actually exploring and considering arguments. By not speaking up it leads people to assume that his mind is already made up, since if it wasn't made up you'd expect him to ask for clarifications or to explore scenarios.