Controversial take here, but I think a lot of this in some modern television (like a lot in the rest of our society) is that writer's rooms are often staffed by people from elite schools and/or nepotists who never had to go through a crucible of actually appealing to a real audience. Meaning that they've studied writing theoretically and their dad knew someone at the studio so they got the gig. This is basically elite rot at every level in society and culture is no different.
The best thing that could probably happen to this stuff is putting writers through the crucible of needing to actually sell books by themselves on Amazon for a year or two. Compete in the real market and see if they could make a living as a middle grade writer with a Patreon (most of them could not, I suspect).
Just saying this as a bit of personal experience as someone who went through this to a degree, you will learn so much more about how to please an audience by getting your ass kicked on Kindle Unlimited than jumping through elite hoops. You will have to unlearn what you have learned about trying to be clever and subversive and instead focusing on hitting correct story beats and tropes.
And fundamentally, writing genre shows is about pleasing your audience, whether Disney or whoever likes that or not. Even if that upsets whatever sensibilities you are trying to project to the world.
Mandalorian did this pretty well. Boba Fett did not. This seems to be somewhere in the middle at best.