So one such theory of complex societies collapsing is proposed by Joseph A. Tainter which serves to explain the development of Complex Societies and how they tend to fall.
Complexity is defined as both, Diversification in function, specialization in structure and behavioral roles, and increasing integration and control of behavior. So in effect societies develop more parts and more different types of parts within themselves. More over you develop mechanisms of power which bind those parts as a whole functional unit. Societies grow in complexity both by adding complexity but managing that complexity into a functional machine, otherwise you just have a box of useless parts so to speak.
Complexity has a drawback however, mainly as societies grow more complex they run into various key problems. Tainter’s theory, to simplify things is that as societies grow they become more complex, slapping on layer after layer of institutions, regulations and customs to deal with challenges (and, I suspect, to facilitate the ruling classes’ extracting resources from the ruled).
Over time, these layers grow more and more rigid and take more and more of the society’s resources. It’s hard to change them because every layer of complexity represents some group’s livelihood or claim on power. Eventually, the society is devoting almost all its resources to maintaining these institutions and has very little reserve left to deal with the unexpected. The result is that challenges that it would have weathered easily in the past are now sufficient to bring it to an end.
Political solutions are not always capable of solving such crisis'. Political leaders’ chief concern is their own power and position, they’re willing to do almost anything to stave off a collapse, except reduce their own power and position. Kicking the can down the road usually just makes the problem worse in the end, but politicians would rather do that than make any sacrifice up front.
In a sense Tainter presents a Malthusian style crisis as a kind of inevitability. Complexity consumes more resources, sustaining complexity costs more resources than the initial expansion. Powers that formed around institutional structures resist change or reform, the system bleeds and dies. One might argue that Innovation and technological progress will avert all future social complexity issues, that is central to the Futurist narrative of things. That soon we will have Woo-Gee-Amazing new innovations and they will effectively prevent the Malthusian crisis. Nicholas Rescher presents a bit more grim response to that, his studies point more towards the understanding that innovation becomes increasingly more expensive to carry out and that R&D costs go up exponentially and the returns decline relatively thus making it prohibitively expensive. For Nicholas Rescher every new breakthrough in the technological arms race against nature leads to an all new level of difficulty and intractability. Science has a habit of exhausting easy answers, so for example early scientists like Charles Darwin and Mendel could be these lone wolf geniuses because effectively they were trying to answer relatively easy questions. Now it takes interdisciplinary teams, vast budgets and resource marshaling to answer questions. Or in simple terms look at the number of advanced air war vehicles, compare bombers from the 50's to today and just how many of them we are able to effectively produce.
In fact for the Military alone there is a book called Augustines Laws, which covers this problem in action in Military tech, "in the year 2054, the entire defense budget will purchase just one aircraft. This aircraft will have to be shared by the Air Force and the Navy 3-1/2 days each per week except for leap year, when it will be made available to the marines for the extra day." In general innovation does not always come at greater returns. One thing is that resources needed to maintain substantial productive innovation will be so costly as to wipe out the society. But Innovation in general will continue to decline in innovation productivity.
Video talk by Tainter
https://youtu.be/G0R09YzyuCI
So, Complex Societies? Doomed to the Malthusian Apocalypse or will Technology really save us all?