Uh... yes? This thing hasn't gone away and is not showing any signs of going away.
Even if you think it's not going to kill a lot of people (which it already did), it's straining healthcare resources that could have been used to treat other stuff.
We're in this state today because we never treated the flu seriously enough. We went to work sick. We never had masks at the ready. We never had our jabs regularly and we have anti-vaxxors. If we were prepared and threated the flu seriously and have these best practices as a habit before the pandemic hit, things wouldn't have spiraled and snowballed into the situation we have today.
So yes. We should be worried every flu season.