They already can't be bothered to get it right rather than give the government a free loan.
I personally find it weird your government gets away without paying interest. The CRA gives you 4% APR compounded monthly on overremittances. It's a better rate than CSBs or my savings account.