If you don't think immigration is a major factor here, you're being naiive.
The problem is A) too much immigration and B) too much beaurocratic BS. The first is as a result of socialist policys, which result in huge numbers of immigrants coming in to France and sponging off the state. This pushes up taxes. The same happens in the UK. This is made worse by being an EU member, and therefore having 0 control over your borders.
You can start to fix this problem by stopping immigration, although the real fix is to put a stop to socalism. But really you need to do both.
The beaurocrat problem is an issue caused by being in the EU. Put simply, in the US they look at a new idea and ask "how can we make money on this". In the EU, it's "how can we regulate this". The only way to fix this at this point is to leave the EU, as there's too much legislation being produced. This is why UKIP is now a thing in the UK :
http://www.bbc.co.uk/news/uk-politics-29549414