As someone who RBGd up to 2.4k (not hugely high) I'll have to disagree with this. There is nothing skillful about having 10 people turret damage into each other while stood at max range. There are skillful parts of RBGs (mostly the decision making), but it is not the team fights - and that is all Arena would be without pillars.
OT: No. Pillars add a massive skillcap to Arena and removing them would be the worst change to PvP ever made. Yes, sometimes pillars can be frustrating but, as people have already said, it's more of a mobility or skill issue than it is to do with the pillars.