The best argument that I have heard came from SE, they said that if certain jobs could wear some of the armours, they would confuse players when doing PvP. So I think they should keep the current restriction when doing PvP, but remove them in PvE.