While I don't know the answer to your exact question, the greater point to the swapping is that PvP skills cannot be used in PvE content. The reverse is also true, PvE skills cannot be used in PvP. So setting up your PvP skills on your PvE hotbar is, in a sense, a waste of space.