I remember the devs said the restriction was set to no "confuse players". Like a white mage wearing paladin gear for example.