I don't think SE has thought about this one in much detail, Myself i have a Town Gear armour set, that I'll switch into but I haven't really thought as to why I'd need to switch on a whim for the current job I'm on, its a little thing that no ones that bothered about at the Min,

in FFXI it was easier due to the fact you where tied to a job unless you changed it at a moogle, so removing weapons wouldn't put you in a limbo role, unless they allow us in the future to become an "adventurer" role or something to that extent capped at level 1 when/if we unassigned a weapon, I can't really see much being done about this.

I doubt it would take much to code a gear swap when not in battle for these things, especially for all the RPers out there, it would be probbably something welcomed, I hope they do this for you