If the above case is true for many of us..

I'd like to suggest SE to consider adding a NPC in Cities and camps, perhaps typical "Pay some gil I'll restore that for you" style, with a cooldown limit on how many times we can use it within a hour or so.
This way the influence on class switching to abuse gathering + fate (which is probably what SE is afraid of) should be limited.