Could add a Exp block option or Item that prevents you from gaining exp from combat.

I mean it'd be a very niche item or Option, but I mean, they added something similar in Bravely Default (turning off encounters) and such and it worked out great to be able to control how fast/slow you exp'd.