Too much abuse potential, especially when the cooldown can be worked around by being in town when you switch. Which will *not* trigger the cooldown.

I wonder if that same cooldown immunity could be extended to rest areas like camps, too.