I guess the tiny abuse you could see from this system is if the cooldowns are not tracked so you could swap back and forth to your job to instantly reset your 1+ min recast abilities to use it every fight.

In my opinion though, most of those 1+ min abilities aren't that awesome that they need a 1+ min delay.