Yesss.
This was my biggest turn off to the atma books. I can spam dungeons. I do it anyway. I can slap some monster around, sure. Kinda easy, even when you're camping the same monsters as someone else (could just party up with them and knock it out for both without worrying about who gets the cred).
But the fates wait time.... besides the redundancy of the books themselves (I hate repeating myself numerous times), this is a good portion of the reason why I stopped doing the books - and now just use the yagrush.
Edit> It's not so much doing fates, but rather like the OP said - the wait time for their spawn