In the only time I've seen Odin, he was actually the first to load (yet out of all the other FATEs, none of the bosses/monsters would). I do agree on this point though, and I think they've actual said that they're working on addressing the issue. If you haven't already, try turning down the effects of other players in the System Config(?). I think it might help a little for the time being.