You don't need to go to your grand company that often. There's no reason why you should have felt compelled to align with Ul'dah because of that.