TBH I only ever visited Rhalgr's Reach when I specifically needed to for a quest or to use the tomestone/token vendors. I spent most of my non adventuring time during Stormblood in my house in Shirogane or in Kugane itself.