Immersion wise, yes, great idea.
Server/Load wise, could be a problem. It would drastically increase the population in that one location.

Things would need to be moved around (i.e., the adventurer's guild moved out of that location to somewhere else).