Yes there is a limit, you cannot have everyone flooding into one world at the same time. If the world you are travelling to is your home world, there is separate spaces reserved for you to return, so you may still return home even if the visitors allocation is at max capacity.