Log out and log in will cancel world visit queue. You still not be able to visit your home world unless doing so during less-prime time, obviously, but you can now do other things permitted for visitors, including duty finders, move to other areas...