In FFXI we had something similar called Adventuring Fellows. They could be out while you seek a party and were not in a party with you but by your side. It you joined a party it did assume a spot in the party but once someone entered the last spot it auto dismissed. I don't see why they could not do something more like this?