Within 4 ranks should be instant. It is possible one of you had been queuing for synced while the other was in unsynced. (You need to make sure everyone unlocks synced by talking to the guy at the Pier)

Just gotta make sure everyone is on the same page. It's not necessarily the average that needs to be the same or w/e but just the cumulative total.