This has to be fixed by SE however.

1) add an option to queue ONLY for party in progress.
2) limit the number of times you can use it daily.
3) if a forming party is interrupted by a players who rejects or is afk, just find a replacement for that player, without starting the queue over again.
Like "1 player didn't accept the duty, finding another one, stand by", than it's found and who has already accepted doesn't have to do it again.

players are not using this feature in the wrong way. Is the feature itself that is poorly made.