I'd say, open the option to invite players because a player either left the group or was kicked while offline (not "because offline", just when offline). That would prevent the abuse.
I guess there are also technical reasons this isn't a thing tho..