Just put your seek back up after you join the party.

If you don't remove it automatically, people will forget that they're seeking, and I'd rather not have some stupid pop up asking me whether or not I want to remove my party seek every time I join a party with a seek up because I join parties by typing /join.