Someone should check me on this, but perhaps setting your status to 'Busy' in character info will block incoming invites of all kinds.