You can go into your character options and turn off battle effects for everyone but you and your party members.