I only pull when I have some sort of stack, buff, or something that's important and it's about to run out :P but I always apologize when I do so, which is rarely. (Because mostly I do it when I'm with friends)