Is it that hard to just switch to grit when your going to go take the orbs? I do that on WAR all the time. It's not hard, and you don't lose anything. Then switch back when your done with orbs.