Scale up the manacost with the party members while out of combat if you're so afraid of abuse