Spriggans only aggro if they touch you, just avoid bumping into them. Walk past trees as others have suggested, and just kill the wolves on the way. When you fight near a tree you can't move around with your weapon out, your only movement with a weapon drawn is running, so you gotta stay still. You'll also find delay after putting your weapon away, give the game a few seconds to realize you're back in walking mode.