You do auto-attacks inbetween Holy Spirits, but Holy Spirits pause them. As long as you are in melee range you will be auto-attacking and accumulating some gauge, just less while casting things.

Of course, they could alter that.