Working as designed. The trait mentions that using any action other than a spell will cancel the effect.