Simple solution: Make it cast what you want to cast instead of silence. You have that capability.

My automaton doesn't ever cast silence on anything unless I signal to it to use enfeebles.