Just make sure you're facing your target at all times Rysstyl. AAs are sort of on a "timer" which happen at exactly that interval shown on your weapon. So you can be looking away etc, then turn to face your foe just before your AA and you'll still hit it. If you turn around and miss an AA, that delay is held until you turn around again, thus over time, your total AA's will be decreased.

So either get used to timing your self to always face your target before you hit an AA, or learn to use Lock-On like I do.