Instead of removing the whole thing, i would say an adjustment/balance is in need. Say those basic attacks should consume little stamina comparing to a WS. Magic should use the same minimal stamina and still depletes MP.

And they should add more cool animation in it.