Thanks for all your replies.

I was actually thinking trying Red Mage later on.

I think I'll also give the class another chance - at least until lv 40 after I have played the real Blackmage class for a bit. I have also noticed that I haven't gotten any passives yet. Maybe that stacking fire attunment will make the difference?!
I hate giving up :-P I was just really frustrated.