Bard is fairly complex, to be totally honest. It's got several simple and straightforward things all going on at once, which adds up to a complex playstyle when you have to keep an eye on all of them. I actually decided at about level 67 or 68 that it probably isn't the job for me in the long run because I favor a simpler playstyle. I was always looking up and thinking, huh, how long ago did my song/DoTs/whatever expire? Guess I'd better put them back up...
Summoner also seems pretty complex, so if complexity is a downside for you I don't think I'd recommend it.
Red Mage, from what I've read, is one of the easier jobs to play, and the utility it brings is the sort that's only really needed in emergencies (extra healing and raises). That seems like it might be more my speed, and I plan to give it a try, myself, once I've got a little more experience at healing. It kind of seems like it might be a good fit for you, too. It'd make your party really magic-heavy, which might make some fights more difficult, but bringing Vercure and Verraise can make up for a lot of party weaknesses.