Your cards more than make up for the lower DPS output. You boost the entire DPS output of the party rather than yourself which imo contributes more DPS than any scholar or whmas that extra damage thanks to your buffs couldn't have happened if not for your buffs. Assuming DPS is the reason why the group wanted to boot you since most groups nowadays pretty much expect healers to DPS.