your not doing anything wrong as it is complete RNG as is most content like gear for instance.
Maybe try doing 10 or so fates in one area then moving to the next. Some players got all atmas the first day, others in a few days, etc.
I figure my lack of luck has helped those players get their atmas,