This is a legit concern, it's understandable that you feel this way. It probably can't be easily fixed though. Bad latency will result in a poor experience in an online game, in a number of ways, and favors is one of those things. If they add other methods of getting the materials then you could spend your scrips on gathering gear instead of favors, or just do that anyway and save gil for favor mats instead.