As Xenor stated, remove the SP penalty, and leave the fail to acquire resources.

Without a limit to the influx of gathering goods, there would be a flouding/overflow that would crash the econmy value of any harvestable item.

I don't even play anymore because the game is mind numbing, but my primary goal was 50/50/50 DoL and Fatigue is one of the reasons I don't come back.