Devs have already confirmed that "randomness" is intentional for offhand gathering. You can only influence it slightly with gear stats.