For leveling Weaver, just skip the fleece phase. Keep making the gathering hats from the level 35 leves based on flax instead. This got me to 50 with much less of a headache.
You'll still need a bit of fleece for the class quests at the end, but nothing substantial as what you would need to level off of it.