I found that even if you have the spare fleece/wool, you should not use it to level. A lot of the level 50 LTW and WVR stuff requires undyed woolen cloth. Plus, linen stuff should easily get you to level 50.