What gives you the right (Looking for DEV response)

[Crimen]

What? What are you talking about exactly? I do the exact same thing and my rested exp remains until I use it up.

Edit: Yeah, better said as Tareel said, you ARE using it while you gather. Rested exp isn't literally a new bar of exp, it just shows you how much will it give you a bonus for.