Is it only happening on specific classes?

Do the affected classes share any gear?

Have you tried removing a different single piece of equipment, from your leatherworker gearset for example, place it in your inventory each time then saving the gearset and switching back to it? Process on elimination to see if there is a specific gear slot causing it.