This has been happening to me since PS4 release. Only way to solve it is restart the client. I also agree, it's a pain in the butt. Would often happen after big fights (Hunts, Odin, Behemoth, etc), crowded areas in general made it happen. Mostly play on PC, so it's not THAT bothersome, if it was my system of choice, would drive me nuts.