At the very least the beast tribe strongholds, bandit hideouts and especially garlean strongholds should have threatening mobs, granted i would like a more dangerous open world in general but the things I mentioned above should be dangerous at the least.
Heavy is only a minor inconvenience and I would prefer something more perilous with or without heavy.