Why are there so few Hellsguard? Is it because of the nose? They are so charming.

Not even in-game NPCs have that many Hellsguards compared to Seawolves. Is it a lore thing or just general preference?