Dropping Enoch only makes you lose F4/B4 and a 5% damage buff. So really in AF3 your Fire spells were already getting buffed by 80%. Enoch jumped it up to 85%. Once you get a handle on your timers it becomes very difficult to drop Enoch and even if you do most cases it isn't a big deal.
The only time I guess it matters is strict fights like Extreme/Savage content. Other then that it's fine.
