It's not too hard. It's really easy. It just happens to be one of the few 4 man dungeons before 50 where boss mechanics are actually relevant and everyone has to pay attention. Which means that it's hell in Duty Finder. If you're really set on clearing it, run it with 3 people from Party Finder. Talk about the boss mechanics before you head in, be cautious on trash pulls, and it'll be a piece of cake. I'd just like to note, however, that the mechanics of AV are very specific to that one dungeon. It teaches you to be overly cautious, and then you're in Wanderer's Palace where it's better to take things at a faster pace. I really don't like AV, not because it's hard, but because it's a giant annoyance that takes dreadfully long to finish and you get less experience than just spamming the first room of DD, which the OP was planning to do before running AV. I like AV's bosses though, I think they're great - but the rest of the dungeon is a giant time sink.

Also, maybe I'm wrong, but I thought they phased out needing to clear AV? I remember a lot of people complaining about it and then some adjustment was made. Could be wrong though, foggy memory.